[00:00]
This little box was my all-in-one AI rig
[00:02]
until I decided I needed another RTX Pro
[00:04]
6000, and there's absolutely no way this
[00:07]
is fitting in here. So, today I'm
[00:08]
planning to expand operations. This
[00:11]
build is going to take a lot, so I'm
[00:12]
going to go over here to MicroEnter, my
[00:14]
favorite spot to go shopping for
[00:16]
computer parts and talk to my buddy Dan.
[00:18]
He'll hook us up.
[00:19]
>> Hey Dan, what's up?
[00:20]
>> Hey, Alex. Welcome back to Good to see
[00:22]
you too.
[00:23]
>> I got a gift for you. Not a gift, it's
[00:24]
it's mine. I'm keeping it. But this is
[00:27]
the new power supply that I have. And I
[00:29]
don't think this is going to work with
[00:31]
my setup. So, we're going to look at
[00:32]
some power supplies, a case, and some
[00:36]
fans for this Thread Ripper build.
[00:38]
>> Okay. Well, like what exactly are we
[00:40]
doing?
[00:40]
>> I've got a Thread Ripper TRX board, a
[00:42]
Monster Thread Ripper 9970X, and two RTX
[00:46]
Pro 6000 GPUs waiting for a case. That
[00:49]
combo can pull an absurd amount of
[00:51]
power, which is why I bought this 2500 W
[00:54]
power supply. Now I'm at MicroEnter so
[00:56]
we can walk around and see which case
[00:58]
can actually fit this brick.
[00:59]
>> Feel that. Dang. It's almost as heavy as
[01:02]
my graphics card. It's crazy. You do
[01:04]
your push-ups today?
[01:05]
>> Yeah. Well, not yet. I guess we're going
[01:06]
to have to today, right?
[01:07]
>> This thing is crazy.
[01:18]
We basically have two options. split the
[01:20]
load so one power supply can run the CPU
[01:22]
plus one GPU and a second power supply
[01:25]
feeds the other GPU or try to shove
[01:28]
everything into this 2500 watt monster
[01:30]
to use all that power the big unit needs
[01:32]
a special high voltage plug and a normal
[01:34]
US outlet tops out around 1,800 watts so
[01:38]
before I accidentally discover the limit
[01:39]
of my office wiring we're leaning
[01:41]
towards the dual PSU setup right now
[01:44]
>> yeah well we're doing two GPUs knowing
[01:46]
you they're probably something very fun
[01:48]
pro 6000s All right. Pro 6000s. Two Pro
[01:51]
6000s and me and my measly 5090.
[01:54]
>> With that much hardware, small cases are
[01:56]
officially cancelled. Dan tells me I'm
[01:58]
stuck shopping in the skyscraper sized
[02:00]
full tower section if I want dual RTX
[02:02]
6000s and giant power supplies. What is
[02:05]
up with this? Oh, yeah. So, that one's
[02:07]
really cool. Bethesda teamed up with uh
[02:09]
Haven to create this case.
[02:11]
>> Wow.
[02:12]
>> So, for any Doom fans out there, these
[02:14]
are limited run. There's only 1,666 of
[02:16]
these in the world.
[02:17]
>> Really?
[02:18]
>> Oh, yeah. This is sick. And I am a Doom
[02:20]
fan, by the way.
[02:21]
>> We go full kid in a candy store on
[02:23]
cases, limited edition Doom art, fancy
[02:26]
glass, even one with a tiny panoramic
[02:28]
OLED screen.
[02:29]
>> I would, of course, have probably some
[02:30]
kind of a GPU usage readout on there.
[02:33]
Memory usage readout. I love how you
[02:35]
have some of these on and just like
[02:37]
showing what they're going to look like
[02:39]
when they're running.
[02:40]
>> For the record, if you have to do two
[02:41]
power supplies, that's got to be your
[02:43]
case behind our wonderful cameraman.
[02:45]
Yeah.
[02:46]
>> Is that the case? The That's the box for
[02:48]
the case. The case itself is just a
[02:50]
little bigger than than the half 700
[02:52]
enforcer.
[02:53]
>> What?
[02:54]
>> This is the case.
[02:55]
>> This might be your case.
[02:56]
>> Can I lift this?
[02:58]
>> Probably. Yeah, you're a strong guy. He
[03:00]
can lift it. But how am I going to put
[03:01]
this in my office
[03:04]
with a lot of elbow grease? I'm scared.
[03:07]
I'm scared. This is crazy.
[03:08]
>> If people like how this looks in your
[03:10]
office, I'll do one, too, just for fun.
[03:11]
>> You're going to do one?
[03:12]
>> If you end up going with this guy and
[03:13]
the people in the video like it, I'll do
[03:15]
one, too. I'm a sucker for peer
[03:16]
pressure.
[03:16]
>> We kick around other ideas like an open
[03:18]
air test bench or just parking a second
[03:20]
PSU on the floor next to the main case
[03:22]
like a Cyberpunk space heater.
[03:24]
>> It's doable. It's just uh you know how
[03:26]
how neat do you want your office to
[03:28]
look?
[03:28]
>> How much office do I want to have left
[03:31]
is the question after putting this case
[03:34]
in there.
[03:34]
>> Yeah, the huge enclosed case is starting
[03:36]
to look less like overkill and more like
[03:38]
the only sane option.
[03:40]
>> So, this would be one of the power
[03:41]
supplies we put in I was a fan of
[03:43]
recommending the Taichi power supply
[03:45]
here. It's a 1650 W power supply, which
[03:47]
is just enough to work. It has two 16
[03:50]
pin outs, so you can use that for your
[03:52]
two Pro 6000s. Yep.
[03:54]
>> Another cool feature about this power
[03:55]
supply is for all those people who are
[03:57]
still scared about melting cables, uh,
[03:59]
which if you know how to plug in your
[04:01]
phone at night, you shouldn't be worried
[04:03]
about that. It has an extra sensor to
[04:05]
detect temperature as well, so that if
[04:07]
anything goes wrong, it's done. It's
[04:09]
also titanium rated.
[04:10]
>> Nice. Well, let's go look at the power
[04:11]
supplies.
[04:12]
>> Yeah, let's go look at power supplies
[04:13]
while I talk about the rating.
[04:14]
>> This Vertex 1200 is the one you
[04:17]
suggested to me last year. And I love
[04:19]
this power supply. I got like three of
[04:21]
them now, and it's really good. It's
[04:22]
12,200 W, but um this is also gold. I'm
[04:26]
seeing now. There's bronze, gold,
[04:28]
platinum, and titanium.
[04:30]
>> Like, you know, if one of you guys is
[04:31]
just here to build a gaming PC and you
[04:32]
want to get a titanium watt, the
[04:34]
question on my mind is why? But if you
[04:36]
do a workstation, then yeah, that can
[04:38]
mean something for you,
[04:39]
>> right? So for us, we got two GPUs in
[04:42]
there. I want to keep the heat low. And
[04:44]
when you don't have an efficient PSU, it
[04:46]
gets rid of some of that wattage that's
[04:48]
coming into it as heat so that it's
[04:51]
going to go away as heat into the
[04:52]
machine. We don't want that. We want as
[04:54]
high as possible efficiency so that that
[04:56]
power is converted into just straight
[05:00]
wattage going into the system instead of
[05:02]
heat. Did I explain that right?
[05:04]
>> Yeah. I don't I mean I don't disagree
[05:05]
with it. So titanium has about 95% up to
[05:08]
95% efficiency, which is really nice.
[05:11]
And if you go with something like
[05:12]
bronze, that's low. That's pretty low.
[05:14]
It's like 80 to 82% efficiency. Yeah.
[05:17]
And honestly, for the purposes of this
[05:19]
machine, I don't think we want to go
[05:21]
lower than platinum. If we're doing one
[05:23]
of those dual GPU cases, while your
[05:25]
Vertex might be fine for like one of the
[05:27]
PSUs, the second PSU has to be SFX or
[05:30]
SFXL, which are just like size standard
[05:33]
power supplies. So, you could look at
[05:34]
something like the ROG Loki. Um, I'd
[05:37]
probably give you the 1000 watt just
[05:38]
because then you have like the 600 watt
[05:40]
rated cable, but it's SFXL. It's
[05:43]
platinum rated and it would sit
[05:45]
comfortably in that case.
[05:46]
>> I have one of these in my current 6000
[05:49]
build.
[05:49]
>> Silver Stones is a good one, too.
[05:51]
Although it's like double the price for
[05:52]
an extra 200 W, which people can do what
[05:54]
they want with their money. financially
[05:56]
the better option is CPU GPU on one and
[06:00]
other GPU on the other because uh
[06:02]
talking about that Taichi that's a 550 W
[06:04]
power supply if we did that for two GPUs
[06:06]
and then you add um 280 for the
[06:10]
extra,000 watt for the CPU and anything
[06:13]
else going on there that's going to put
[06:14]
you at $830 right
[06:16]
>> so
[06:17]
>> it's pretty quick
[06:18]
>> uh I try uh you do that versus you do
[06:22]
maybe you could do the 1300 watt version
[06:23]
of that power supply which runs you
[06:25]
about4 400 bucks and you're still going
[06:26]
to want one of these obviously. So then
[06:28]
that puts you at 680 bucks. So you're
[06:30]
going to be aboutundred
[06:33]
$150 less than the other.
[06:34]
>> I also need to figure out how to connect
[06:36]
the two power supplies together so
[06:37]
they're synchronized. Yes,
[06:38]
>> I haven't done that before.
[06:39]
>> We have an adapter. So what this adapter
[06:41]
lets you do is you plug in the two
[06:43]
motherbolt cables into it from each of
[06:45]
the uh power supplies. This adapter.
[06:47]
>> Okay.
[06:48]
>> So that's the easy part and the least
[06:49]
expensive.
[06:50]
>> Yeah, this is good. I like that. $11.
[06:54]
the cheapest part but important. It's
[06:55]
how we get everything firing together.
[06:57]
>> That sorts out the power inside the PC,
[06:59]
but now we need a UPS or a giant battery
[07:01]
to survive power blips while it's
[07:03]
running LLM workflows.
[07:05]
>> These are about 180. The challenge for
[07:07]
us though is we can get away with one of
[07:09]
them being up to 900 watts if it's for
[07:10]
one GPU, but we need we absolutely need
[07:13]
that second one to be much higher. So, I
[07:16]
think that that super expensive one is
[07:18]
going to be unavoidable. And that one is
[07:21]
uh
[07:22]
>> 800 bucks. Yeah. 800 bucks.
[07:24]
>> And that's big, too.
[07:25]
>> That one is uh probably the heaviest
[07:27]
thing you would carry today if you if we
[07:29]
had to go with it.
[07:30]
>> It's heavier than the case.
[07:31]
>> Um I'd say they're about the same. That
[07:33]
thing is like a brick. And it's it's
[07:35]
bigger than the picture would make you
[07:36]
believe.
[07:38]
>> Okay. You're killing me, Dan. You're
[07:39]
killing me.
[07:40]
>> Oh, I mean, we both have to get our
[07:42]
workout today, right?
[07:43]
>> Two GPUs, man. That's all I want to
[07:44]
power.
[07:46]
>> Yeah. Well, not everyone has Pro 6000s
[07:48]
that they're playing around with.
[07:50]
>> How loud is this thing going to It's not
[07:52]
going to be louder than a jet plane.
[07:54]
>> Is that a microenter guarantee?
[07:59]
>> Unofficial.
[08:00]
>> I don't make promises.
[08:01]
>> It's a Dan guarantee.
[08:02]
>> It's a Yeah, it's a Dan guarantee. There
[08:03]
we go. There you go.
[08:04]
>> Let's do it.
[08:05]
>> I guess we're going to do that big case,
[08:06]
huh?
[08:06]
>> We're going to do the big case. We're
[08:07]
going to do the big UPS.
[08:10]
>> We're going to go big. Let's do it.
[08:11]
>> Good thing there's three of us, right?
[08:13]
>> You know, we forgot one thing.
[08:15]
>> Case fans.
[08:16]
>> We don't need this thing to be a rainbow
[08:17]
show, do we?
[08:18]
>> I don't want any rainbow show.
[08:20]
>> There we go. As far as quietness,
[08:22]
there's Be Quiet and there's Nachua.
[08:24]
Naka is famous for being quiet.
[08:25]
>> Noctua is the quietest. They definitely
[08:27]
earn their price tag with that because
[08:29]
no matter how you spin it, Noctua
[08:32]
>> spins.
[08:33]
>> Get it?
[08:33]
>> Uh, but they they do it quietly. They do
[08:36]
it efficiently. They, as far as air flow
[08:39]
goes, they're still the kings. So, we
[08:42]
can look at that option, too. I mean,
[08:43]
it's already an expensive machine. Why
[08:45]
not make it quiet or better than a jet
[08:47]
engine? I want to have as quiet as we
[08:50]
possibly can. So, let's do that. Several
[08:52]
knockup fans. Holy cow, this is a huge
[08:56]
fan. The UPS is in our warehouse, which,
[08:59]
as you guys remember, I have to
[09:01]
disappear into and then reappear with
[09:03]
the magic item.
[09:04]
>> Let's see.
[09:05]
>> I'll be right back.
[09:05]
>> Maybe we can follow him this time. What
[09:07]
do you think? We can sneak in there.
[09:08]
>> I don't think it'd go too well.
[09:11]
Microenter wouldn't like it. Yo. Yeah.
[09:13]
There you go. The sign is just going to
[09:15]
prevent all entry.
[09:16]
>> All right.
[09:19]
Where's Alex? I'm going to ask him if he
[09:20]
wants to lift it. Wait, lost track of
[09:23]
him already. Hey, there you are. You
[09:25]
want to try to lift it?
[09:26]
>> Are you okay, Dan?
[09:27]
>> Uh, is your arm getting ripped off right
[09:30]
now?
[09:30]
>> Not yet. Maybe after like 30 more
[09:32]
seconds. All right, let's see.
[09:36]
>> Lift with your back, kids.
[09:43]
>> Told him he was going to get his work
[09:44]
out.
[09:44]
>> I'm just kidding. It's not that heavy.
[09:45]
>> No, it's not that bad. It's not too bad.
[09:47]
>> It's It's only about this. The case is
[09:48]
where
[09:48]
>> it's not actually that big.
[09:50]
>> No, no, no.
[09:51]
>> So, this is rack mountable and I can put
[09:53]
it on my floor.
[09:54]
>> Yeah, you should be able to do it either
[09:55]
way. For now, on the floor should be
[09:57]
fine. Maybe like standing it up a bit.
[09:59]
>> This is not a cheap UPS. Once you're
[10:01]
going over 900 W, these things just
[10:04]
start jumping up more and more and more
[10:06]
and more. So, that's it. That's all
[10:08]
we're getting.
[10:09]
>> One more UPS and that's it.
[10:10]
>> Oh, just one more UPS.
[10:13]
This one's not so bad. So, you have to
[10:15]
get to a certain point for microenter
[10:17]
employees to take this to the car.
[10:19]
>> If you want,
[10:20]
>> what if I was like an a little old lady?
[10:22]
What would it take?
[10:23]
>> Just ask for carry out and they'll say,
[10:24]
"Yeah, we got you. You need help getting
[10:26]
something out to your car? We'll be more
[10:29]
than happy to assist."
[10:30]
>> What if Arnold Schwarzenegger came?
[10:31]
Would you make him carry all his own
[10:33]
stuff?
[10:34]
>> No. And that's just because I'd probably
[10:37]
take the opportunity to ask him for like
[10:38]
workout tips and stuff. I feel like
[10:40]
getting on his good side would be good
[10:42]
because uh if anyone knows how to train,
[10:44]
it's it's that guy.
[10:46]
>> Definitely Arnold.
[10:47]
>> Definitely Arnold. Yeah.
[10:48]
>> Thanks, man.
[10:48]
>> Can't wait for the peer pressure to make
[10:50]
me do the same thing. I'll see you guys.
[10:58]
>> Can I just put this in here and call it
[11:00]
a day? I was super stoked to get this
[11:02]
thing to the office and set it up, even
[11:04]
though I was kind of nervous cuz this is
[11:06]
my first Thread Ripper build, and it'll
[11:08]
be my first time running multiple
[11:11]
$10,000 GPUs in there. I also wasn't
[11:14]
sure about the power requirements, but I
[11:15]
wanted to start off with a huge 2500
[11:18]
watt power supply before I upgrade to
[11:20]
more wattage and more power, which I
[11:22]
feel I'm going to need. So, I put
[11:23]
everything together and threw it into
[11:25]
this gigantic case, and it looked pretty
[11:28]
good. This case is really smartly
[11:30]
designed where fan assemblies can be
[11:32]
built outside of the case and then just
[11:33]
be slid in. So much easier to work in
[11:35]
this case than that small factor case.
[11:37]
This is a quality case. I decided to
[11:39]
throw in a 50/60 in there just as a test
[11:42]
if things explode. Uh it would be a sad
[11:45]
but not $10,000 ad. And after everything
[11:47]
turned on just fine.
[11:48]
>> All right.
[11:49]
>> And I installed the drivers. I went with
[11:50]
one RTX Pro 6000 and finally two. And
[11:54]
this is how it looks now. Oh,
[11:57]
don't put your fingers on the fan. Now,
[12:00]
somebody already yelled at me on Twitter
[12:01]
after I posted a picture of this saying,
[12:03]
"Why are they so close together?" This
[12:06]
machine is still in development. Plus,
[12:08]
I'm going to need some space for some
[12:10]
extra boards that might also go in
[12:11]
there. A package I just got in the mail.
[12:14]
Yeah, I'm glad I got the big case after
[12:16]
all. Stay tuned on the channel for more.
[12:18]
This case will be back. Oh, you want to
[12:20]
see a model running on this? Is that
[12:22]
what you want to see? Now, I did throw
[12:25]
VLM on there. I tried it with a couple
[12:27]
of models, but here is the first larger
[12:30]
model that I tried, which is called Quen
[12:33]
3 235 billion. And this model is 142 GB
[12:39]
on disk. So, there's no freaking way
[12:41]
that a 5090 or a 5080 or a 4090 or a
[12:46]
couple of those 4090s or a couple of
[12:47]
5090s will ever be able to run that. You
[12:50]
need two RTX Pro 6000s to be able to run
[12:53]
that. Unless you're using a totally
[12:55]
smashed quantization. And I'm going to
[12:57]
do Olama here because it's easy to
[12:59]
install. I made videos about all the
[13:01]
whole process of installation and
[13:02]
setting things up before. Lama run quen
[13:04]
235 billion. Watch NV top memory is
[13:08]
getting filled up. Not all the way.
[13:10]
We're about 75% on each of the GPUs, but
[13:12]
it's being split up nicely because Olama
[13:15]
when it detects that the model is larger
[13:17]
than would fit on one GPU, it starts to
[13:19]
use multiple GPUs, which is kind of
[13:21]
cool. Write a story. Yeah, I know. I
[13:24]
know you're going to complain. What kind
[13:25]
of prompt is that? Right, Alex? More
[13:27]
testing to come. Okay, have some
[13:29]
patience. Oh, do you hear that? Do you
[13:31]
hear that? And look how fast it's going.
[13:33]
This is thinking and now it's
[13:35]
generating. Wow, look at that activity
[13:38]
going on over there on the two GPUs.
[13:40]
Both of them being used. And we're done.
[13:42]
68 tokens per second on the generation
[13:45]
side. And this is a 235 billion
[13:48]
parameter model. This is freaking cool.
[13:50]
I'm really happy about this. Thanks to
[13:51]
MicroEnter for setting me up with a case
[13:53]
and the fans and check out the new
[13:55]
Phoenix store which is already open.
[13:57]
Maybe I'll run into you. Stop by and say
[13:58]
hi. I'll be there on the 10th of
[14:00]
December. Now, if you want to see a more
[14:02]
in-depth test of the RTX Pro 6000, watch
[14:04]
this video right here. Thanks for
[14:06]
watching and I'll see you next time.