[0:00] This little box was my all-in-one AI rig
[0:02] until I decided I needed another RTX Pro
[0:04] 6000, and there's absolutely no way this
[0:07] is fitting in here. So, today I'm
[0:08] planning to expand operations. This
[0:11] build is going to take a lot, so I'm
[0:12] going to go over here to MicroEnter, my
[0:14] favorite spot to go shopping for
[0:16] computer parts and talk to my buddy Dan.
[0:18] He'll hook us up.
[0:19] >> Hey Dan, what's up?
[0:20] >> Hey, Alex. Welcome back to Good to see
[0:22] you too.
[0:23] >> I got a gift for you. Not a gift, it's
[0:24] it's mine. I'm keeping it. But this is
[0:27] the new power supply that I have. And I
[0:29] don't think this is going to work with
[0:31] my setup. So, we're going to look at
[0:32] some power supplies, a case, and some
[0:36] fans for this Thread Ripper build.
[0:38] >> Okay. Well, like what exactly are we
[0:40] doing?
[0:40] >> I've got a Thread Ripper TRX board, a
[0:42] Monster Thread Ripper 9970X, and two RTX
[0:46] Pro 6000 GPUs waiting for a case. That
[0:49] combo can pull an absurd amount of
[0:51] power, which is why I bought this 2500 W
[0:54] power supply. Now I'm at MicroEnter so
[0:56] we can walk around and see which case
[0:58] can actually fit this brick.
[0:59] >> Feel that. Dang. It's almost as heavy as
[1:02] my graphics card. It's crazy. You do
[1:04] your push-ups today?
[1:05] >> Yeah. Well, not yet. I guess we're going
[1:06] to have to today, right?
[1:07] >> This thing is crazy.
[1:18] We basically have two options. split the
[1:20] load so one power supply can run the CPU
[1:22] plus one GPU and a second power supply
[1:25] feeds the other GPU or try to shove
[1:28] everything into this 2500 watt monster
[1:30] to use all that power the big unit needs
[1:32] a special high voltage plug and a normal
[1:34] US outlet tops out around 1,800 watts so
[1:38] before I accidentally discover the limit
[1:39] of my office wiring we're leaning
[1:41] towards the dual PSU setup right now
[1:44] >> yeah well we're doing two GPUs knowing
[1:46] you they're probably something very fun
[1:48] pro 6000s All right. Pro 6000s. Two Pro
[1:51] 6000s and me and my measly 5090.
[1:54] >> With that much hardware, small cases are
[1:56] officially cancelled. Dan tells me I'm
[1:58] stuck shopping in the skyscraper sized
[2:00] full tower section if I want dual RTX
[2:02] 6000s and giant power supplies. What is
[2:05] up with this? Oh, yeah. So, that one's
[2:07] really cool. Bethesda teamed up with uh
[2:09] Haven to create this case.
[2:11] >> Wow.
[2:12] >> So, for any Doom fans out there, these
[2:14] are limited run. There's only 1,666 of
[2:16] these in the world.
[2:17] >> Really?
[2:18] >> Oh, yeah. This is sick. And I am a Doom
[2:20] fan, by the way.
[2:21] >> We go full kid in a candy store on
[2:23] cases, limited edition Doom art, fancy
[2:26] glass, even one with a tiny panoramic
[2:28] OLED screen.
[2:29] >> I would, of course, have probably some
[2:30] kind of a GPU usage readout on there.
[2:33] Memory usage readout. I love how you
[2:35] have some of these on and just like
[2:37] showing what they're going to look like
[2:39] when they're running.
[2:40] >> For the record, if you have to do two
[2:41] power supplies, that's got to be your
[2:43] case behind our wonderful cameraman.
[2:45] Yeah.
[2:46] >> Is that the case? The That's the box for
[2:48] the case. The case itself is just a
[2:50] little bigger than than the half 700
[2:52] enforcer.
[2:53] >> What?
[2:54] >> This is the case.
[2:55] >> This might be your case.
[2:56] >> Can I lift this?
[2:58] >> Probably. Yeah, you're a strong guy. He
[3:00] can lift it. But how am I going to put
[3:01] this in my office
[3:04] with a lot of elbow grease? I'm scared.
[3:07] I'm scared. This is crazy.
[3:08] >> If people like how this looks in your
[3:10] office, I'll do one, too, just for fun.
[3:11] >> You're going to do one?
[3:12] >> If you end up going with this guy and
[3:13] the people in the video like it, I'll do
[3:15] one, too. I'm a sucker for peer
[3:16] pressure.
[3:16] >> We kick around other ideas like an open
[3:18] air test bench or just parking a second
[3:20] PSU on the floor next to the main case
[3:22] like a Cyberpunk space heater.
[3:24] >> It's doable. It's just uh you know how
[3:26] how neat do you want your office to
[3:28] look?
[3:28] >> How much office do I want to have left
[3:31] is the question after putting this case
[3:34] in there.
[3:34] >> Yeah, the huge enclosed case is starting
[3:36] to look less like overkill and more like
[3:38] the only sane option.
[3:40] >> So, this would be one of the power
[3:41] supplies we put in I was a fan of
[3:43] recommending the Taichi power supply
[3:45] here. It's a 1650 W power supply, which
[3:47] is just enough to work. It has two 16
[3:50] pin outs, so you can use that for your
[3:52] two Pro 6000s. Yep.
[3:54] >> Another cool feature about this power
[3:55] supply is for all those people who are
[3:57] still scared about melting cables, uh,
[3:59] which if you know how to plug in your
[4:01] phone at night, you shouldn't be worried
[4:03] about that. It has an extra sensor to
[4:05] detect temperature as well, so that if
[4:07] anything goes wrong, it's done. It's
[4:09] also titanium rated.
[4:10] >> Nice. Well, let's go look at the power
[4:11] supplies.
[4:12] >> Yeah, let's go look at power supplies
[4:13] while I talk about the rating.
[4:14] >> This Vertex 1200 is the one you
[4:17] suggested to me last year. And I love
[4:19] this power supply. I got like three of
[4:21] them now, and it's really good. It's
[4:22] 12,200 W, but um this is also gold. I'm
[4:26] seeing now. There's bronze, gold,
[4:28] platinum, and titanium.
[4:30] >> Like, you know, if one of you guys is
[4:31] just here to build a gaming PC and you
[4:32] want to get a titanium watt, the
[4:34] question on my mind is why? But if you
[4:36] do a workstation, then yeah, that can
[4:38] mean something for you,
[4:39] >> right? So for us, we got two GPUs in
[4:42] there. I want to keep the heat low. And
[4:44] when you don't have an efficient PSU, it
[4:46] gets rid of some of that wattage that's
[4:48] coming into it as heat so that it's
[4:51] going to go away as heat into the
[4:52] machine. We don't want that. We want as
[4:54] high as possible efficiency so that that
[4:56] power is converted into just straight
[5:00] wattage going into the system instead of
[5:02] heat. Did I explain that right?
[5:04] >> Yeah. I don't I mean I don't disagree
[5:05] with it. So titanium has about 95% up to
[5:08] 95% efficiency, which is really nice.
[5:11] And if you go with something like
[5:12] bronze, that's low. That's pretty low.
[5:14] It's like 80 to 82% efficiency. Yeah.
[5:17] And honestly, for the purposes of this
[5:19] machine, I don't think we want to go
[5:21] lower than platinum. If we're doing one
[5:23] of those dual GPU cases, while your
[5:25] Vertex might be fine for like one of the
[5:27] PSUs, the second PSU has to be SFX or
[5:30] SFXL, which are just like size standard
[5:33] power supplies. So, you could look at
[5:34] something like the ROG Loki. Um, I'd
[5:37] probably give you the 1000 watt just
[5:38] because then you have like the 600 watt
[5:40] rated cable, but it's SFXL. It's
[5:43] platinum rated and it would sit
[5:45] comfortably in that case.
[5:46] >> I have one of these in my current 6000
[5:49] build.
[5:49] >> Silver Stones is a good one, too.
[5:51] Although it's like double the price for
[5:52] an extra 200 W, which people can do what
[5:54] they want with their money. financially
[5:56] the better option is CPU GPU on one and
[6:00] other GPU on the other because uh
[6:02] talking about that Taichi that's a 550 W
[6:04] power supply if we did that for two GPUs
[6:06] and then you add um 280 for the
[6:10] extra,000 watt for the CPU and anything
[6:13] else going on there that's going to put
[6:14] you at $830 right
[6:16] >> so
[6:17] >> it's pretty quick
[6:18] >> uh I try uh you do that versus you do
[6:22] maybe you could do the 1300 watt version
[6:23] of that power supply which runs you
[6:25] about4 400 bucks and you're still going
[6:26] to want one of these obviously. So then
[6:28] that puts you at 680 bucks. So you're
[6:30] going to be aboutundred
[6:33] $150 less than the other.
[6:34] >> I also need to figure out how to connect
[6:36] the two power supplies together so
[6:37] they're synchronized. Yes,
[6:38] >> I haven't done that before.
[6:39] >> We have an adapter. So what this adapter
[6:41] lets you do is you plug in the two
[6:43] motherbolt cables into it from each of
[6:45] the uh power supplies. This adapter.
[6:47] >> Okay.
[6:48] >> So that's the easy part and the least
[6:49] expensive.
[6:50] >> Yeah, this is good. I like that. $11.
[6:54] the cheapest part but important. It's
[6:55] how we get everything firing together.
[6:57] >> That sorts out the power inside the PC,
[6:59] but now we need a UPS or a giant battery
[7:01] to survive power blips while it's
[7:03] running LLM workflows.
[7:05] >> These are about 180. The challenge for
[7:07] us though is we can get away with one of
[7:09] them being up to 900 watts if it's for
[7:10] one GPU, but we need we absolutely need
[7:13] that second one to be much higher. So, I
[7:16] think that that super expensive one is
[7:18] going to be unavoidable. And that one is
[7:21] uh
[7:22] >> 800 bucks. Yeah. 800 bucks.
[7:24] >> And that's big, too.
[7:25] >> That one is uh probably the heaviest
[7:27] thing you would carry today if you if we
[7:29] had to go with it.
[7:30] >> It's heavier than the case.
[7:31] >> Um I'd say they're about the same. That
[7:33] thing is like a brick. And it's it's
[7:35] bigger than the picture would make you
[7:36] believe.
[7:38] >> Okay. You're killing me, Dan. You're
[7:39] killing me.
[7:40] >> Oh, I mean, we both have to get our
[7:42] workout today, right?
[7:43] >> Two GPUs, man. That's all I want to
[7:44] power.
[7:46] >> Yeah. Well, not everyone has Pro 6000s
[7:48] that they're playing around with.
[7:50] >> How loud is this thing going to It's not
[7:52] going to be louder than a jet plane.
[7:54] >> Is that a microenter guarantee?
[7:59] >> Unofficial.
[8:00] >> I don't make promises.
[8:01] >> It's a Dan guarantee.
[8:02] >> It's a Yeah, it's a Dan guarantee. There
[8:03] we go. There you go.
[8:04] >> Let's do it.
[8:05] >> I guess we're going to do that big case,
[8:06] huh?
[8:06] >> We're going to do the big case. We're
[8:07] going to do the big UPS.
[8:10] >> We're going to go big. Let's do it.
[8:11] >> Good thing there's three of us, right?
[8:13] >> You know, we forgot one thing.
[8:15] >> Case fans.
[8:16] >> We don't need this thing to be a rainbow
[8:17] show, do we?
[8:18] >> I don't want any rainbow show.
[8:20] >> There we go. As far as quietness,
[8:22] there's Be Quiet and there's Nachua.
[8:24] Naka is famous for being quiet.
[8:25] >> Noctua is the quietest. They definitely
[8:27] earn their price tag with that because
[8:29] no matter how you spin it, Noctua
[8:32] >> spins.
[8:33] >> Get it?
[8:33] >> Uh, but they they do it quietly. They do
[8:36] it efficiently. They, as far as air flow
[8:39] goes, they're still the kings. So, we
[8:42] can look at that option, too. I mean,
[8:43] it's already an expensive machine. Why
[8:45] not make it quiet or better than a jet
[8:47] engine? I want to have as quiet as we
[8:50] possibly can. So, let's do that. Several
[8:52] knockup fans. Holy cow, this is a huge
[8:56] fan. The UPS is in our warehouse, which,
[8:59] as you guys remember, I have to
[9:01] disappear into and then reappear with
[9:03] the magic item.
[9:04] >> Let's see.
[9:05] >> I'll be right back.
[9:05] >> Maybe we can follow him this time. What
[9:07] do you think? We can sneak in there.
[9:08] >> I don't think it'd go too well.
[9:11] Microenter wouldn't like it. Yo. Yeah.
[9:13] There you go. The sign is just going to
[9:15] prevent all entry.
[9:16] >> All right.
[9:19] Where's Alex? I'm going to ask him if he
[9:20] wants to lift it. Wait, lost track of
[9:23] him already. Hey, there you are. You
[9:25] want to try to lift it?
[9:26] >> Are you okay, Dan?
[9:27] >> Uh, is your arm getting ripped off right
[9:30] now?
[9:30] >> Not yet. Maybe after like 30 more
[9:32] seconds. All right, let's see.
[9:36] >> Lift with your back, kids.
[9:43] >> Told him he was going to get his work
[9:44] out.
[9:44] >> I'm just kidding. It's not that heavy.
[9:45] >> No, it's not that bad. It's not too bad.
[9:47] >> It's It's only about this. The case is
[9:48] where
[9:48] >> it's not actually that big.
[9:50] >> No, no, no.
[9:51] >> So, this is rack mountable and I can put
[9:53] it on my floor.
[9:54] >> Yeah, you should be able to do it either
[9:55] way. For now, on the floor should be
[9:57] fine. Maybe like standing it up a bit.
[9:59] >> This is not a cheap UPS. Once you're
[10:01] going over 900 W, these things just
[10:04] start jumping up more and more and more
[10:06] and more. So, that's it. That's all
[10:08] we're getting.
[10:09] >> One more UPS and that's it.
[10:10] >> Oh, just one more UPS.
[10:13] This one's not so bad. So, you have to
[10:15] get to a certain point for microenter
[10:17] employees to take this to the car.
[10:19] >> If you want,
[10:20] >> what if I was like an a little old lady?
[10:22] What would it take?
[10:23] >> Just ask for carry out and they'll say,
[10:24] "Yeah, we got you. You need help getting
[10:26] something out to your car? We'll be more
[10:29] than happy to assist."
[10:30] >> What if Arnold Schwarzenegger came?
[10:31] Would you make him carry all his own
[10:33] stuff?
[10:34] >> No. And that's just because I'd probably
[10:37] take the opportunity to ask him for like
[10:38] workout tips and stuff. I feel like
[10:40] getting on his good side would be good
[10:42] because uh if anyone knows how to train,
[10:44] it's it's that guy.
[10:46] >> Definitely Arnold.
[10:47] >> Definitely Arnold. Yeah.
[10:48] >> Thanks, man.
[10:48] >> Can't wait for the peer pressure to make
[10:50] me do the same thing. I'll see you guys.
[10:58] >> Can I just put this in here and call it
[11:00] a day? I was super stoked to get this
[11:02] thing to the office and set it up, even
[11:04] though I was kind of nervous cuz this is
[11:06] my first Thread Ripper build, and it'll
[11:08] be my first time running multiple
[11:11] $10,000 GPUs in there. I also wasn't
[11:14] sure about the power requirements, but I
[11:15] wanted to start off with a huge 2500
[11:18] watt power supply before I upgrade to
[11:20] more wattage and more power, which I
[11:22] feel I'm going to need. So, I put
[11:23] everything together and threw it into
[11:25] this gigantic case, and it looked pretty
[11:28] good. This case is really smartly
[11:30] designed where fan assemblies can be
[11:32] built outside of the case and then just
[11:33] be slid in. So much easier to work in
[11:35] this case than that small factor case.
[11:37] This is a quality case. I decided to
[11:39] throw in a 50/60 in there just as a test
[11:42] if things explode. Uh it would be a sad
[11:45] but not $10,000 ad. And after everything
[11:47] turned on just fine.
[11:48] >> All right.
[11:49] >> And I installed the drivers. I went with
[11:50] one RTX Pro 6000 and finally two. And
[11:54] this is how it looks now. Oh,
[11:57] don't put your fingers on the fan. Now,
[12:00] somebody already yelled at me on Twitter
[12:01] after I posted a picture of this saying,
[12:03] "Why are they so close together?" This
[12:06] machine is still in development. Plus,
[12:08] I'm going to need some space for some
[12:10] extra boards that might also go in
[12:11] there. A package I just got in the mail.
[12:14] Yeah, I'm glad I got the big case after
[12:16] all. Stay tuned on the channel for more.
[12:18] This case will be back. Oh, you want to
[12:20] see a model running on this? Is that
[12:22] what you want to see? Now, I did throw
[12:25] VLM on there. I tried it with a couple
[12:27] of models, but here is the first larger
[12:30] model that I tried, which is called Quen
[12:33] 3 235 billion. And this model is 142 GB
[12:39] on disk. So, there's no freaking way
[12:41] that a 5090 or a 5080 or a 4090 or a
[12:46] couple of those 4090s or a couple of
[12:47] 5090s will ever be able to run that. You
[12:50] need two RTX Pro 6000s to be able to run
[12:53] that. Unless you're using a totally
[12:55] smashed quantization. And I'm going to
[12:57] do Olama here because it's easy to
[12:59] install. I made videos about all the
[13:01] whole process of installation and
[13:02] setting things up before. Lama run quen
[13:04] 235 billion. Watch NV top memory is
[13:08] getting filled up. Not all the way.
[13:10] We're about 75% on each of the GPUs, but
[13:12] it's being split up nicely because Olama
[13:15] when it detects that the model is larger
[13:17] than would fit on one GPU, it starts to
[13:19] use multiple GPUs, which is kind of
[13:21] cool. Write a story. Yeah, I know. I
[13:24] know you're going to complain. What kind
[13:25] of prompt is that? Right, Alex? More
[13:27] testing to come. Okay, have some
[13:29] patience. Oh, do you hear that? Do you
[13:31] hear that? And look how fast it's going.
[13:33] This is thinking and now it's
[13:35] generating. Wow, look at that activity
[13:38] going on over there on the two GPUs.
[13:40] Both of them being used. And we're done.
[13:42] 68 tokens per second on the generation
[13:45] side. And this is a 235 billion
[13:48] parameter model. This is freaking cool.
[13:50] I'm really happy about this. Thanks to
[13:51] MicroEnter for setting me up with a case
[13:53] and the fans and check out the new
[13:55] Phoenix store which is already open.
[13:57] Maybe I'll run into you. Stop by and say
[13:58] hi. I'll be there on the 10th of
[14:00] December. Now, if you want to see a more
[14:02] in-depth test of the RTX Pro 6000, watch
[14:04] this video right here. Thanks for
[14:06] watching and I'll see you next time.