Nvidia Shrinks AI Giant for Your PC!
45sThe shocking revelation that a powerful AI can run locally on personal hardware sparks curiosity and excitement.
▶ Play ClipAI Summary
Full Transcript
New Quen model is insane. Nvidia just shrank the most powerful free AI model ever and it runs on your PC. With Quen 3.6, you get a 35 billion parameter AI brain, but it only activates 3 billion at a time, so it's lightning fast, dirt cheap, and runs on hardware you can actually own. Then Nvidia compressed it three times smaller without losing the intelligence. It scored 73.4 on real-world bug fixes and beat Google's model by 21 points.
Its memory holds 262,000 words at once. It's open-source, free to use commercially, and runs on one graphics card. I can't believe what Nvidia just did.