[0:01] hello guys U welcome to another episode
[0:04] of AML talks so today we will be talking
[0:06] about uh Lama models so llama is a like
[0:10] know open source model by Facebook or
[0:12] you can say Meta Meta so llama like know
[0:16] provides the weights and everything so
[0:18] you can either download the models if
[0:20] you have enough resources uh if you
[0:22] don't have resources and if you want to
[0:24] try llama you can go to meta you can
[0:27] click here so it will redirect you to
[0:29] meta
[0:30] and you can try it out so these llama
[0:33] versions they that they are using
[0:35] currently 3.1 so let's just ask it out
[0:38] which llama
[0:41] version are you currently
[0:49] using see it's currently using 3.1 but
[0:54] meta has released like 3.3 also so that
[0:57] you can use directly like you know so
[1:00] llama you can see llama has used uh
[1:02] released 3.2 and 3.3 also so to use that
[1:06] you can use cloud service called like
[1:09] you know grock Cloud uh so let's go to
[1:12] grock cloud and then we'll
[1:16] see so here you can like you know uh you
[1:19] can also test it out here whatever
[1:21] versions you wish to test it out so
[1:23] there are like Lama 3.1 3.2 so 3.3 is
[1:27] also there but I think that is there
[1:29] through the API part okay so uh what you
[1:32] can do is like you can go to API Keys
[1:35] like know go to like console. gro.com
[1:38] and create an account there uh it's a
[1:40] free thing right now and you can go and
[1:43] create an API out there and that API
[1:46] will give you access uh to llama new
[1:49] latest versions so Lama 3.3 is also
[1:52] available out there so after creating an
[1:54] API key you need to go to the
[1:56] documentation so in the documentation
[1:58] part uh like you know you can see how
[2:01] you can start working with like know Gro
[2:03] API uh so there are like API differences
[2:05] available out there so you can click on
[2:07] API references or you can if you want to
[2:09] just quick start here so you can go here
[2:12] and from there select the python part
[2:14] and copy it out okay and then you can
[2:17] use it in your uh system so like you can
[2:20] use it in collab or any any place you
[2:22] wish to do or any ID that you have so I
[2:25] am currently using vs code so I will
[2:27] show in the vs code part so uh I've just
[2:31] copied it out here and pasted it the
[2:33] whole thing is pasted already so uh I've
[2:36] added two extra things that were not
[2:38] there import OS and import from EnV
[2:41] import do uh load. EnV because these two
[2:45] things are uh required to get this um
[2:48] like know key that Gro API key so that
[2:51] API key you need to have it in EnV file
[2:53] from where you can uh call it out okay
[2:56] and then it's just same like you know
[2:58] everything else so here you need to
[3:00] mention the model which model you are
[3:02] using So currently this is a sample of
[3:05] Lama 3 8 billion so you can if you wish
[3:08] to use like any other thing uh like know
[3:11] you can just uh check the model cards
[3:13] out there and use it you can use mral or
[3:16] anything so that's not an issue okay so
[3:19] let's see like you
[3:21] know uh how it works so what we will do
[3:24] we will uh start with our virtual
[3:27] environment to my virtual environment is
[3:29] Gro EnV SL
[3:33] bin SL
[3:36] activate Okay now we need to just run it
[3:41] python
[3:43] gr Lama sorry Gro Lama
[3:49] dop yeah so see how fast it is so Gro
[3:53] Gro has like you know uh uh one of the
[3:56] best lpus so they are having like a
[3:58] language processing unit
[4:00] out there and uh they have the fastest
[4:03] response time uh of any of the cloud
[4:05] that is available as of now uh so you
[4:08] can see the how they have answered so
[4:10] fast language models have become like an
[4:12] increasing important today's landscape
[4:14] to do their ability to quickly process
[4:15] and generate large amount of natural
[4:17] data so this is how it is okay so uh
[4:21] like you know I hope you'll start
[4:22] building something out of it and you can
[4:25] go to gro.com sign up and get the key
[4:28] and start using any of the LM that you
[4:30] wish to use it there are multimetal
[4:33] versions also that also you can use okay
[4:36] I hope you have liked uh like my video
[4:38] so do like share and subscribe thank you
[4:41] everyone