Hello guys!
So in our previous video we had seen that how we created this lantern demo with gamma model with the
help of Lama.
And here you could see that I asked any question and is able to give me the answer.
Let's say if I go ahead and ask what is machine learning?
I'll be able to see that once I press enter, I will be able to get the response.
And again, this is interacting with the gamma model that is downloaded locally with the help of Lama.
Right.
One thing that I forgot to tell you about, you know, like how, uh, see, in my code, uh, which
I was actually running right here, we are making sure that the tracking also happens right in the Lange
Smith.
So in this video I'll be talking about like how this entire information is basically getting, uh,
tracked in the Lange Smith.
And the best thing is that no cost is involved in open.
I usually cost was involved, but in this nothing is there.
So let me just go ahead and open this.
So this was my projects okay.
So Jen I or app with open I.
So here you can see what is machine learning.
What is generative AI.
This was the question that I asked.
So let's open this first one.
So see how is the runnable sequence.
So first of all I got the chat prompt template.
So let me just hide my face so that you'll be able to clearly clearly see it.
So my input question was what is machine learning.
Right.
And here you could basically see that, uh, I'm getting some kind of content to my AI assistant.
It is saying, hey, you are a helpful assistant.
Please respond to the question that is asked.
Right.
And then, uh, once we go from here to Olama, right now here with respect to Olama here we are going
to use the llama three model.
right?
You can also open the playground if you want.
But here you can see my human question is that what is machine learning then?
Uh, this entire message is basically getting displayed by the ulama itself, right?
Ulama which is using this gamma model.
Right.
And this is what is basically getting returned.
Okay.
Now, after using this prompt and completion from Ulama, I will go ahead into the string output parser
that is the str output parser.
And with respect to this you are able to see this entire output that is basically getting displayed
along with the styling.
Right?
Which is amazing.
So this entire chain here, you can see that it is being tracked.
How much latency is there?
How much time is basically taking up, you know, with respect to more information?
Let's say if I want more information over here, you know, if you go to the right side, right.
How much token see cost is zero.
There is no cost involved over here.
Right.
So this is also amazing.
See no cost is involved.
Right.
So over here, uh, no cost is involved because I'm using the complete open source model.
Right.
So I hope, uh, you are able to understand this, uh, with respect to the kind of thing that we have
developed.
If you still feel that OpenAI, you don't have credit card, you don't want to use any balance.
As such, you can go ahead and use open source models.
Right.
And that is what I'm actually going to show you as we go ahead, more amazing end to end projects that
I'll try to create.
Right?
So yes, this was it for my side.
I hope you liked this particular video.
I will see you all in the next video.
Thank you.