Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Carmine Paolino

๐Ÿ‘ค Speaker
201 total appearances

Appearances Over Time

Podcast Appearances

Coder Radio
639: RubyLLM with Carmine Paolino

But all of the other ones, you have to send the entire conversation.

Coder Radio
639: RubyLLM with Carmine Paolino

Yeah.

Coder Radio
639: RubyLLM with Carmine Paolino

So even for me, actually, it was really cool to have that feature because I wanted to test a different model while being in the same conversation.

Coder Radio
639: RubyLLM with Carmine Paolino

So when I was selecting the models that I wanted to use,

Coder Radio
639: RubyLLM with Carmine Paolino

I started to chat maybe with one model and then I was not really like pleased with their output.

Coder Radio
639: RubyLLM with Carmine Paolino

So I was like, why can't I just use the same chat, but with a different model?

Coder Radio
639: RubyLLM with Carmine Paolino

And that's how also that feature came about.

Coder Radio
639: RubyLLM with Carmine Paolino

And in terms of token usage, I mean, you can also switch around between models.

Coder Radio
639: RubyLLM with Carmine Paolino

So for example, if you exhaust like the tokens for a specific model, then you can switch around to another one that is perhaps a bigger context window and then you're going to be fine.

Coder Radio
639: RubyLLM with Carmine Paolino

So you can just put it in your gem file, bundle install.

Coder Radio
639: RubyLLM with Carmine Paolino

And then we also have a Rails integration and some generators that are going to help you to connect it all together.

Coder Radio
639: RubyLLM with Carmine Paolino

No, no.

Coder Radio
639: RubyLLM with Carmine Paolino

Wow.

Coder Radio
639: RubyLLM with Carmine Paolino

That's right, yeah.

Coder Radio
639: RubyLLM with Carmine Paolino

So basically, the Rails integration is built on top of the callbacks.

Coder Radio
639: RubyLLM with Carmine Paolino

So every time we have a new message or there's a new chunk, we actually pass it to the Rails integration.

Coder Radio
639: RubyLLM with Carmine Paolino

So it's using RubyLM features inside RubyLM in order to build the Rails integration.

Coder Radio
639: RubyLLM with Carmine Paolino

And that allows us to have a very, very short amount of code for the Rails integration.

Coder Radio
639: RubyLLM with Carmine Paolino

And on top of that, we have all the migration generators so that you can create your models that have all the different fields that we require.

Coder Radio
639: RubyLLM with Carmine Paolino

And then in the end, in your controllers, you just have an access, let's say chat, if it's a chat or access message, if it's a message.