Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Glauber Costa

๐Ÿ‘ค Speaker
358 total appearances

Appearances Over Time

Podcast Appearances

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

This is clearly working. You do this for another two years, you do this for another three years, you get there. So the first milestone that we have in mind is that when we can, through some proxy, because a lot of that you cannot measure, but we have a good level of confidence that we have a billion databases in the open. Then I think, okay, that's success, right?

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

This is clearly working. You do this for another two years, you do this for another three years, you get there. So the first milestone that we have in mind is that when we can, through some proxy, because a lot of that you cannot measure, but we have a good level of confidence that we have a billion databases in the open. Then I think, okay, that's success, right?

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

A lot of the read stuff works. A lot of the read stuff works. And one of the things that Pekka, and this was entirely Pekka's idea, that he did very well, and he was very praised by a lot of people, including those contributors. Some of them said, this is one of the reasons I contributed, is that he wrote on day one, because technically, this was very well thought.

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

A lot of the read stuff works. A lot of the read stuff works. And one of the things that Pekka, and this was entirely Pekka's idea, that he did very well, and he was very praised by a lot of people, including those contributors. Some of them said, this is one of the reasons I contributed, is that he wrote on day one, because technically, this was very well thought.

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

We thought about everything very well on the technical level, just on the presentation that we didn't have a lot of time. But there is a compatibility matrix. So if you go to the repository, there is a file there, compat.md, that is linked in the readme. And there is a full compatibility matrix with everything.

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

We thought about everything very well on the technical level, just on the presentation that we didn't have a lot of time. But there is a compatibility matrix. So if you go to the repository, there is a file there, compat.md, that is linked in the readme. And there is a full compatibility matrix with everything.

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

So what you're going to see there is like the read stuff from SQLite already works pretty well. So you can, in a lot of ways, if your queries are not the one I run today with 10 joins and very complicated use cases, the basics of like reading from a SQLite file, they work already.

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

So what you're going to see there is like the read stuff from SQLite already works pretty well. So you can, in a lot of ways, if your queries are not the one I run today with 10 joins and very complicated use cases, the basics of like reading from a SQLite file, they work already.

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

And if you want to self-host... More or less. Just to add to that, it wasn't something very relevant, so I didn't bring it up, but we already had, for other reasons, we already had a proof of concept of a new server implementation that is not based on libSQL. And the reason we did this is that we also want our server to have deterministic simulation testing.

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

And if you want to self-host... More or less. Just to add to that, it wasn't something very relevant, so I didn't bring it up, but we already had, for other reasons, we already had a proof of concept of a new server implementation that is not based on libSQL. And the reason we did this is that we also want our server to have deterministic simulation testing.

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

So that new server will be closed source. LibSQL, so that's one of the changes in strategy that we're making. And again, we understand that in a perfect world, everything will be open source. I would love that. But the reason we're doing this is that we want to have this very clear separation without concerns of what goes where.

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

So that new server will be closed source. LibSQL, so that's one of the changes in strategy that we're making. And again, we understand that in a perfect world, everything will be open source. I would love that. But the reason we're doing this is that we want to have this very clear separation without concerns of what goes where.

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

And we think the best way to do this is if the server is fully proprietary. And the client is fully open source. So Leap SQL is open source. The protocols are all the same. So you would be able to run your Thurso Cloud databases on Leap SQL. That's the goal.

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

And we think the best way to do this is if the server is fully proprietary. And the client is fully open source. So Leap SQL is open source. The protocols are all the same. So you would be able to run your Thurso Cloud databases on Leap SQL. That's the goal.

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

But the new server that runs deterministic simulation testing, that has a lot of additional features, that is designed to be multi-tenant, the design goal that we had is that we will be able to run queries to a billion SQLite databases in a single box. So all of that, like that level of scalability, we're going to keep it closed source. So that's going to be the dividing line.

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

But the new server that runs deterministic simulation testing, that has a lot of additional features, that is designed to be multi-tenant, the design goal that we had is that we will be able to run queries to a billion SQLite databases in a single box. So all of that, like that level of scalability, we're going to keep it closed source. So that's going to be the dividing line.

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

And then LibSQL still exists as a reference implementation. If you truly want to run an open source version, I think it's more accurate to say if you want to run an open source implementation of our cloud platform, LibSQL will do this for you with limitations. But our new server,

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

And then LibSQL still exists as a reference implementation. If you truly want to run an open source version, I think it's more accurate to say if you want to run an open source implementation of our cloud platform, LibSQL will do this for you with limitations. But our new server,

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

We decided not to, you know, seeing the success of Limbo, we decided not to release that as open source to keep things clear. And then Turso, the embedded database is 100%, 200% if we can, open source.

The Changelog: Software Development, Open Source
Turso is rewriting SQLite in Rust (Interview)

We decided not to, you know, seeing the success of Limbo, we decided not to release that as open source to keep things clear. And then Turso, the embedded database is 100%, 200% if we can, open source.