My Python CRUD App hits 2 million rows, Should I Shard my Database?

episode

The Backend Engineering Show with Hussein Nasser not yet transcribed

▲ 0

Transcript

This episode hasn't been transcribed yet Upvotes decide what gets transcribed next — 0 so far. Sign in to upvote

Related

recent transcribed audio

Trump Makes MAJOR Move as Midterms Get Closer | Guests: Donald & Amy Johnson | 9/29/26 2h 6m · 29 Sep 2026 · The Glenn Beck Program

Best of the Program | Guests: Donald & Amy Johnson | 9/29/26 43 min · 29 Sep 2026 · The Glenn Beck Program

Standoff At Drumcree Enters Third Day 16 min · 29 Sep 2026 · The Last Word with Matt Cooper

The Last Word On Music: Oasis Sell Out Live ’27 Tour In Staggered Three Day Sale 18 min · 29 Sep 2026 · The Last Word with Matt Cooper

The 3 Senate Seats Republicans Can ACTUALLY Flip 1h 2m · 29 Sep 2026 · Next Up with Mark Halperin

Trump Miscalculates as Canada’s PM Carney Plans for US Invasion 16 min · 29 Sep 2026 · Legal AF by MeidasTouch

Report any issue

Source

Recorded03 Apr 2021

Publisheranchor.fm ↗

Handlerec:9885947

Show notes

Hey Hussein I have a 2 million row table used in my CRUD python app, I’m worried that as the table grow my inserts will slow down, should I consider sharding my database or partition the table? thank you I’m avid of simplicity in design if I can do it in one machine I’ll do it. Sharding/Partitioning are all great inserts are fast, queries are slow 0:00 inserts can be slow 3:00 indexes/stored procedures selects, updates, and deletes can be slow 12:00 add proper indexes. simplicity wins, premature optimization is bad 15:20 crazy things that people say like microservices day 1 scares me

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.

Sign in