Yi Tay

speaker
925 appearances 1 recordings 1 series first heard Jan 2026 last heard 23 Jan

Yi Tay’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months
1 · Jan OctJan 26AprJulnow

Recordings per month over the last 12 months — 1 in all, peaking in Jan 2026 with 1.

Appearances

newest first · ▶ plays the moment
So I think that
I honestly I hated working on like Rexis and Shiva stuff.
Okay, I'm just talking about old days.
When you work on like T5, you work on you change change architecture, you try to improve perplexity, you use super glue.
Like this is the olden days era.
On like even now when you train LMs, you just do zero short, full short stuff like that.
Your things the the you because as a researcher engineer, you just interact with the environment a lot by this, you're just like okay, RL by this environment.
But Rexis and IR are
has a very
strange feeling to it.
Strange feeling in the sense that it feels like your the like whatever works it's like you are in this in a world with the the gravity is different or like you are in a world where the modeling things that feel intuitive are not intuitive.
So it feels like a very strange space to so I wrote some papers back in my days on like Rexis and stuff like that.
Every time I ran some modeling experiments for for offrexists and stuff like that I I didn't enjoy the it feels like the environment was rude.
It feels like the vibes are just like like What makes it rude?
It just feels transactional.
No, no, not transactional.
Like I I don't know how to describe it.
For example, like if you play like sports where you play tennis, where you hit the ball, you have a very nice feeling like hitting the sweet spot.
When you do modeling in traditional dome, when you get the feedback back, you feel like everything sounds right, everything feels right, everything right.
But Rexis and IRI is like a problem.
Showing 721–740 of 925 · page 37 of 47 ← Previous Next →