Nathaniel Whittemore
speaker
52,364 appearances
204 recordings
3 series
first heard Oct 2025
last heard today
Nathaniel Whittemore’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 204 in all, peaking in Jun 2026 with 31.
Appearances
And indeed, sitting there right at the top of the list, with an average score of 9.1 across the different dimensions, was Muse.
podcast-host
Now, assistant benchmark is still very nascent as a benchmark.
podcast-host
And one of the things that some people have noticed is that at this stage, because it remains a passion project, the scores are fairly incomplete.
podcast-host
For example, Muse is sitting at the top with an average score of 9.1, but only seven of the 15 dimensions have so far been scored.
podcast-host
Instinct, which is just below Muse at an 8.4 average score, has had 11 of the 15 dimensions scored.
podcast-host
David explained that so far it's basically just him and Autumn Mulder from Cohere who have been doing these tests manually.
podcast-host
He writes, these are use case driven.
podcast-host
We run the same prompts and compare the performance of outcome across a variety of dimensions.
podcast-host
And I think that one of the values here is not just the scoring, but also around the use case inspiration.
podcast-host
On a recent podcast, OpenAI president Greg Brockman said that one of the reasons that consumer agents had had a hard time with adoption is that most people look at a blank text box and have no idea what they should be asking AI to do.
podcast-host
Now, his argument was that agents should be proactively suggesting tasks based on context, but having a list of use cases that other people are getting value out of is another approach to lowering those barriers to entry.
podcast-host
And certainly if you are hanging out on the personal agent portion of X, it is just use cases all day long every day.
podcast-host
Among people who are using bot, you're seeing things like subscription cancellations.
podcast-host
Matt Palmer, who works on bot, wrote recently that, quote, each day Grokbot looks at my X benchmarks for things I find interesting.
podcast-host
Then it spins up a cursor agent to build a demo.
podcast-host
It validates work with screenshots and video, then cuts a branch on a repo and sends me a link each morning and I get to see the tech for myself.
podcast-host
AI creator Min Choi built something that he called ContentOS or Grokbot as a content desk.
podcast-host
And Chris Back wrote, my favorite use case for bot right now is my billionaire bot.
podcast-host
I run all mildly annoying tasks I have to do through my billionaire bot, which tells me how I would solve any problem if I didn't want to get personally involved and had unlimited resources.
podcast-host
It turns out that a large number of inconveniences like having to show up to the DMV to sign paperwork can be outsourced to notaries who come to your office for $150.
podcast-host
Showing 2821–2840 of 52,364 · page 142 of 2619
← Previous
Next →