Sander Schulhoff
speaker
947 appearances
1 recordings
1 series
first heard Jun 2025
last heard Jun 2025
Sander Schulhoff’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
That is just like one of the wacky oddities of prompting and prompt engineering.
There's just small things you change that have massive, unpredictable effects.
Uh, but the lesson there is that including context or additional information about the situation was super, super important uh to get a performance prompt.
possible.
And there are other professors in the email.
Yeah.
I would say so.
Yeah, that is pretty much my advice, especially in the conversational setting when uh I mean frankly, when you're not paying per token, uh uh and maybe latency is not quite as important, but in that product focused setting, when you're giving additional information, it is a lot more important to figure out exactly what information you need.
Otherwise things can get uh expensive pretty quickly.
quickly with all those API calls uh and also slow.
So latency and cost become uh big factors in deciding how much additional information is too much additional information.
Uh and so usually I will put my additional information at the beginning of the prompt.
Uh and that is helpful for two reasons.
One, it can get cached.
So
subsequent calls to the LM with that same context at the top of the prompt are cheaper because the model provider stores that initial context for you as well as kind of like the embeddings for it.
So it it saves a ton of computation from being done.
Uh and so that's one really big uh reason to do it at the beginning.
Uh and then the second is that sometimes if you put all your additional information at the end of the prompt and it's like super, super long, uh the the model can like forget what its original task was and might pick up some question in the additional information to use instead.
this also can kind of get into like, are you going to like few shop prompt with different pieces of additional information?
Showing 301–320 of 947 · page 16 of 48
← Previous
Next →