64. Solo - Manuel Pasieka on the hottest LLM topics of 2024

With the last episode in 2024, I dare to release an solo episode, summarizing my christmas research on the topics of - Small Language models - Agentic Systems - Advanced Reasoning / Test time compute paradigm I hope you find it interesting and useful! All the best for 2025! ## AAIP Community Join our discord server and ask guest directly or discuss related topics with the community. https://discord.gg/5Pj446VKNU ## TOC 00:00:05 Intro 00:01:52 Part 1 - Small Language Models 00:20:16 Part 2 - Agentic Systems 00:36:16 Part 3 - Advanced Reasoning 00:58:08 Outro ## References - Testing Qwen2.5 - https://huggingface.co/spaces/Qwen/Qwen2.5 - Qwen2.5 Technical report - https://arxiv.org/pdf/2412.15115 - Agents: https://www.superannotate.com/blog/llm-agents - Scaling Test-time compute: https://arxiv.org/html/2408.03314v1 - Test time compute: https://huggingface.co/spaces/HuggingFaceH4/blogpost-scaling-test-time-compute - O3 achieving 88% on ARC-AGI https://arcprize.org/blog/oai-o3-pub-breakthrough - https://arxiv.org/html/2409.01374v1 - Human performance on ARC-AGI 76%

There are no comments yet.

Please log in to write the first comment.