Software Huddle

@softwarehuddle

共 98 期 · 已译制 1 期

1:06:45

今天我们有幸邀请到重量级嘉宾Arvid Kahl。他是我最喜欢的那类嘉宾——既深谙技术又能畅谈初创企业技术与商业挑战的创始人。本期节目精彩纷呈,不容错过。 Arvid以"自举创业者"(Bootstrapped Founder)闻名,曾完整记录2019年出售Feedback Panda的全过程。如今他正在打造Podscan,并持续分享创业历程。 Podscan是个引人入胜的项目。它让全球*所有*播客单集内容实现完全可搜索。目前已完成350万集播客的转录,并以每天3万至5万集的速度持续增长。 这涉及大量技术挑战:如何利用最新大语言模型获得最佳转录效果、该使用公共供应商API还是自建大语言模型、如何高效实现跨TB级转录数据的全文搜索。Arvid分享了多年积累的经验与尝试过的各种策略。 但项目还面临独特的商业挑战。对多数技术型企业而言,基础设施成本与客户增长成正比——更多客户意味着更多数据与服务器。而Podscan必须索引整个播客生态,无论客户多寡。这意味着在拓展客户群时需要大量前期投入。Arvid将讲述如何优化基础设施以应对这一特殊挑战。 *时间戳* 01:44 开场 08:09 如何发现所有内容? 13:58 转录基础设施 24:25 文件大小与质量权衡 28:26 优先级排序 36:40 本地运行大语言模型 38:35 系统演进历程 40:42 搜索功能 58:56 PHP Laravel框架 01:04:47 警报系统 01:07:12 独立开发者创业 01:14:00 再次退出?

1:00:09

Today, we have Or Weis, Co-Founder and CEO at Permit.io, on the show! Or has spent over two decades in software engineering and is now building tools to help developers manage authorization and access control as AI agents become an increasingly important part of software systems. In this episode, we explore how AI agents are changing the way we think about identity, authentication, and authorization. Or explains why agents can’t simply be treated like human users or traditional machine identities, and how their unpredictable and autonomous behavior introduces new security challenges, from prompt injection attacks to the confused deputy problem. We also dive into the Model Context Protocol (MCP), why delegated access requires a different approach to security, and the shift from session-based permissions to action-level authorization. Or walks us through Permit.io’s MCP Gateway and introduces the concept of agentic intent—how organizations can track changes in an agent’s intended actions and intervene when its behavior starts drifting from the original task. Finally, we discuss how enterprises are navigating the transition to agentic workflows, the challenges of connecting AI agents to sensitive data and production systems, and why existing security and compliance practices need to evolve as AI adoption accelerates. Tune in for a deep dive into AI agent security, authorization, MCP, and what it takes to build secure and reliable agentic systems. Visit permit.io to learn more

暂未译制

43:13

Today, we have Dan Manges, Co-Founder and CEO at RWX, on the show! Dan previously served as CTO at Braintree and co-founded Root Insurance, and is now building a CI/CD platform designed for the agentic era. In this episode, we explore how AI coding agents are changing software development and why the bottleneck is shifting from writing code to validating it. Dan explains why traditional CI/CD workflows are struggling to keep up, and how RWX uses content-based caching, graph-based execution, and a CLI-first approach to make builds faster and more efficient. We also dive into how engineering teams can rethink their development workflows around AI agents, from validating code changes before opening pull requests to using sandboxes and distributed compute. Dan shares his thoughts on harness engineering, why developer tooling needs to evolve alongside AI models, and what it takes to build reliable software when code is becoming increasingly cheap to produce. Finally, we discuss how teams should measure engineering productivity beyond build times and costs, and why Dan believes the shift to agentic development is creating opportunities to rethink how software gets built and shipped. Tune in for a deep dive into CI/CD, AI coding agents, and the future of software engineering. Visit https://www.rwx.com/blog/series-a for more info.

暂未译制

1:16

AI coding tools are changing how software is built, but understanding what happens under the hood still matters. Robert Brennan, Co-Founder and CEO at OpenHands, explains why new developers should embrace AI tools without neglecting the fundamentals of software architecture, databases, and security. Even if you’re no longer writing every line of code, you still need to understand what good software looks like.

暂未译制

38:43

Today, we have Robert Brennan, Co-Founder and CEO at OpenHands, on the show! Robert previously worked at Google and Fairwinds, and is now building an open-source platform for AI-powered software development. In this episode, we explore how AI agents are changing the way developers work, from automating code reviews and debugging to proactively monitoring production systems and fixing issues. Robert explains what makes an AI agent reliable, why agent harnesses are becoming commoditized, and how teams can continuously improve agent performance. We also dive into how software teams should prepare for agentic development, including the trade-offs between monorepos and microservices, trunk-based development, and traditional code review workflows. Robert also walks us through OpenHands’ SDK and Agent Canvas, and how they enable developers to build and manage autonomous workflows. Finally, we discuss the idea of an AI “dark factory,” where agents handle everything from writing code to testing and deployment. Robert shares his prediction that source code could become an antiquated abstraction layer within the next few years, and what that means for the future of software engineering. Tune in for a deep dive into AI coding agents, developer tools, and the future of autonomous software development. Visit https://www.openhands.dev/ to learn more.

暂未译制

52:49

Today we are talking with Vignesh Baskaran, the CTO and co-founder of Hexo Labs, about teaching AI agents to improve themselves. Vignesh has been training neural networks since 2012, back when he was still called a data scientist. Then he became an ML engineer and now an AI engineer, though he says the underlying work has never really changed. It's to figure out how to make a system behave the way you intend it to. He built the litigation search engine that Google itself became a customer of, and now he's chasing something new, agents that rewrite and retrain other agents without a human in the loop. We dig into Sia, the meta-agent at the center of Hexo's research, and why improving an agent means touching both its harness and its actual model weights, not just one or the other. We talk about proxy evals for when you don't have much to ground truth. The Darwin-Gödel machine and why formal verification is too strict a bar for anything commercial. How Hexo's work echoes DeepMind's Alpha lineage from AlphaGo to AlphaEvolve, and the spectrum from clearly verifiable to totally subjective tasks? Why VAE evals are quietly wrecking agent quality across the industry, and a great story about an agent that discovered a customer's own eval file was silently corrupted, something buried in hundreds of thousands of traces that no human would have caught. Visit https://hexolabs.com/

暂未译制

6:44

随着像Mythos这样的AI工具以前所未有的速度发现漏洞,组织需要的不仅仅是可见性。他们需要网络分段来降低风险。 在这次对话中,Shankar解释了Asimily如何帮助企业实现这一点。 访问 https://asimily.com/

暂未译制

14:02

来自Kernel的Catherine Jue加入本期Pulse。Kernel正在构建开源基础设施,让AI代理能够访问互联网。 时间戳 00:29 公司命名背后有什么故事? 01:21 你能从表面层面介绍Kernel吗? 03:23 Kernel针对谁? 06:11 有没有独立黑客的使用案例? 07:22 有什么书推荐给观众? 08:29 对PlanetScale的看法? 09:31 你们现在在招聘吗? 11:14 科技领域值得关注的3个人? 12:50 Chromium源代码让人望而生畏吗? 访问 kernel.sh 了解更多。

暂未译制

1:40

来自Kernel的Catherine谈论她的团队在新员工中寻找什么。 访问 kernel.sh 了解更多关于Kernel如何为AI代理创建开源基础设施的信息。

暂未译制

1:08

来自Kernel.sh的Catherine谈论她最喜欢的一本书以及科技领域的领导力

暂未译制

55:12

今天我们与Gremlin的创始人兼CEO Kolton Andrus讨论当AI编写大部分代码时,可靠性会发生什么变化。Kolton在创办Gremlin之前,曾帮助亚马逊和Netflix建立了混沌工程实践。 在我们的对话中,我们谈到了伤疤组织,工程师因凌晨3点被叫醒修复生产故障而培养出的直觉,以及AI完全没有这些。它在一个下午生成的代码,可能之前需要一个团队数周才能构建,但那些痛苦的教训并没有随之而来。 我们深入探讨了为什么10倍多的代码可能意味着10倍多的故障。可靠性护栏的概念,类似于道德护栏,但用于保持系统正常运行。为什么无论你的预发布环境有多好,你仍然需要在生产环境中进行测试?Gremlin如何重新思考他们的产品,以适应代理(而非工程师)成为主要用户的世界。以及为什么我们正在进入沙漏中狭窄而痛苦的部分,直到AI足够好地自行处理这一切。

暂未译制

0:57

@trykernel 为AI代理使用互联网提供了非常快速的基础设施。Catherine分享了@PlanetScale如何通过可预测的大规模性能帮助实现这一目标。

暂未译制

51:50

今天我们与Mezmo的创新总监Andre Elizondo讨论他们为SRE打造的开源代理工具包AURA。Mezmo最初处理大规模的可观测性数据。日志、追踪、指标,这些常规内容。 AURA是他们应对一个日益严重的问题的答案:随着系统复杂性超出人类理解所有数据的能力,如何使其对AI代理真正可操作? 我们深入探讨了他们的上下文工程方法,本质上是在数据到达模型之前使其为代理做好准备。为什么他们用Rust构建了自己的编排器?他们如何在代理循环中处理记忆和自我修正?他们对MCP的看法,以及它相对于Skills和代码沙箱的定位,以及随着代理成为值得信赖的队友,SRE角色如何演变。 访问 mezmo.com/aura

暂未译制

53:21

Today on the show, we have a special guest — Ashmeet Sidana, the founder of Engineering Capital. Ashmeet started his career as an engineer at some great companies like Hewlett-Packard and Silicon Graphics before founding his own company, getting it acquired, and eventually starting his venture capital firm, Engineering Capital. With his strong engineering background, Ashmeet looks for startups that have a technical insight — something unique that gives them an edge over their competitors. This focus on technical insight sets Engineering Capital apart from other VC firms that often emphasize market insight or distribution insight or some other kind of advantage. We talked about AI, Exponential Engineers, Entrepreneurship, and had a lot of fun.

暂未译制

42:34

Today we have Dr. Ewelina Kurtys on the show. Ewelina has a background in Neuroscience and is currently working at FinalSpark. FinalSpark is using live Neurons for computations instead of traditional electric CPUs. The advantage is that live Neurons are significantly more energy efficient than traditional computing, and given all the energy concerns right now with regards to running AI workloads and data centers, this seems quite relevant, even though bioprocessors are still very much in the research phase.

暂未译制

1:08:52

Today we're talking with one of our favorite engineers, Rafal Wilinski. Rafal has been on the cutting edge of AI development in the last few years as he has led AI teams at Zapier and Vendr. Rafal walks us through the hard-won lessons about actually integrating AI tools into the applications you're building. One of the hardest things in integrating these AI tools is how to ensure you're getting better and not regressing as you improve your prompts and upgrade your models. He shows how using evals is one part of the story along with deeply investigating customer signals to see how they are or aren't succeeding with AI. Along the way, we also talk about RAG, his favorite models, his AI development toolset, and why Poland has been killing it lately. Check it out and be sure to follow Rafal if you want to learn more on building with AI. *Timestamps* 01:10 Start 08:05 Zapier Agents 09:41 How does it differ from previous workflows? 13:10 Does text transform into a workflow? 14:31 Using Zapier's existing tools to power Agents? 15:48 Agents are given a only set of actions from which they can choose 17:45 Browser related stuff? 21:16 Choosing a model 25:28 Different prompts for different models? 40:36 Most often used models 41:45 TypeScript or Python 44:19 Cost 45:35 Less talk about non AI stuff 47:32 On regular devs building with AI 52:18 Protecting against user behaviour 54:25 Future of RAG 56:26 Is AI progress slowing down? 01:00:43 Personal AI tools 01:02:41 Losing understanding of repos? 01:04:33 Would you need Software Background in a few years? 01:06:08 GitHub Actions 01:07:31 Poland

暂未译制

51:38

If you’ve ever felt like engineering teams are stuck in execution mode—heads down, building what they’re told—then today’s episode is for you. We're talking about what it really takes to build high ownership engineering cultures where devs aren't simply just shipping code, but they're helping shape the product. And our guest this week is Matt Watson. He's a long time founder, engineer, and now the CEO of Full Scale, a company that helps startups and scale ups, grow their engineering teams with top talent from the Philippines. Matt's also the author of a book called Product Driven that shows how engineers can build with more clarity, purpose, customer focus and we get into some of the details in that book during this podcast. So in this episode, we get into everything from the downsides of specialization to the importance of empathy, to why code shipped isn't the same as value delivered. We hope you enjoy it.

暂未译制

1:04:02

Today's episode is with Aayush Shah. Aayush is one of the co-founders of Blacksmith, which is a CI compute platform. Basically, Blacksmith will run your GitHub Actions jobs faster and with more visibility with the standard GitHub Actions CI runners. The founding team has a fun background doing systems work at Cockroach and Faire, and they're taking on a big problem in running this massive CI fleet. The explosion in AI agents has really changed the CI world. CI is more useful than ever, as you want to be sure the changes from your agents aren't breaking your existing functionality. At the same time, there's a huge increase in demand and spikiness of CI workloads as developers can fire off multiple agents to work in parallel, each needing to run the CI suite before merging. Aayush talked about how they're handling this load and facilitating visibility into test failures. We also covered cloud economics. Aayush said the traditional cloud-based storage options don't work for them -- EBS and locally attached SSDs are too expensive for their workloads where they don't need the standard durability guarantees. He walks us through building their own fleet outside the hyperscalers and the plans going forward, along with some of the economics of multi-tenancy that Blacksmith has previously written about. *Blacksmith will be at KubeCon | CloudNativeCon North America 2025. Register Here* https://events.linuxfoundation.org/kubecon-cloudnativecon-north-america/register/ 01:09 Start 08:38 Github Actions 23:07 Cockroach 27:22 Forced bundling 31:11 Compute Locations 39:32 Network I/O Costs 40:51 Multi tenancy 46:04 Pricing Model 52:42 Seed Round 54:13 YC Experience 56:27 Office Locations 59:06 Codebase 01:01:24 AI Workflow

暂未译制

1:06:13

Today, Sam Lambert from Planetscale is back for a third time. Planetscale just announced Planetscale Postgres, so we had to get Sam back to tell us how and why they decided to add support for Postgres. It's always great to have Sam on -- he brings great stories about real customers and honest insight about the state of the database industry. In this episode, we talk about the road to Postgres and how operational excellence is the only true advantage in database providers. Sam walks us through the current Planetscale Postgres offering, along with details on Nova, a new sharded Postgres project that Planetscale is working on. Along the way, we get updates on Planetscale Metal, how demand has been for Planetscale Postgres, and future plans for Planetscale. *Timestamps* 01:16 Start 06:37 The Timeline 15:15 Not Much IP in the Database Market 21:48 PSBouncer 24:17 Zonal affinity 27:38 Query Insights 29:34 How to sign up 32:02 Convex 34:37 Other data stores? 56:18 Acquisitions

暂未译制

1:21:15

Today, we're talking Valkey, Redis, and all things caching. Our guest is Madelyn Olson, who is a principal engineer at AWS working on Elasticache and is one of the most well-known people in the caching community. She was a core maintainer of Redis prior to the fork and was one of the creators of Valkey, an open-source fork of Redis. In this episode, we talk about Madelyn's road to becoming a Redis maintainer and how she found out about the March 2024 license change. Then, Madelyn shares the story of Valkey being created, philosophical differences between the projects, and her reaction to re-relicensing of Redis in May 2025. Next, we dive into the performance improvements of recent Valkey releases, including the I/O threads improvements and the new hash table layout. Along the way, Madelyn dispels the notion that the single-threaded nature of Redis / Valkey is that big of a hindrance for most workloads. Finally, she compares some of the Valkey improvements to some of the other recent cache competitors in the space. Check it out! *Timestamps* 01:10 Start 07:52 TLS for Redis 12:44 Core Maintainer 15:03 Maintaining a Fork 17:38 License Change 19:14 How quick was the decision on fork? 21:33 When was the first Valkey release? 25:53 How does compatibility look right now? 27:18 Improvements 51:23 Valkey written in C 57:32 Tradeoffs? 01:02:49 KeyDB 01:04:35 MemoryDB 01:11:31 Roadmap? 01:13:14 Major Bumps vs Minor Bumps 01:14:48 Finding Good Maintainers 01:16:16 ChatGPT for specialized stuff?

暂未译制