Channel
Interviewed Person
Guillermo Rauch
What happens when conversational AI, evals, and trust converge? Recorded live at #SFTechWeek, this fireside chat features Guillermo Rauch (CEO, Vercel) and Evalion, exploring the next frontier of AI — where reliability, evaluation, and agentic behavior meet. This session dives into: How we define quality and truth in conversational AI The rise of “evals” as a foundation for reliable AI systems Red-teaming, simulation, and stress-testing agentic models Building observability and trust at scale Hosted at The Producer’s Loft Studio in San Francisco, the evening brought together top builders, researchers, and investors for intimate discussion and peer-led exploration on what’s next for trustworthy AI. Video by https://www.roll.ai/
Great to great to see you. Thank you again for for being here and as much as I say we're very lucky to have you. Thanks for thanks for inviting me. Thank you. Absolutely. So and to get started I would love to to start by talking about the interaction between human and technology. I think you've been a big promoter of kind of the way we interact with technology nowadays through the web. Uh so I would love to to pick your brain. What do you think is going to evolve in the future? thanks to the advent of AI. And so it's really funny because on the way
here I was reviewing a post that's about to come out from our blog announcing the chat GPT and Nex.js integration. So the reason I think the question is really timely is that the most common question I get these days is what does the future of the web look like? What happens to web pages? What happens to SEO? U and how is AI going to change the
fundamental fabric of software? And so it's very clear that as chat and voice agents proliferate, the world is going to have to adapt to that new way of interaction between humans and computers. My the way that I I from the versail side we've been trying to help companies make sense of it is you should always think about owning a direct relationship
with your customer. Meaning, you know, you'll still have your own apps. You'll still have your own websites. But it's very clear that there's many many many people and moments that are going to be directly interfacing a human and an agent. And that agent might be an agent that you might not fully control, right? So, JBD is a good example. It has 800 million active users, monthly active users, and they're opening it up as a platform so that you can show up there.
So, if you're in an e-commerce company, you have the opportunity to integrate through the agentic commerce protocol. If you are some kind of application that already has data and user interfaces, you'll be able to integrate through MCP. So there's a whole new set of protocols that are emerging so that we can connect agents together. On the other hand, I think it's really important that companies build their own agents otherwise there's a massive risk that you'll be disintermediated by the one
bot to rule them all. Right? And so on the versel side, we've been, you know, helping people deploy MCPs, deploy those integrations to to join in on the action where it's happening, but at the same time, you know, be able to create your own agents and your own interfaces. Something I think is particularly unique to this wave of AI is that so much of the interface is conversational. So as an entrepreneur for example, I
think you should be thinking about how can I join in on the conversation where it's happening. I'll be speaking at Dreamforce next week talking about the integration between Slack and the Verscell AI SDK. I believe that a lot of great startups and products can be bootstrapped off of again joining the conversation. So if you can deploy your agent to be in the room in the channel in Slack where the conversation is
already happening I think your odd of success is much higher. But what's becoming clear I think is that you know you're going to have to show up to all of these places. You can be integrated into Slack, you can be integrated into Zoom, you can be integrated into chat GPD and I think you'll have your own AI native interfaces. And that probably means that if you already have a.com or if you already have a working product, you'll probably have to rethink what is my interface that makes sense in the context of AI. For versel that was Vzero.