Community Session: AI Gateway

Hello everyone. Welcome to this week's Versol community live session. Um my name is Pauline and I'm joined here with Jacob from the

Versile community team. Uh you may have actually seen our avatars floating around in the community. So I love to do this because it's always fun uh to have time to interact with you all in a more synchronous way like this. Um so we're actually streaming this live out uh to X uh and YouTube. But if you want to participate in our chat uh join community, join our community platform

which is on community.versal.com versile.com and click going on this event page uh and that will unlock the chat. Throughout the session, we'll also uh be doing some Q&A. Um so feel free to drop any questions you have along the way. To start, definitely tell us where you're tuning in from and what you're hoping to learn from this session. Yeah, if you're going to hang out in the chat, uh please remember to be respectful and follow our code of conduct. And with that out of the way,

I'd love to introduce our two guests today. We have Walter Corman and Harriet Agora from the AI Gateway product team. Hi guys, welcome. How are you doing today? Fantastic. Need my coffee? Amazing. Talking about coffee. Joining you all from the the Versel San Francisco headquarters office. Uh so, you know, you never know, GM may charge by uh in the background. So, so keep a watchful eye. But yeah, it's it's great

to see you all. Amazing. We'll leave it over to you then. Um but yeah, excited to have you here. Excellent. All right. Um I want to talk through, you know, why we built the Versale gateway first. Um and then we'll do a couple of demos um including a really amazing demo that Walter has conceived uh uh that that went really well in the company. And then we'll have time at the end for questions and answers and also uh through the chat. So with that, um, let me just start off with the vision, right? Um, hopefully you're all familiar

with the AI SDK. If you're not, um, it's our open- source, uh, SDK for building AI apps and agents, uh, in Typescript, right? And it has become the de facto library that people use to build AI apps. Um, one of the things that we pride ourselves at about is just the developer experience, right? So when you

use any SDK or any app from Burcell, you just experience really high taste and good developer experience. Um if you are using AI SDK, you still will and you are using multiple AI models, you still want that simplicity of switching models, right? So that's like one pain point that we always heard about. The other pain point we heard about is well I want like I I run into raid limits very frequently. you guys have experience building v 0ero like can you

help me with that right and we of course can uh and then the third thing is well there's a lot of the providers that go down from time to time um maybe you can do smart routing because we're DNA aside from really good developer experience is also quality infrastructure right we're known for really high up times um and just our framework defined infrastructure approach so with all of that we decided well versai gateway is