Community Session: AI Gateway AMA

[Music]

Hello everyone. I'm Amy. This is Jacob. We work in the community here at Verscell. Welcome to our second Fursel community session of today. Uh just a reminder, we are streaming on X and YouTube, but if you want to join in the chat, please join us in the community and be sure to click going to open up the chat on the event page. Uh that way we'll be sure to see your questions. I don't want to miss any of those that happen on other platforms. Um and feel free to ask questions along the way. We'll we'll add

those questions and make sure that those get asked uh before we run out of time here. Yeah, if you're going to hang out in the chat, please remember to be respectful and follow our code of conduct. And I'd like to introduce our guests today. We have Walter and Harprey from the Verscell AI Gateway team. Hey guys, welcome. Hey everyone. Hey there. Thanks for joining us today. Jacob, I see that you fixed your lights. That's

cool. Yeah. Yeah, it was a little bright last time, but we finally got that one all sorted out. Well, all right. We have a lot of things that people have asked um ahead of time and some things I'm sure that will come up in the chat. So, let's get started. Uh just as a quick intro for people who've maybe not tried the AI gateway yet or tried it a while ago and have missed some of the new features, do you guys want to talk a little bit about that? Yeah, for sure. Um hey everyone, I'm Arri. Um I work on product for our AI

gateway and other AI related things at VCEL and we had a chat last time um before we actually went GA with AI gateway and we're excited to kind of talk to you about the improvement some of the things that we've seen since then. If you haven't really heard of the gateway and if you haven't used it thus far, um it's really a one-stop shop to access multiple models um so that you

don't have to go create provider accounts with each individual provider if you want to have flexibility in your production apps or if you're just looking to try out what's new. Um and we'll have an interesting announcement at the end of this um call as well around that. Verseli gateways is the place to go. So um that's just like if you're a curious person, right? But production apps what we realized like v0ero also any reliability and for better or for worse

the u 11 9 that we took for granted uh with infra hasn't really been the case with inference. And to get that same level of reliability or close to that, you need to have uh fallback between different providers in case someone goes down and gateway magically handles that for you in the background. Um we have great relationships with the upstream providers. Uh and therefore we also have

good rate limits for you. So when you access gateway you don't have to be worried about rate li getting rate limited. um you can just build and ship products and that's what you need to that's what we want you to focus on anyway right and the last thing I'd call out here is we don't have a markup on the actual tokens that's not our strategy so if if you're in the business of shipping products with AI um and you want to access intelligence