Skip to main content
Original: Swyx · 12/03/2026

Summary

Simon Hørup Eskildsen discusses the development of Turbopuffer, a search engine designed to optimize costs and improve retrieval for unstructured data, reflecting on his journey and insights.

Key Insights

“I just called Lockey and was like, local Lockie. Like if this doesnt have PMF by the end of the year, like well just like return all the money to you.” — Simon discussing his commitment to ensuring Turbopuffer achieves product-market fit.
“Its less about whether a company can build search infra internally, and more about whether they have time.” — Simon reflecting on the challenges companies face in building search infrastructure in the age of AI.
“The old pattern was one retrieval call up front; the new pattern is one agent firing many parallel queries at once.” — Simon explaining the evolution of search methodologies with the introduction of agentic workloads.

Topics


Full Article

Turbopuffer came out of a reading app.In 2022, Simon was helping his friends at Readwise scale their infra for a highly requested feature: article recommendations and semantic search. Readwise was paying ~5k/monthfortheirrelationaldatabaseandvectorsearchwouldcost 5k/month for their relational database and vector search would cost ~20k/month making the feature too expensive to ship. In 2023 after mulling over the problem from Readwise, Simon decided he wanted to build a search engine which became Turbopuffer.Turbopuffer helping Readwise today - https://turbopuffer.com/customers/readwiseWe discuss: Simons path: Denmark Shopify infra for nearly a decade angel engineering across startups like Readwise, Replicate, and Causal turbopuffer almost accidentally becoming a company The Readwise origin story: building an early recommendation engine right after the ChatGPT moment, seeing it work, then realizing it would cost ~30k/monthforacompanyspending 30k/month for a company spending ~5k/month total on infra and getting obsessed with fixing that cost structure Why turbopuffer is a search engine for unstructured data: Simons belief that models can learn to reason, but cant compress the worlds knowledge into a few terabytes of weights, so they need to connect to systems that hold truth in full fidelity The three ingredients for building a great database company: a new workload, a new storage architecture, and the ability to eventually support every query plan customers will want on their data The architecture bet behind turbopuffer: going all in on object storage and NVMe, avoiding a traditional consensus layer, and building around the cloud primitives that only became possible in the last few years Why Simon hated operating Elasticsearch at Shopify: years of painful on-call experience shaped his obsession with simplicity, performance, and eliminating state spread across multiple systems The Cursor story: launching turbopuffer as a scrappy side project, getting an email from Cursor the next day, flying out after a 4am call, and helping cut Cursors costs by 95% while fixing their per-user economics The Notion story: buying dark fiber, tuning TCP windows, and eating cross-cloud costs because Simon refused to compromise on architecture just to close a deal faster Why AI changes the build-vs-buy equation: its less about whether a company can build search infra internally, and more about whether they have time especially if an external team can feel like an extension of their own Why RAG isnt dead: coding companies still rely heavily on search, and Simon sees hybrid retrieval semantic, text, regex, SQL-style patterns becoming more important, not less How agentic workloads are changing search: the old pattern was one retrieval call up front; the new pattern is one agent firing many parallel queries at once, turning search into a highly concurrent tool call Why turbopuffer is reducing query pricing: agentic systems are dramatically increasing query volume, and Simon expects retrieval infra to adapt to huge bursts of concurrent search rather than a small number of carefully chosen calls The philosophy of playing with open cards: Simons habit of being radically honest with investors, including telling Lachy Groom hed return the money if turbopuffer didnt hit PMF by year-end The P99 engineer: Simons framework for building a talent-dense company, rejecting by default unless someone on the team feels strongly enough to fight for the candidate Simon Hrup Eskildsen LinkedIn: https://www.linkedin.com/in/sirupsen X: https://x.com/Sirupsen https://sirupsen.com/aboutturbopuffer https://turbopuffer.com/Full Video PodTimestamps00:00:00 The PMF promise to Lachy Groom00:00:25 Intro and Simon’s background00:02:19 What turbopuffer actually is00:06:26 Shopify, Elasticsearch, and the pain behind the company00:10:07 The Readwise experiment that sparked turbopuffer00:12:00 The insight Simon couldnt stop thinking about00:17:00 S3 consistency, NVMe, and the architecture bet00:20:12 The Notion story: latency, dark fiber, and conviction00:25:03 Build vs. buy in the age of AI00:26:00 The Cursor story: early launch to breakout customer00:29:00 Why code search still matters00:32:00 Search in the age of agents00:34:22 Pricing turbopuffer in the AI era00:38:17 Why Simon chose Lachy Groom00:41:28 Becoming a founder on purpose00:44:00 The P99 engineer philosophy00:49:30 Bending software to your will00:51:13 The future of turbopuffer00:57:05 Simons tea obsession00:59:03 Tea kits, X Live, and P99 LiveTranscriptSimon Hrup Eskildsen: I dont think Ive said this publicly before, but I just called Lockey and was like, local Lockie. Like if this doesnt have PMF by the end of the year, like well just like return all the money to you. But its just like, I dont really, we, Justine and I dont wanna work on this unless its really working.So we want to give it the best shot this year and like were really gonna go for it. Were gonna hire a bunch of people. Were just gonna be honest with everyone. Like when I dont know how to play a game, I just play with open cards. Lockey was the only person that didnt, that didnt freak out. He was like, Ive never heard anyone say that before.Alessio: Hey everyone, welcome to the Leading Space podcast. This is Celesio Pando, Colonel Laz, and Im joined by Swix, editor of Leading Space.swyx: Hello. Hello, uh, were still, uh, recording in the Ker studio for the first time. Very excited. And today we are joined by Simon Eski. Of Turbo Farer welcome.Simon Hrup Eskildsen: Thank you so much for having me.swyx: Turbo Farer has like really gone on a huge tear, and I, I do have to mention that like youre one of, youre not my newest member of the Danish AHU Mafia, where like theres a lot of legendary programmers that have come out of it, like, uh, beyond Trotro, Rasmus, lado Berg and the V eight team and, and Google Maps team.Uh, youre mostly a Canadian now, but isnt that interesting? Theres so many, so much like strong Danish presence.Simon Hrup Eskildsen: Yeah, I was writing a post, um, not that long ago about sort of the influences. So I grew up in Denmark, right? I left, I left when, when I was 18 to go to Canada to, to work at Shopify. Um, and so I, like, Ive, I would still say that I feel more Danish than, than Canadian.This is also the weird accent. I cant say th because it, this is like, I dont, you know, my wife is also Canadian, um, and I think. I think like one of the things in, in Denmark is just like, theres just such a ruthless pragmatism and theres also a big focus on just aesthetics. Like, theyre like very, people really care about like where, what things look like.Um, and like Canada has a lot of attributes, US has, has a lot of attributes, but I think theres been lots of the great things to carry. I dont know whats in the water in Ahu though. Um, and I dont know that I could be considered part of the Mafi mafia quite yet, uh, compared to the phenomenal individuals we just mentioned.Barra OV is also, uh, Danish Canadian. Okay. Yeah. I dont know where he lives now, but, and hes the PHP.swyx: Yeah. And obviously Toby German, but moved to Canada as well. Yes. Like this is like import that, uh, that, that is an interesting, um, talent move.Alessio: I think. I would love to get from you. Definition of Turbo puffer, because I think you could be a Vector db, which is maybe a bad word now in some circles, you could be a search engine.Its like, let, lets just start there and then well maybe run through the history of how you got to this point.Simon Hrup Eskildsen: For sure. Yeah. So Turbo Puffer is at this point in time, a search engine, right? We do full text search and we do vector search, and thats really what were specialized in. If youre trying to do much more than that, like then this might not be the right place yet, but Turbo Buffer is all about search.The other way that I think about it is that we can take all of the worlds knowledge, all of the exabytes and exabytes of data that there is, and we can use those tokens to train a model, but we cant compress all of that into a few terabytes of weights, right? Compress into a few terabytes of weights, how to reason with the world, how to make sense of the knowledge.But we have to somehow connect it to something externally that actually holds that like in full fidelity and truth. Um, and thats the thing that we intend to become. Right? Thats like a very holier than now kind of phrasing, right? But being the search engine for unstructured, unstructured data is the focus of turbo puffer at this point in time.Alessio: And lets break down. So people might say, well, didnt Elasticsearch already do this? And then some other people might say, is this search on my data, is this like closer to rag than to like a xr, like a public search thing? Like how, how do you segment like the different types of search?Simon Hrup Eskildsen: The way that I generally think about this is like, theres a lot of database companies and I think if you wanna build a really big database company, sort of, you need a couple of ingredients to be in the air.We dont, which only happens roughly every 15 years. You need a new workload. You basically need the ambition that every single company on earth is gonna have data in your database. Multiple times you look at a company like Oracle, right? You will, like, I dont think you can find a company on earth with a digital presence that it not, doesnt somehow have some data in an Oracle database.Right? And I think at this point, thats also true for Snowflake and Databricks, right? 15 years later its, or even more than that, theres not a company on earth that doesnt, in. Or directly is consuming Snowflake or, or Databricks or any of the big analytics databases. Um, and I think were in that kind of moment now, right?I dont think youre gonna find a company over the next few years that doesnt directly or indirectly, um, have all their data available for, for search and connect it to ai. So you need that new workload, like you need something to be happening where theres a new workload that causes that to happen, and that new workload is connecting very large amounts of data to ai.The second thing you need. The second condition to build a big database company is that you need some new underlying change in the storage architecture that is not possible from the databases that have come before you. If you look at Snowflake and Databricks, right, commoditized, like massive fleet of HDDs, like that was not possible in it.It just wasnt in the air in the nineties, right? So you just didnt, we just didnt build these systems. S3 and and and so on was not around. And I think the architecture that is now possible that wasnt possible 15 years ago is to go all in on NVME SSDs. It requires a particular type of architecture for the database that.Its difficult to retrofit onto the databases that are already there, including the ones you just mentioned. The second thing is to go all in on OIC storage, more so than we could have done 15 years ago. Like we dont have a consensus layer, we dont really have anything. In fact, you could turn off all the servers that Turbo Buffer has, and we would not lose any data because we have all completely all in on OIC storage.And this means that our architecture is just so simple. So thats the second condition, right? First being a new workload. That means that every company on earth, either indirectly or directly, is using your database. Second being, theres some new storage architecture. That means that the, the companies that have come before you can do what youre doing.I think the third thing you need to do to build a big database company is that over time you have to implement more or less every Cory plan on the data. What that means is that you. You cant just get stuck in, like, this is the one thing that a database does. It has to be ever evolving because when someone has data in the database, they over time expect to be able to ask it more or less every question.So you have to do that to get the storage architecture to the limit of what, what its capable of. Those are the three conditions.swyx: I just wanted to get a little bit of like the motivation, right? Like, so you left Shopify, youre like principal, engineer, infra guy. Um, you also head of kernel labs, uh, inside of Shopify, right?And then you consulted for read wise and that it kind of gave you that, that idea. I just wanted you to tell that story. Um, maybe I, youve told it before, but, uh, just introduce the, the. People to like the, the new workload, the sort of aha moment for turbo PufferSimon Hrup Eskildsen: For sure. So yeah, I spent almost a decade at Shopify.I was on the infrastructure team, um, from the fairly, fairly early days around 2013. Um, at the time it felt like it was growing so quickly and everything, all the metrics were, you know, doubling year on year compared to the, what companies are contending with today. Its very cute in growth. I feel like lot some companies are seeing that month over month.Um, of course. Shopify compound has been compounding for a very long time now, but I spent a decade doing that and the majority of that was just make sure the site is up today and make sure its up a year from now. And a lot of that was really just the, um, you know, uh, the Kardashians would drive very, very large amounts of, of data to, to uh, to Shopify as they were rotating through all the merch and building out their businesses.And we just needed to make sure we could handle that. Right. And sometimes these were events, a million requests per second. And so, you know, we, we had our own data centers back in the day and we were moving to the cloud and there was so much sharding work and all of that that we were doing. So I spent a decade just scaling databases cause thats fundamentally whats the most difficult thing to scale about these sites.The database that was the most difficult for me to scale during that time, and that was the most aggravating to be on call for, was elastic search. It was very, very difficult to deal with. And I saw a lot of projects that were just being held back in their ambition by using it.swyx: And I mean, self-hosted.Self-hosted. causeSimon Hrup Eskildsen: its, yeah, and it commercial, this is like 2015, right? So its like a very particular vintage. Right. Its probably better at a lot of these things now. Um, it was difficult to contend with and Im just like, I just think about it. Its an inverted index. It should be good at these kinds of queries and do all of this.And it was, we, we often couldnt get it to do exactly what we needed to do or basically get lucine to do, like expose lucine raw to, to, to what we needed to do. Um, so that was like. Just something that we did on the side and just panic scaled when we needed to, but not a particular focus of mine. So I left, and when I left, I, um, wasnt sure exactly what I wanted to do.I mean, it spent like a decade inside of the same company. Id like grown up there. I started working there when I was 18.swyx: You only do Rails?Simon Hrup Eskildsen: Yeah. I mean, yeah. Rails. And hes a Rails guy. Uh, love Rails. So good. Um,Alessio: we all wish we could still work in Rails.swyx: I know know. I know, but some, I tried learning Ruby.Its just too much, like too many options to do the same thing. Its, thats my, I I know theres a, theres a way to do it.Simon Hrup Eskildsen: I love it. I dont know that I would use it now, like given cloud code and, and, and cursor and everything, but, um, um, but still it, like if Im just sitting down and writing a teal code, thats how I think.But anyway, I left and I wasnt, I talked to a couple companies and I was like, I dont. I need to see a little bit more of the world here to know what Im gonna like focus on next. Um, and so what I decided is like I was gonna, I called it like angel engineering, where I just hopped around in my friends companies in three months increments and just helped them out with something.Right. And, and just vested a bit of equity and solved some interesting infrastructure problem. So I worked with a bunch of companies at the time, um, read Wise was one of them. Replicate was one of them. Um, causal, I dunno if youve tried this, its like a, its a spreadsheet engine Yeah. Where you can do distribution.They sold recently. Yeah. Um, weve been, we used that in fp and a at, um, at Turbo Puffer. Um, so a bunch of companies like this and it was super fun. And so were the Chachi bt moment happened, I was with. With read Wise for a stint, we were preparing for the reader launch, right? Which is where you, you cue articles and read them later.And I was just getting their Postgres up to snuff, like, which basically boils down to tuning, auto vacuum. So I was doing that and then this happened and we were like, oh, maybe we should build a little recommendation engine and some features to try to hook in the lms. They were not that good yet, but it was clear there was something there.And so I built a small recommendation engine just, okay, lets take the articles that youve recently read, right? Like embed all the articles and then do recommendations. It was good enough that when I ran it on one of the co-founders of Reys, like I found out that I got articles about, about having a child.Im like, oh my God, I didnt, I, I didnt know that, that they were having a child. I wasnt sure what to do with that information, but the recommendation engine was good enough that it was suggesting articles, um, about that. And so there was, there was recommendations and uh, it actually worked really well.But this was a company that was spending maybe five grand a month in total on all their infrastructure and. When I did the napkin math on running the embeddings of all the articles, putting them into a vector index, putting it in prod, its gonna be like 30 grand a month. That just wasnt tenable. Right?Like Read Wise is a proudly bootstrapped company and its paying 30 grand for infrastructure for one feature versus five. It just wasnt tenable. So sort of in the bucket of this is useful, its pretty good, but let us, lets return to it when the costs come down.swyx: Did you say it grows by feature? So for five to 30 is by the number of, like, whats the, whats the Scaling factor scale?It scales by the number of articles that you embed.Simon Hrup Eskildsen: It does, but what I meant by that is like five grand for like all of the other, like the Heroku, dinos, Postgres, like all the other, and this then storage is 30. Yeah. And then like 30 grand for one feature. Right. Which is like, what other articles are related to this one.Um, so it was just too much right to, to power everything. Their budget wouldve been maybe a few thousand dollars, which still wouldve been a lot. And so we put it in a bucket of, okay, were gonna do that later. Well wait, we will wait for the cost to come down. And that haunted me. I couldnt stop thinking about it.I was like, okay, theres clearly some latent demand here. If the cost had been a 10th, we wouldve shipped it and. This was really the only data point that I had. Right. I didnt, I, I didnt, I didnt go out and talk to anyone else. It was just so I started reading Right. I couldnt, I couldnt help myself.Like I didnt know what like a vector index is. I, I generally barely do about how to generate the vectors. There was a lot of hype about, this is a early 2023. There was a lot of hype about vector databases. There were raising a lot of money and its like, I really didnt know anything about it. Its like, you know, trying these little models, fine tuning them.Like I was just trying to get sort of a lay of the land. So I just sat down. I have this. A GitHub repository called Napkin Math. And on napkin math, theres just, um, rows of like, oh, this is how much bandwidth. Like this is how many, you know, you can do 25 gigabytes per second on average to dram. You can do, you know, five gigabytes per second of rights to an SSD, blah blah.All of these numbers, right? And S3, how many you could do per, how much bandwidth can you drive per connection? I was just sitting down, I was like, why hasnt anyone build a database where you just put everything on O storage and then you puff it into NVME when you use the data and you puff it into dram if youre, if youre querying it alive, its just like, this seems fairly obvious and you, the only real downside to that is that if you go all in on o storage, every right will take a couple hundred milliseconds of latency, but from there its really all upside, right?You do the first go, it takes half a second. And it sort of occurred to me as like, well. The architecture is really good for that. Its really good for AB storage, its really good for nvm ESSD. Its, well, you just couldnt have done that 10 years ago. Back to what we were talking about before. You really have to build a database where you have as few round trips as possible, right?This is how CPUs work today. Its how NVM E SSDs work. Its how as, um, as three works that you want to have a very large amount of outstanding requests, right? Like basically go to S3, do like that thousand requests to ask for data in one round trip. Wait for that. Get that, like, make a new decision. Do it again, and try to do that maybe a maximum of three times.But no databases were designed that way within NVME as is ds. You can drive like within, you know, within a very low multiple of DRAM bandwidth if you use it that way. And same with S3, right? You can fully max out the network card, which generally is not maxed out. You get very, like, very, very good bandwidth.And, but no one had built a database like that. So I was like, okay, well cant you just, you know, take all the vectors right? And plot them in the proverbial coordinate system. Get the clusters, put a file on S3 called clusters, do json, and then put another file for every cluster, you know, cluster one, do js O cluster two, do js ON you know that like its two round trips, right?So you get the clusters, you find the closest clusters, and then you download the cluster files like the, the closest end. And you could do this in two round trips.swyx: You were nearest neighbors locally.Simon Hrup Eskildsen: Yes. Yes. And then, and you would build this, this file, right? Its just like ultra simplistic, but its not a far shot from what the first version of Turbo Buffer was.Why hasnt anyone done thatAlessio: in that moment? From a workload perspective, youre thinking this is gonna be like a read heavy thing because theyre doing recommend. Like is the fact that like writes are so expensive now? Oh, with ai youre actually not writing that much.Simon Hrup Eskildsen: At that point I hadnt really thought too much about, well no actually it was always clear to me that there was gonna be a lot of rights because at Shopify, the search clusters were doing, you know, I dont know, tens or hundreds of crew QPS, right?cause you just have to have a human sit and type in. But we did, you know, I dont know how many updates there were per second. Im sure it was in the millions, right into the cluster. So I always knew there was like a 10 to 100 ratio on the read write. In the read wise use case. Its, um, even, even in the read wise use case, thered probably be a lot fewer reads than writes, right?Theres just a lot of churn on the amount of stuff that was going through versus the amount of queries. Um, I wasnt thinking too much about that. I was mostly just thinking about whats the fundamentally cheapest way to build a database in the cloud today using the primitives that you have available.And this is it, right? You just, now you have one machine and you know, lets say you have a terabyte of data in S3, you paid the 200amonthforthat,andthenmaybefiveto10200 a month for that, and then maybe five to 10% of that data and needs to be an NV ME SSDs and less than that in dram. Well. Youre paying very, very little to inflate the data.swyx: By the way, when you say no one else has done that, uh, would you consider Neon, uh, to be on a similar path in terms of being sort of S3 first and, uh, separating the compute and storage?Simon Hrup Eskildsen: Yeah, I think what I meant with that is, uh, just build a completely new database. I dont know if we were the first, like it was very much, it was, I mean, I, I hadnt, I just looked at the napkin math and was like, this seems really obvious.So Im sure like a hundred people came up with it at the same time. Like the light bulb and every invention ever. Right. It was just in the air. I think Neon Neon was, was first to it. And theyre trying, theyre retrofitted onto Postgres, right? And then they built this whole architecture where you have, you have it in memory and then you sort of.You know, m map back to S3. And I think that was very novel at the time to do it for, for all LTP, but I hadnt seen a database that was truly all in, right. Not retrofitting it. The database felt built purely for this no consensus layer. Even using compare and swap on optic storage to do consensus. I hadnt seen anyone go that all in.And I, I mean, there, there, Im sure there was someone that did that before us. I dont know. I was just looking at the napkin mathswyx: and, and when you say consensus layer, uh, are you strongly relying on S3 Strong consistency? You are. Okay.SoSimon Hrup Eskildsen: that is your consensus layer. It, it is the consistency layer. And I think also, like, this is something that most people dont realize, but S3 only became consistent in December of 2020.swyx: I remember this coming out during COVID and like people were like, oh, like, it was like, uh, it was just like a free upgrade.Simon Hrup Eskildsen: Yeah.swyx: They were just, they just announced it. We saw consistency guys and like, okay, cool.Simon Hrup Eskildsen: And Im sure that they just, they probably had it in prod for a while and theyre just like, its done right.And people were like, okay, cool. But. Thats a big moment, right? Like nv, ME SSDs, were also not in the cloud until around 2017, right? So you just sort of had like 2017 nv, ME SSDs, and people were like, okay, cool. Theres like one skew that does this, whatever, right? Takes a few years. And then the second thing is like S3 becomes consistent in 2020.So now it means you dont have to have this like big foundation DB or like zookeeper or whatever sitting there contending with the keys, which is how. You know, thats what Snowflake and others have do so muchswyx: for goneSimon Hrup Eskildsen: Exactly. Just gone. Right? And so just push to the, you know, whatever, how many hundreds of people they have working on S3 solved and then compare and swap was not in S3 at this point in time,swyx: by the way.Uh, I dont know what that is, so maybe you wanna explain. Yes. Yeah.Simon Hrup Eskildsen: Yes. So, um, what Compare and swap is, is basically, you can imagine that if you have a database, it might be really nice to have a file called metadata json. And metadata JSON could say things like, Hey, these keys are here and this file means that, and theres lots of metadata that you have to operate in the database, right?But thats the simplest way to do it. So now you have might, you might have a lot of servers that wanna change the metadata. They might have written a file and want the metadata to contain that file. But you have a hundred nodes that are trying to contend with this metadata that JSON well, what compare and Swap allows you to do is basically just you download the file, you make the modifications, and then you write it only if it hasnt changed.While you did the modification and if not you retry. Right? Should just have this retry loops. Now you can imagine if you have a hundred nodes doing that, its gonna be really slow, but it will converge over time. That primitive was not available in S3. It wasnt available in S3 until late 2024, but it was available in GCP.The real story of this is certainly not that I sat down and like bake brained it. I was like, okay, were gonna start on GCS S3 is gonna get it later. Like it was really not that we started, we got really lucky, like we started on GCP and we started on GCP because tur um, Shopify ran on GCP. And so that was the platform I was most available with.Right. Um, and I knew the Canadian team there cause Id worked with them at Shopify and so it was natural for us to start there. And so when we started building the database, were like, oh yeah, we have to build a, we really thought we had to build a consensus layer, like have a zookeeper or something to do this.But then we discovered the compare and swap. Its like, oh, we can kick the can. Like well just do metadata r json and just, its fine. Its probably fine. Um, and we just kept kicking the can until we had very, very strong conviction in the idea. Um, and then we kind of just hinged the company on the fact that S3 probably was gonna get this, it started getting really painful in like mid 2024.cause we were closing deals with, um, um, notion actually that was running in AWS and were like, trust us. You, you really want us to run this in GCP? And theyre like, no, I dont know about that. Like, were running everything in AWS and the latency across the cloud were so big and we had so much conviction that we bought like, you know, dark fiber between the AWS regions in, in Oregon, like in the InterExchange and GCP is like, weve never seen a startup like do like, whats going on here?And were just like, no, we dont wanna do this. We were tuning like TCP windows, like everything to get the latency down cause we had so high conviction in not doing like a, a metadata layer on S3. So those were the three conditions, right? Compare and swap. To do metadata, which wasnt in S3 until late 2024 S3 being consistent, which didnt happen until December, 2020.Uh, 2020. And then NVMe ssd, which didnt end in the cloud until 2017.swyx: I mean, in some ways, like a very big like cloud success story that like you were able to like, uh, put this all together, but also doing things like doing, uh, bind our favor. That that actually is something Ive never heard.Simon Hrup Eskildsen: I mean, its very common when youre a big company, right?Youre like connecting your own like data center or whatever. But its like, it was uniquely just a pain with notion because the, um, the org, like most of the, like if youre buying in Ashburn, Virginia, right? Like US East, the Google, like the GCP and, and AWS data centers are like within a millisecond on, on each other, on the public exchanges.But in Oregon uniquely, the GCP data center sits like a couple hundred kilometers, like east of Portland and the AWS region sits in Portland, but the network exchange they go through is through Seattle. So its like a full, like 14 milliseconds or something like that. And so anyway, yeah. Its, its, so we were like, okay, we cant, we have to go through an exchange in Portland.Yeah. Andswyx: youd rather do this than like run your zookeeper and likeSimon Hrup Eskildsen: Yes. Way rather. It doesnt have state, I dont want state and two systems. Um, and I think all that is just informed by Justine, my co-founder and I had just been on call for so long. And the worst outages are the ones where you have state in multiple places thats not syncing up.So it really came from, from a a, like just a, a very pure source of pain, of just imagining what we would be Okay. Being woken up at 3:00 AM about and having something in zookeeper was not one of them.swyx: You, youre talking to like a notion or something. Do they care or do they just, theySimon Hrup Eskildsen: just, they care about latency.swyx: They latency cost. Thats it.Simon Hrup Eskildsen: They just cared about latency. Right. And we just absorbed the cost. Were just like, we have high conviction in this. At some point we can move them to AWS. Right. And so we just, we, well buy the fiber, it doesnt matter. Right. Um, and its like 5,000. Usually when you buy fiber, you buy like multiple lines.And were like, we can only afford one, but we will just test it that when it goes over the public internet, its like super smooth. And so we did a lot of, anyway, its, yeah, it was, thats cool.Alessio: You can imagine talking to the GCP rep and its like, no, were gonna buy, because we know were gonna turn, were gonna turn from you guys and go to AWS in like six months.But in the meantime well do this. ItsSimon Hrup Eskildsen: a, I mean, like they, you know, this workload still runs on GCP for what its worth. Right? cause its so, it was just, it was so reliable. So it was never about moving off GCP, it was just about honesty. It was just about giving notion the latency that they deserved.Right. Um, and we didnt want em to have to care about any of this. We also, they were like, oh, egress is gonna be bad. It was like, okay, screw it. Like were just gonna like vvc, VPC peer with you and AWS well eat the cost. Yeah. Whatever needs to be done.Alessio: And what were the actual workloads? Because I think when you think about ai, its like 14 milliseconds.Its like really doesnt really matter in the scheme of like a model generation.Simon Hrup Eskildsen: Yeah. We were told the latency, right. That we had to beat. Oh, right. So, so were just looking at the traces. Right. And then sort of like hand draw, like, you know, kind of like looking at the trace and then thinking what are the other extensions of the trace?Right. And theres a lot more to it because its also when you have, if you have 14 versus seven milliseconds, right. You can fit in another round trip. So we had to tune TCP to try to send as much data in every round trip, prewarm all the connections. And there was, theres a lot of things that compound from having these kinds of round trips, but in the grand scheme it was just like, well, we have to beat the latency of whatever were up against.swyx: Which is like they, I mean, notion is a database company. They could have done this themselves. They, they do lots of database engineering themselves. How do you even get in the door? Like Yeah, just like talk through that kind of.Simon Hrup Eskildsen: Last time I was in San Francisco, I was talking to one of the engineers actually, who, who was one of our champions, um, at, AT Notion.And they were, they were just trying to make sure that the, you know, per user cost matched the economics that they needed. You know, Uhhuh like, its like the way I think about, its like I have to earn a return on whatever the clouds charge me and then my customers have to earn a return on that. And its like very simple, right?And so there has to be gross margin all the way up and thats how you build the product. And so then our customers have to make the right set of trade off the turbo Puffer makes, and if theyre happy with that, thats great.swyx: Do you feel like youre competing with build internally versus buy or buy versus buy?Simon Hrup Eskildsen: Yeah, so, sorry, this was all to build up to your question. So one of the notion engineers told me that theyd sat and probably on a napkin, like drawn out like, why hasnt anyone built this? And then they saw terrible. It was like, well, it literally that. So, and I think AI has also changed the buy versus build equation in terms of, its not really about can we build it, its about do we have time to build it?I think they like, I think they felt like, okay, if this is a team that can do that and they, they feel enough like an extension of our team, well then we can go a lot faster, which would be very, very good for them. And I mean, they put us through the, through the test, right? Like we had some very, very long nights to to, to do that POC.And they were really our biggest, our second big customer off the cursor, which also was a lot of late nights. Right.swyx: Yeah. That, I mean, should we go into that story? The, the, the sort of Chriss story, like a lot, um, they credit you a lot for. Working very closely with them. So I just wanna hear, Ive heard this, uh, story from Soles point of view, but like, Im curious what, what it looks like from your side.Simon Hrup Eskildsen: I actually havent heard it from Soles point of view, so maybe you can now cross reference it. The way that I remember it was that, um, the day after we launched, which was just, you know, Id worked the whole summer on, on the first version. Justine wasnt part of it yet. cause I just, I didnt tell anyone that summer that I was working on this.I was just locked in on building it because its very easy otherwise to confuse talking about something to actually doing it. And so I was just like, Im not gonna do that. Im just gonna do the thing. I launched it and at this point turbo puffer is like a rust binary running on a single eight core machine in a T Marks instance.And me deploying it was like looking at the request log and then like command seeing it or like control seeing it to just like, okay, theres no request. Lets upgrade the binary. Like it was like literally the, the, the, the scrappiest thing. You could imagine it was on purpose because just like at Shopify, we did that all the time.Like, we like move, like we ran things in tux all the time to begin with. Before something had like, at least the inkling of PMF, it was like, okay, is anyone gonna hear about this? Um, and one of the cursor co-founders Arvid reached out and he just, you know, the, the cursor team are like all I-O-I-I-M-O like, um, contenders, right?So they just speak in bullet points and, and facts. It was like this amazing email exchange just of, this is how many QPS we have, this is what were paying, this is where were going, blah, blah, blah. And so were just conversing in bullet points. And I tried to get a call with them a few times, but they were, so, they were like really writing the PMF bowl here, just like late 2023.And one time Swally emails me at like five. What was it like 4:00 AM Pacific time saying like, Hey, are you open for a call now? And Im on the East coast and I, it was like 7:00 AM I was like, yeah, great, sure, whatever. Um, and we just started talking and something. Then I didnt know anything about sales.It was something that just comp compelled me. I have to go see this team. Like, theres something here. So I, I went to San Francisco and I went to their office and the way that I remember it is that Postgres was down when I showed up at the office. Did SW tell you this? No. Okay. So Postgres was down and so its like they were distracting with that.And I was trying my best to see if I could, if I could help in any way. Like I knew a little bit about databases back to tuning, auto vacuum. It was like, I think you have to tune out a vacuum. Um, and so we, we talked about that and then, um, that evening just talked about like what would it look like, what would it look like to work with us?And I just said. Look like were all in, like we will just do what well do whatever, whatever you tell us, right? They migrated everything over the next like week or two, and we reduced their cost by 95%, which I think like kind of fixed their per user economics. Um, and it solved a lot of other things. And we were just, Justine, this is also when I asked Justine to come on as my co-founder, she was the best engineer, um, that I ever worked with at Shopify.She lived two blocks away and we were just, okay, were just gonna get this done. Um, and we did, and so we helped them migrate and we just worked like hell over the next like month or two to make sure that we were never an issue. And that was, that was the cursor story. Yeah.swyx: And, and is code a different workload than normal text?I, I dont know. Is is it just text? Is it the same thing?Simon Hrup Eskildsen: Yeah, so cursors workload is basically, they, um, they will embed the entire code base, right? So they, they will like chunk it up in whatever they would, they do. They have their own embedding model, um, which theyve been public about. Um, and they find that on, on, on their evals.It. Theres one of their evals where its like a 25% improvement on a very particular workload. They have a bunch of blog posts about it. Um, I think it works best on larger code basis, but theyve trained their own embedding model to do this. Um, and so youll see it if you use the cursor agent, it will do searches.And theyve also been public around, um, how theyve, I think they post trained their model to be very good at semantic search as well. Um, and thats, thats how they use it. And so its very good at, like, can you find me on the code thats similar to this, or code that does this? And just in, in this queries, they also use GR to supplement it.swyx: Yeah.Simon Hrup Eskildsen: Um, of courseswyx: its been a big topic of discussion like, is rag dead because gr you know,Simon Hrup Eskildsen: and I mean like, I just, we, we see lots of demand from the coding company to ethicsswyx: search in every part. Yes.Simon Hrup Eskildsen: Uh, we, we, we see demand. And so, I mean, Im. I like case studies. I dont like, like just doing like thought pieces on this is where its going.And like trying to be all macroeconomic about ai, thats has turned out to be a giant waste of time because no one can really predict any of this. So I just collect case studies and I mean, cursor has done a great job talking about what theyre doing and I hope some of the other coding labs that use Turbo Puffer will do the same.Um, but it does seem to make a difference for particular queries. Um, I mean we can also do text, we can also do RegX, but I should also say that cursors like security posture into Tur Puffer is exceptional, right? They have their own embedding model, which makes it very difficult to reverse engineer. They obfuscate the file paths.They like you. Its very difficult to learn anything about a code base by looking at it. And the other thing they do too is that for their customers, they encrypt it with their encryption keys in turbo puffers bucket. Um, so its, its, its really, really well designed.swyx: And so this is like extra stuff they did to work with you because you are not part of Cursor.Exactly like, and this is just best practice when working in any database, not just you guys. Okay. Yeah, that makes sense. Yeah. I think for me, like the, the, the learning is kind of like you, like all workloads are hybrid. Like, you know, uh, like you, you want the semantic, you want the text, you want the RegX, you want sql.I dunno. Um, but like, its silly to like be all in on like one particularly query pattern.Simon Hrup Eskildsen: I think, like I really like the way that, um, um, that swally at cursor talks about it, which is, um, Im gonna butcher it here. Um, and you know, Im a, Im a database scalability person. Im not a, I, I dunno anything about training models other than, um, what the internet tells me and what.The way he describes is that this is just like cash compute, right? Its like you have a point in time where youre looking at some particular context and focused on some chunk and you say, this is the layer of the neural net at this point in time. That seems fundamentally really useful to do cash compute like that.And, um, how the value of that will change over time. Im, Im not sure, but there seems to be a lot of value in that.Alessio: Maybe talk a bit about the evolution of the workload, because even like search, like maybe two years ago it was like one search at the start of like an LLM query to build the context. Now you have a gentech search, however you wanna call it, where like the model is both writing and changing the code and its searching it again later.Yeah. What are maybe some of the new types of workloads or like changes youve had to make to your architecture for it?Simon Hrup Eskildsen: I think youre right. When I think of rag, I think of, Hey, theres an 8,000 token, uh, context window and you better make it count. Um, and search was a way to do that now. Everything is moving towards the, just let the agent do its thing.Right? And so back to the thing before, right? The LLM is very good at reasoning with the data, and so were just the tool call, right? And thats increasingly what we see our customers doing. Um, what were seeing more demand from, from our customers now is to do a lot of concurrency, right? Like Notion does a ridiculous amount of queries in every round trip just because they cant.And Im also now, when I use the cursor agent, I also see them doing more concurrency than Ive ever seen before. So a bit similar to how we designed a database to drive as much concurrency in every round trip as possible. Thats also what the agents are doing. So thats new. It means just an enormous amount of queries all at once to the dataset while its warm in as few turns as possible.swyx: Can I clarify one thing on that?Simon Hrup Eskildsen: Yes.swyx: Is it, are they batching multiple users or one user is driving multiple,Simon Hrup Eskildsen: one user driving multiple, one agent driving.swyx: Its parallel searching a bunch of things.Simon Hrup Eskildsen: Exactly.swyx: Yeah. Yeah, exactly. So yeah, the clinician also did, did this for the fast context thing, like eight parallel at once.Simon Hrup Eskildsen: Yes.swyx: And, and like an interesting problem is, well, how do you make sure you have enough diversity so youre not making the the same request eight times?Simon Hrup Eskildsen: And I think like thats probably also where the hybrid comes in, where. Thats another way to diversify. Its a completely different way to, to do the search.Thats a big change, right? So before it was really just like one call and then, you know, the LLM took however many seconds to return, but now we just see an enormous amount of queries. So the, um, we just see more queries. So weve like tried to reduce query, weve reduced query pricing. Um, this is probably the first time actually Im saying that, but the query pricing is being reduced, like five x.Um, and well probably try to reduce it even more to accommodate some of these workloads of just doing very large amounts of queries. Um, thats one thing thats changed. I think the right, the right ratio is still very high, right? Like theres still a, an enormous amount of rights per read, but were starting probably to see that change if people really lean into this pattern.Alessio: Can we talk a little bit about the pricing? Im curious, uh, because traditionally a database would charge on storage, but now you have the token generation that is so expensive, where like the actual. Value of like a good search query is like much higher because theyre like saving inference time down the line.How do you structure that as like, what are people receptive to on the other side too?Simon Hrup Eskildsen: Yeah. I, the, the turbo puffer pricing in the beginning was just very simple. The pricing on these on for search engines before Turbo Puffer was very server full, right? It was like, heres the vm, heres the per hour cost, right?Great. And I just sat down with like a piece of paper and said like, if Turbo Puffer was like really good, this is probably what it would cost with a little bit of margin. And that was the first pricing of Turbo Puffer. And I just like sat down and I was like, okay, like this is like probably the storage amp, but whenever on a piece of paper I, it was vibe pricing.It was very vibe price, and I got it wrong. Oh. Um, well I didnt get it wrong, but like Turbo Puffer wasnt at the first principle pricing, right? So when Cursor came on Turbo Puffer, it was like. Like, I didnt know any VCs. I didnt know, like I was just like, I dont know, I didnt know anything about raising money or anything like that.I just saw that my GCP bill was, was high, was a lot higher than the cursor bill. So Justine and I was just like, well, we have to optimize it. Um, and I mean, to the chagrin now of, of it, of, of the VCs, it now means that were profitable because weve had so much pricing pressure in the beginning. Because it was running on my credit card and Justine and I had spent like, like tens of thousands of dollars on like compute bills and like spinning off the company and like very like, like bad Canadian lawyers and like things like to like get all of this done because we just like, we didnt know.Right. If youre like steeped in San Francisco, youre just like, you just know. Okay. Like you go out, raise a pre-seed round. I, I never heard a word pre-seed at this point in time.swyx: When you had Cursor, you had Notion you, you had no funding.Simon Hrup Eskildsen: Um, with Cursor we had no funding. Yeah. Um, by the time we had Notion Locke was, Locke was here.Yeah. So it was really just, we vibe priced it 100% from first Principles, but it wasnt, it, it was not performing at first principles, so we just did everything we could to optimize it in the beginning for that, so that at least we could have like a 5% margin or something. So I wasnt freaking out because Cursors bill was also going like this as they were growing.And so my liability and my credit limit was like actively like calling my bank. It was like, I need a bigger credit. Like it was, yeah. Anyway, that was the beginning. Yeah. But the pricing was, yeah, like storage rights and query. Right. And the, the pricing we have today is basically just that pricing with duct tape and spit to try to approach like, you know, like a, as a margin on the physical underlying hardware.And were doing this year, youre gonna see more and more pricing changes from us. Yeah.swyx: And like is how much does stuff like VVC peering matter because youre working in AWS land where egress is charged and all that, you know.Simon Hrup Eskildsen: We probably dont like, we have like an enterprise plan that just has like a base fee because we havent had time to figure out SKU pricing for all of this.Um, but I mean, yeah, you can run turbo puffer either in SaaS, right? Thats what Cursor does. You can run it in a single tenant cluster. So its just you. Thats what Notion does. And then you can run it in, in, in BYOC where everything is inside the customers VPC, thats what an for example, philanthropic does.swyx: What Im hearing is that this is probably the best CRO job for somebody who can come in and,Simon Hrup Eskildsen: I mean,swyx: help you with this.Simon Hrup Eskildsen: Um, like Turbo Puffer hired, like, I dont know what, what number this was, but we had a full-time CFO as like the 12th hire or something at Turbo Puffer, um, I think I hear are a lot of comp.I dont know how they do it. Like they have a hundred employees and not a CFO. Its like having a CFO is like a runningswyx: business man. Like, you know,Simon Hrup Eskildsen: its so good. Yeah, like money Mike, like he just, you know, just handles the money and a lot of the business stuff and so he came in and just hopped with a lot of the operational side of the business.So like C-O-O-C-F-O, like somewhere in between.swyx: Just as quick mention of Lucky, just cause Im curious, Ive met Lock and like, hes obviously a very good investor and now on physical intelligence, um, I call it generalist super angel, right? He invests in everything. Um, and I always wonder like, you know, is there something appealing about focusing on developer tooling, focusing on databases, going like, Ive invested for 10 years in databases versus being like a lock where he can maybe like connect you to all the customers that you need.Simon Hrup Eskildsen: This is an excellent question. No, no ones asked me this. Um, why lockey? Because. There was a couple of people that we were talking to at the time and when we were raising, we were almost a little, we were like a bit distressed because one of our, one of our peers had just launched something that was very similar to Turbo Puffer.And someone just gave me the advice at the time of just choose the person where you just feel like you can just pick up the phone and not prepare anything. And just be completely honest, and I dont think Ive said this publicly before, but I just called Lockey and was like local Lockie. Like if this doesnt have PMF by the end of the year, like well just like return all the money to you.But its just like, I dont really, we, Justine and I dont wanna work on this unless its really working. So we want to give it the best shot this year and like were really gonna go for it. Were gonna hire a bunch of people and were just gonna be honest with everyone. Like when I dont know how to play a game, I just play with open cards and.Lockey was the only person that didnt, that didnt freak out. He was like, Ive never heard anyone say that before. As I said, I didnt even know what a seed or pre-seed round was like before, probably even at this time. So I was just like very honest with him. And I asked him like, Lockie, have you ever have, have you ever invested in database company?He was just like, no. And at the time I was like, am I dumb? Like, but I think there was something that just like really drew me to Lockie. He is so authentic, so honest, like, and there was something just like, I just felt like I could just play like, just say everything openly. And that was, that was, I think that that was like a perfect match at the time, and, and, and honestly still is.He was just like, okay, thats great. This is like the most honest, ridiculous thing Ive ever heard anyone say to me. But like that, like that, whyswyx: is this ridiculous? Say competitor launch, this may not work out. It wasSimon Hrup Eskildsen: more just like. If this doesnt work out, Im gonna close up shop by the end of the mo the year, right?Like it was, I dont know, maybe its common. I, I dont know. He told me it was uncommon. I dont know. Um, thats why we chose him and hed been phenomenal. The other people were talking at the, at the time were database experts. Like they, you know, knew a lot about databases and Locke didnt, this turned out to be a phenomenal asset.Right. I like Justine and I know a lot about databases. The people that we hire know a lot about databases. What we needed was just someone who didnt know a lot about databases, didnt pretend to know a lot about databases, and just wanted to help us with candidates and customers. And he did. Yeah. And I have a list, right, of the investors that I have a relationship with, and Lockey has just performed excellent in the number of sub bullets of what we can attribute back to him.Just absolutely incredible. And when people talk about like no ego and just the best thing for the founder, I like, I dont think that anyone, like even my lawyer is like, yeah, Lockey is like the most friendly person you will find.swyx: Okay. This is my most glow recommendation Ive ever heard.Alessio: He deserves it.Hes very special.swyx: Yeah. Yeah. Yeah. Okay. Amazing.Alessio: Since you mentioned candidates, maybe we can talk about team building, you know, like, especially in sf, it feels like its just easier to start a company than to join a company. Uh, Im curious your experience, especially not being n SF full-time and doing something that is maybe, you know, a very low level of detail and technical detail.Simon Hrup Eskildsen: Yeah. So joining versus starting, I never thought that I would be a founder. I would start with it, like Turbo Puffer started as a blog post, and then it became a project and then sort of almost accidentally became a company. And now it feels like its, its like becoming a bigger company. That was never the intention.The intentions were very pure. Its just like, why hasnt anyone done this? And its like, I wanna be the, like, I wanna be the first person to do it. I think some founders have this, like, I could never work for anyone else. I, I really dont feel that way. Like, its just like, I wanna see this happen. And I wanna see it happen with some people that I really enjoy working with and I wanna have fun doing it and this, this, this has all felt very natural on that, on that sense.So it was never a like join versus versus versus found. It was just dis found me at the right moment.Alessio: Well I think theres an argument for, you should have joined Cursor, right? So Im curious like how you evaluate it. Okay, I should actually go raise money and make this a company versus like, this is like a company that is like growing like crazy.Its like an interesting technical problem. I should just build it within Cursor and then they dont have to encrypt all this stuff. They dont have to obfuscate things. Like was that on your mind at all orSimon Hrup Eskildsen: before taking the, the small check from Lockie, I did have like a hard like look at myself in the mirror of like, okay, do I really want to do this?And because if I take the money, I really have to do it right. And so the way I almost think about its like you kind of need to ha like you kind of need to be like fucked up enough to want to go all the way. And that was the conversation where I was like, okay, this is gonna be part of my lifes journey to build this company and do it in the best way that I possibly cant.Because if I ask people to join me, ask people to get on the cap table, then I have an ultimate responsibility to give it everything. And I dont, I think some people, it doesnt occur to me that everyone takes it that seriously. And maybe I take it too seriously, I dont know. But that was like a very intentional moment.And so then it was very clear like, okay, Im gonna do this and Im gonna give it everything.Alessio: A lot of people dont take it this seriously. But,swyx: uh, lets talk about, you have this concept of the P 99 engineer. Uh, people are 10 x saying, everyones saying, you know, uh, maybe engineers are out of a job. I dont know.But you definitely see a P 99 engineer, and I just want you to talk about it.Simon Hrup Eskildsen: Yeah, so the P 99 engineer was just a term that we started using internally to talk about candidates and talk about how we wanted to build the company. And you know, like everyone else is, like we want a talent dense company.And I think thats almost become trite at this point. What I credit the cursor founders a lot with is that they just arrived there from first principles of like, we just need a talent dense, um, talent dense team. And I think Ive seen some teams that werent talent dense and like seemed a counterfactual run, which if youve run in been in a large company, you will just see that like its just logically will happen at a large company.Um, and so that was super important to me and Justine and its very difficult to maintain. And so we just needed, we needed wording for it. And so I have a document called Traits of the P 99 Engineer, and its a bullet point list. And I look at that list after every single interview that I do, and in every single recap that we do and every recap we end with.End with, um, some version of Im gonna reject this candidate completely regardless of what the discourse was, because I wanna see people fight for this person because the default should not be, were gonna hire this person. The default should be, were definitely not hiring this person. And you know, if everyone was like, ah, maybe throw a punch, then this is not the right.swyx: Do, do you operate, like if theres one cha there must have at least one champion whos like, yes, I will put my career on, on, on the line for this. You know,Simon Hrup Eskildsen: I think career on the line,swyx: maybe a chair, butSimon Hrup Eskildsen: yeah. You know, like, um, I would say so someone needs to like, have both fists up and be like, Id fight.Right? Yeah. Yeah. And if one person said, then, okay, lets do it. Right?swyx: Yeah.Simon Hrup Eskildsen: Um. It doesnt have to be absolutely everyone. Right? And like the interviews are always the sign that youre checking for different attributes. And if someone is like knocking it outta the park in every single attribute, thats, thats fairly rare.Um, but thats really important. And so the traits of the P 99 engineer, theres lots of them. Theres also the traits of the p like triple nine engineer and the quadruple nine engineer. This is like, its a long list.swyx: Okay.Simon Hrup Eskildsen: Um, Ill give you some samples, right. Of what we, what we look for. I think that the P 99 engineer has some history of having bent, like their trajectory or something to their will.Right? Some moment where it was just, they just, you know, made the computer do what it needed to do. Theres something like that, and it will, it will occur to have them at some point in their career. And, uh. Hopefully multiple times. Right.swyx: Gimme an example of one of your engineers that like,Simon Hrup Eskildsen: Ill give an eng.Uh, so we, we, we launched this thing called A and NV three. Um, we could, were also, were working on V four and V five right now, but a and NV three can search a hundred billion vectors with a P 50 of around 40 milliseconds and a p 99 of 200 milliseconds. Um, maybe other people have done this, Im sure Google and others have done this, but, uh, we havent seen anyone, um, at least not in like a public consumable SaaS that can do this.And that was an engineer, the chief architect of Turbo Puffer, Nathan, um, who more or less just bent this, the software was not capable of this and he just made it capable for a very particular workload in like a, you know, six to eight week period with the help of a lot of the team. Right. Its been, been, theres numerous of examples of that, like at, at turbo puff, but thats like really bending the software and X 86 to your will.It was incredible to watch. Um. You wanna see some moments like that?swyx: Isnt that triple nine?Simon Hrup Eskildsen: Um, I think Nathan, whats calledAlessio: group nine, that was only nine. I feel like this is too high forSimon Hrup Eskildsen: Nathan. Nathan is, uh, Nathan is like, yeah, theres a lot of nines. Okay. After that p So I think thats one trait. I think another trait is that, uh, the P 99 spends a lot of time looking at maps.Generally its their preferred ux. They just love looking at maps. You ever seen someone who just like, sits on their phone and just like, scrolls around on a map? Or did you not look at maps A lot? You guys dont look atswyx: maps? I guess Im not feeling there. I dont know, butSimon Hrup Eskildsen: you just dis What about trains?Do you like trains?swyx: Uh, I mean they, not enough. Okay. This is just like weapon nice. Autism is what I call it. Like, like,Simon Hrup Eskildsen: um, I love looking at maps, like, its like my preferred UX and just like I, you know, I likeswyx: lotsAlessio: of, of like random places, soswyx: like,youswyx: know.Alessio: Yes. Okay. There you go. So instead of like random places, like how do you explore the maps?Simon Hrup Eskildsen: No, its, its just a joke.swyx: Its autism laugh. Its like you are just obsessed by something and you like studying a thing.Simon Hrup Eskildsen: The origin of this was that at some point I read an interview with some IOI gold medalistswyx: Uhhuh,Simon Hrup Eskildsen: and its like, what do you do in your spare time? I was just like, I like looking at maps.I was like, I feel so seen. Like, I just like love, like swirling out. I was like, oh, Canada is so big. Wheres Baffin Island? I dont know. I love it. Yeah. Um, anyway, so the traits of P 99, P 99 is obsessive, right? Like, theres just like, youll, youll find traits of that we do an interview at, at, at, at turbo puffer or like multiple interviews that just try to screen for some of these things.Um, so. Theres lots of others, but these are the kinds of traits that we look for.swyx: Ill tell you, uh, some people listen for like some of my dere stuff. Uh, I do think about derel as maps. Um, you draw a map for people, uh, maps show you the, uh, what is commonly agreed to be the geographical features of what a boundary is.And it shows also shows you what is not doing. And I, I think a lot of like developer tools, companies try to tell you they can do everything, but like, lets, lets be real. Like you, your, your three landmarks are here, everyone comes here, then here, then here, and you draw a map and, and then you draw a journey through the map.And like that. To me, thats what developer relations looks like. So I do think about things that way.Simon Hrup Eskildsen: I think the P 99 thinks in offs, right? The P 99 is very clear about, you know, hey, turbo puffer, you cant run a high transaction workload on turbo puffer, right? Its like the right latency is a hundred milliseconds.Thats a clear trade off. I think the P 99 is very good at articulating the trade offs in every decision. Um. Which is exactly what the map is in your case, right?swyx: Uh, yeah, yeah. My, my, my world. My world.Alessio: How, how do you reconcile some of these things when youre saying you bend the will the computer versus like the tradeoffs?You know, I think sometimes its like, well, these are the tradeoffs, but the three nines, its like, actually its not a real trade off because we can make something that nobody has ever made before and actually make it work.Simon Hrup Eskildsen: The way I think about the bending trajectory to your will is, um, if you sit down and do the napkin math, right, where youre just like, okay, like if I have a hundred machines, they have this many terabytes of disc, they have this bandwidth, whatever, right?And you sit down and you just do the like high school napkin math on this is how many qps we should be able to drive to it. Similar to how I did the vibe pricing, right? If you can sit down and do that, and then you observe the real system and you see, oh, were off by like 10 x bendings trajectory to your will is like just making the software get closer and closer to that first principle line.The P 99 might even be able to cross the line Right. By finding even more optimizations than, than, than from first principle. So bending the software to your rail is about that, right? Like a hundred millisecond P 99 to um, to S3. I mean now youre talking like someone really high agency that like goes to Seattle finds CS three team and its like, how are we gonna make this 10?You know, like its that, thats not quite what we talk about. Right. But yeah.swyx: Whats the future? Turbo Puffer.Simon Hrup Eskildsen: Turbo Puffer started out act one of Turbo Puffer was vector search. That was all we did to begin with Act two of Turbo Puffer is. Is and was full text Search Turbo Puffer today has a fairly start of the state-of-the-art full text search engine.Um, we beat Lucine on some queries, in particular very long queries that weve optimized for because those are the text search queries we see today. Theyre generated by LLMs or augmented by LLMs. Um, and we see them on Webscale datasets, right? Like someone searching for a very long texturing on all of Common Crawl.We beat Lucine on some of those benchmarks and we expect to continue to beat Lucine on more and more queries. Um, thats the performance and scale. Turbo Puffer does phenomenally now at full text search performance at scale. What we work on now is more and more features for full tech search. People expect a lot of features with full tech search.And full tech search is still very valuable, right? If you go in and you press Command K and you search for si. Embedding based search might be like, oh, this is something agreeable. cause that seat thats yes, in Spanish, right,Alessio: an Italian too,Simon Hrup Eskildsen: but in full night search. Thats the prefix of maybe a document of like, you know, these are all the reasons I hate Simon, right?Like this, this is like, thats a completely different. So that augmentation to like how the human brain works and mapping like data to user is very important, but its a lot of features. That feature grind is what were firmly on and you will see us just adding to the change log every month, just more and more full tech search features.Um, so were like fully compatible and we see were seeing people move from some of the traditional search engine onto Turbo Puffer, um, for that. Thats a big focus of Turbo Puffer this year. The other, the other focus of, of Turbo Puffer this year is just on scale. Were seeing more and more companies that wanna search basically common crawl level types of data sets.Um, both internally a companies and externally at, at a time like Cory, like a hundred billion vectors or a hundred billion documents at once. This is tricky and we wanna make it cheaper and we wanna make it faster. Um, thats a big focus for Turbo Puffer this year. Thats, you know, we just released a NNV three, which we talked about before.We are working on A-N-N-V-V four and were also have planned when were gonna do with a and NV five. Right. And then on full Tech search, were working on a lot of these features. Well be like FTSV three, but it will all roll out incrementally. Um, those are some of the really big features. And then the other thing is, um, our dashboard.Have any of you ever locked into the Turbo Hover dashboard? Its not very much there. It almost looks like if, um, a founder two years ago just sat down and wrote enough dashboard that there was at least something there, and then other people just sort of added stuff on for the next two, like the, the following two years, and then at some point SSO and other things to just catch up.And it may or may not be have what happened, but adding like, I want PHP my admin back. Like, do you, do you guys remember? Like, it was, it was so good. Right? And I think that that like software hardware integration between the, the, the dashboard of the console of the database and the database itself. Um, Im, Im really excited for that.Theres lots of other things, um, that are gonna come out in the next two. Like we talked a bit about some, some pricing and, and things like that, but those would be some of the big hitters. Right Nowswyx: you talk about eras of like turbo profile. I, I just, I have to ask like, yes, theres the stuff that youre working on this year, but like Im sure in your mind you already have the next phase that youre already thinking aboutSimon Hrup Eskildsen: Act three.swyx: Yes. Act four. Yeah.Simon Hrup Eskildsen: Act five.swyx: What I say about that, the candidates, you dont have to decide. Yeah, but you know,Simon Hrup Eskildsen: I, Ill just say that if you wanna build a big database company, the database over time has to implement more or less every quarry plan. Because when you have your data in a database, you expect it to over time, not just search, but also, Hey, I want to aggregate this column, I want to join this data, all of that.But when youre a startup, your only moat is really just focus. You have to lay out the vaccine and you have to not get overeager. And I think weve seen some of our peers get very overeager and overextend themselves. And what I keep telling the team, I was just having breakfast this morning with our CTO and and chief architect, we were talking about like what were most likely to regret at the end of the year is having tried to do too much.Um, and so Act three candidates could be, you know, a bunch of simpler ola queries, right? It could be, um, lending ourselves a little bit more into, we see some people who wanna do traces and logging and things like that. Some very simple use cases. Could be that, right? It could be maybe some time series.Some people are trying to do that, right? Like, theres lots of different things that you can do with turbo puffer, but for now, the, like, if youre trying, trying to do not search on turbo puffers, the primary use case, you probably shouldnt, but we see some customers that are like, oh, um, like at some point Cursor moved like 20 terabytes of Postgres data into Turbo Puffer because its like, its di its there, it works.And these particular query plants we know work well. And so they just moved it all to defer sharding. Um, so we look for patterns like that in what future acts of turban puffer are going to be before firmly doubling down on them. But we wouldnt, if. Today, if youre using Turbo Puffer, it should be because search is very important to you.And then we might do a lot of accelerated queries to that, but that should not be the main reason to go to Turbo Puffer at this point in time.swyx: Yeah. Uh, you didnt mention, uh, one thing I was looking for was graph type queries, like graph, database, graph, uh, queries. Can you basically trivially replicate this with what you already have?Simon Hrup Eskildsen: We see some people doingswyx: that, right? Because you have parallel queries and its Its the same thing.Simon Hrup Eskildsen: Exactly. So we see some people doing that, right? Like at the under, like is just a kv, right? And then we expose things on top of it. So we are seeing people do that. And I think, you know, our roadmap is very much just the database that connects AI to a very large amount of data is what the path is to do that in the right order, which is what a good startup is around what is the order to do things in.Our customers are P 99, and they will tell us what they care most about next. And so some of them are doing graphs now, and if they need more graph database features, theyll be banking our door and well prioritize accordingly.swyx: Tea. Okay. Give us the tea. Uh, this, you, you, uh, you kindly gifted us your favorite tea.This is Yabu Keita Kacha, uh, from the Green Tea Shop. Thats right. Talk about your love of tea.Simon Hrup Eskildsen: Yeah, we, we were just talking beforehand about, um, um, um. Caffeine, I think, um, and, uh, especially when Im on a trip like this to San Francisco, I consume a lot of caffeine. Um, but this is my preferred, uh, preferred caffeine.Its this green tea. I have an Airtable with 200 teas that Ive tried over time, over the past, like 15 years, and this one is my favorite. Now, when you drink a tea, um, theres different, theres like six different types of tea. I like green tea in particular. I generally prefer Chinese green tea. And I dont really like Japanese green tea, but this little prefecture somewhere in Japan has specialized in like, theyre like Japanese, but doing it the Chinese way and its just phenomenal.But then the interesting thing about the tea world is that all of the different, um, like you can find this particular tea, theres probably, you know, hundreds of. Places that sell it, but they all go to a different family right on whatever mountain that they have. These like chameleon, ensis, bush bushes on and this woman, Japanese woman in Toronto from the Green tea shop, um, I dont know, shes just like, I has found a really good family.cause thats the best one. The best time of years to get this is in a few months when they do the spring harvest. Uh, now its like kind of old. Um, its just like, I love the spring for the fresh tea, so I hope you enjoy it. But its not the right time of year.swyx: Its out of season. Yeah. I, I, I actually didnt even know Tea has seasons.This is unsophisticated, but I, I think it, like, it ties in with like, you know, loving maps and being obsessed and being keen on united in everything that you do. Um, yeah. But. Thats great.Alessio: Awesome. Well, as we were saying, we have instant hot water at Kernel. So, uh, MET lover can come by any,Simon Hrup Eskildsen: I I have a little ticket where I bring a, uh, where I bring like a little thermometer to like a little thermoworks thermometer.Um, last Friday when we do demos, I have this thing where if theres not enough demos, then I fill the remaining time talking about something completely ridiculous as an incentive for people to actually demo. And last night in time, I spent 20 minutes do, walking through my air table and going through my entire tea travel kit, including the, the, the temperature monitor.cause like Yeah, youll show up. Theres only a boiler. You cant get it to the right. Yeah. You know, you need this at 80 degrees, but anyway. Yeah, sorry.Alessio: Yeah, we have a, we have electric kettle with the temperature thing at home.swyx: I would watch this. You should start a company, YouTube, but it doesnt have anything about search.It just has and like other brands,Simon Hrup Eskildsen: I dont think I could talk, but something that I started doing. Do you, um, do you two know Sam Lambert of, of course, planet Scale? Ofswyx: course.Simon Hrup Eskildsen: Um,swyx: very outspoken guy.Simon Hrup Eskildsen: I love the guy and we just, um, we just last, like last week we just went on X live and just sat and like shut the shit for like an hour and I think well probably do that again.Yes. Well probably come up there. Well, I dont know what well call it. Maybe P 99 live or the P 99 pod or something like that.swyx: Um, P pod.Simon Hrup Eskildsen: P pod.swyx: Uh, cool. Well thank you so much for your time. I know you have to go, uh, but this is a, a blast and youre clearly very passionate and charismatic, so, uh, I I bet youll get some, uh, P nine nine engineers outta this podcast.Yeah.Simon Hrup Eskildsen: Thank you so much for having me. It was a pleasure.

The design process is dead. Here’s what’s replacing it. | Jenny Wen (head of design at Claude)

Lenny Rachitsky · explanation · 65% similar

AI is critical for humanity’s survival: Cisco president on the AI revolution | Jeetu Patel

Lenny Rachitsky · explanation · 63% similar

Head of Claude Code: What happens after coding is solved | Boris Cherny

Lenny Rachitsky · explanation · 63% similar