0:03I'm Chris I work as a product manager in the web integrity and trust team and I look after adaptive intelligence we're part of the bot management team and today over the next 20 minutes the lightning talk we'll be talking a little bit about sophisticated and persistent attackers it's what we've built adaptive intelligence for and it's an important part of detection going forward. Within our team, we look to answer two questions. Are you who you say you are and can we trust you? And based on who we're looking at trying to detect right now, these questions are more important now than they ever have been.

0:49Our vision is to answer these questions across every single entity and as they... transfer through all of our customers applications and we believe if we can do this accurately enough then we can solve for most bot related cyber security incidents that we see today and certainly the ones that we might see going forward as well. So being good and improving on bot detection is certainly a core component of this but also so is trust. There are an increasing amount of individuals of starting to utilize automations to improve their day -to -day with their workflows and stuff like that. And whilst there's certainly a lot of malicious traffic that still resides underneath that automated umbrella, the landscape has become more nuanced.

1:36So our detection capability has to follow. As point of demonstration, can you just raise your hands right now if in your day -to -day at work, you are you. agents or assistants to get your job done. That's great and that's not a surprise and keep your hands up if you're building that capability for your customers to do the same on your applications. Right, because there's a lot of legitimate traffic that sits out there. From my perspective from a professional life, most of the automations for me are helping me plan my day. They'll be helping me with administration, improving my workflows helping me surface data points and get insights into that data as quickly as possible but there are other people who are also following this attackers they're improving their workflows they're improving their quality of data as well and it's really important that we strive to understand how we can attack and what defend against those sorts of attacks

2:45so there are two things that are converging at the same time that make the traditional way in which we were thinking about bot detection slightly more nuanced. It's probably going to, it's still somewhat relevant today, but will start to become more obsolete as we think about things tomorrow. The first thing is that the line between automation and human is almost entirely blurring, completely blurred in some instances. We see increase in the number of hybrid environments, so these are things like Chrome and the internet integrations that they have with Gemini Pro subscriptions or Claude. We see OpenAI with Chrome inside Codex. So across the spectrum, there is a lot more opportunity for automation.

3:31Personally, for me, I use it in my personal life as well. I love going on family holidays, but I absolutely hate booking them. It's just such a pain for me. It's multiple sites I have to look at, hundreds of different permutations of hotels. and flights, the prices all seem to change. It almost ruins that holiday experience before I've got my passport out the drawer. Now I can give Claude an understanding of what makes a good family holiday for me. I give it unrestricted access to my browser and go away, come back maybe an hour later and I have a curated list of great holiday ideas with live prices within budget and a rationale as to one. those would be good holidays for me. On the other side of this, we're also seeing an increase in the level of sophistication in attacks that we are observing across Cloudflare networks.

4:25There's two things that are kind of at play here. The individuals aren't necessarily getting more sophisticated themselves, but the time it takes them to get those attacks back underway is being shortened considerably by the use of LLMs. automations. Additionally, it's democratizing the barrier to entry. So a lot of the individuals who probably didn't have the engineering capability to put more sophisticated attacks in play, they're using automations now to really help them to level up their game and level up the attacks. So the point for us now isn't necessarily about just looking at automation. It's making that between well -intentioned good automation and the automation which is effectively an attack which is about to start or is already underway so these sophisticated attackers are incredibly intelligent they are well motivated sometimes economically motivated as well and when they start to get blocked on their attacks it's not their intention to stop it's their intention to understand a way to re-engineer this as quickly as possible and get back in the game.

5:42So they'll grab, maybe jump onto Discord, they'll start talking to a peer set about the fact something had gone wrong, they'll work through the night, and eventually we'll find a workaround to the defences that have been put into place. In some instances there are libraries of services, these individuals may even be contributing to those libraries of service. So economically benefiting from creating the workaround as quickly as possible and then getting it into the hands of people that rely on them.

6:15Traditionally, we have been as an industry and at Cloudflare using static version models for bot defense. And for more simplistic automations, this actually is still a particularly good strategy. But unfortunately, when you have people. who are highly motivated to try and get around your defenses every time we have to put a new detection in place effectively building up that defensive wall we're finding that people are getting around those those defenses far faster the best defense in the world when it is static cannot keep persistent attackers who are always probing and looking for weaknesses out indefinitely we might be able to buy some time But ultimately, this is not the right path when we're looking at sophisticated attackers.

7:08So our approach for this particular cohort is to acknowledge that the state has changed, understand specifically what has changed in that, and then build for that new state. And when you look at this through the lens of game theory, there's a name for it. asymmetric adversarial game it's asymmetric because the cost of making a move and a counter move is different between each side the defender and the attacker and the information that they have access to is also completely different it's adversarial because the outcome that each side is looking to achieve is in direct conflict with one another so to be successful here it's not about just playing the game the same way that you would for a more simplistic set of automations, building those defenses or the detections into that wall.

8:03It's more about attacking the incentives and in this case it's about how much it costs to make your move and your counter move. Right now the attacker unfortunately has that advantage. The asymmetry is running in their way for three key reasons. Firstly, information. Every time we put a new detection in place or a new block, that's an incredibly strong signal for them. Something that was working yesterday is now broken today, and they want to find a way to make that work tomorrow. When one or two things change, it is very, very easy for them to understand exactly what that was and reverse engineer the block to get their attack underway.

8:53Secondly, from a cost perspective, as I mentioned before, there are off -the -shelf toolkits. Reverse engineering for them has never really been quicker. And this is in terms of costs for engineering the solution itself, how to get around things. From our perspective, we have to be far more careful. So any counter moves that we make, we need to ensure that we're not breaking anything. They don't have that problem. Their idea is to actually break the thing so they can deploy far faster. faster. And on faster, there's also time. There's chances are that there is a group and somebody within that group has already fixed this problem or it's available in the library service. So effectively, these three things, when you take them together, mean that the attacker is spending far more time doing damage than they are trying to work out how to get around today's defenses.

9:51An attack is in one of two phases. It is either live and it's doing damage to applications and your customer databases or whatever it is that they're looking at targeting, or the attacker is adapting. They're trying to work out why the thing that was working yesterday isn't, and they're reverse engineering these defenses. Now, in game theory, the idea here isn't to win anything. single round of that back and forth. What we're actually trying to do is inject as much friction into this process as possible to slow things down. Two things need to be true to make that happen. First, the cost for us to defend needs to be incredibly cheap. So just flicking a switch would cost them weeks of adaptation.

10:37Second, we need to starve them of information because even the cheapest move on. our behalf is entirely worthless if we tell them specifically how to fix the thing that we just broke for them right now the ratio is working backwards it's not the way we want to see it for every day that a attacker is spending in adaptation mode they can have weeks and weeks of uh of the attack running live this is somewhat um as a demonstration as opposed to like hard numbers but what i want to show you here is that the ratio is on the wrong side. What we want instead is for every single day of attack, it takes them weeks of adaptation to sustain that attack.

11:26And there's a human on the other side of this as well. And they have human traits, frustration, boredom, ego. And we want to attack those things. So those adaptations have to be as painful as possible to make sure that they just want to give up. They may find that they get 80% of the way there. They can't quite work out how to continue the attack on the target they had on the Cloudflare network. Maybe there's a softer target elsewhere. We want to encourage them to move away from applications that are largely under our protection.

12:06So this meant that we went back to the drawing board. it's not thinking about how we can build better rules and build that wall just that little bit higher we went back and thought what if we were to build a system under the assumption that from day one a determined attacker is always going to make its way through this led us to kind of three key insights first the system needs to automatically notice when something goes wrong secondly it needs to be able to adapt to that new state and thirdly it needs to be able to react on its own that be that if it needs to monitor something and flag it or if it needs to do something to lower bot score into a more enforcement related zone. To do this there are five key things that we have and are in the process of delivering.

12:54First one is speed now this is about how quickly we can react to attacks that are live in the moment but it's not just about that static version models are incredibly expensive to research and to deploy which is why they only happen infrequently usually on an annual or a semi -annual basis the problem that we have here is that the efficacy is particularly high at launch but over time that starts to diminish as people start to work their way around the defenses we're effectively playing cat and mouse when we're putting the new detections in place. What we have with adaptive intelligence, which this is the first component that launched at the end of August, is the ability to react as quickly as we need to when a new attack pattern shows.

13:44That's either us retraining the model on new features, getting better in areas that we know that we haven't necessarily covered thoroughly enough yet, but it's also the ability for us. to make sure that we're not stuck on a specific schedule, we can react when attacks are at their highest or most prevalent.

14:12Secondly, we aim to close a lot of the structural gaps that we see today. There are kind of three areas that we cover with bot management. There's simplistic automations, there's kind of like a middle ground, and then... the more sophisticated side of things. Here this is really helping us close down that middle ground where there are some very obvious places where attacks are masking themselves right now and we know that there are things that we can do about that now that we can train faster. So for example this quarter we're going to be doubling down on trying to get much better at detecting within the residential proxy space. The areas where we know that some of these moderate attackers are actually masking themselves.

15:05Secondly, we're also looking at bridging the gap between the network signals and the client-side signals that we see. So it may be that a network signal managed to spoof us at some point, but when it gets into the browser-level signals, where we're looking at things like typing cadence, hence how a mouse mo- move how a browser gets um gets driven the information gets put in despite the fact there are some things which are relatively intelligent on this when you're looking across the whole session it's actually really really difficult to to spoof things like precursor so we're bringing those two things together to make sure that we're closing down those gaps where um where we can well sorry you said you're bringing two things together your brain precursor and what's the we are things like residential proxy detection so they've got the network stuff where um that there's a lot of like network kind of signals that we're looking there and then we're bringing precursor which is the more um browser related client side stuff so people like some of the ephemeral ideas of that okay it's not about ephemeral ideas that comes up in a minute but like yep um so yeah the question was um there were two things that i'd mentioned and i was just answering that it was the network stuff and the browser relate side of things right now they work or have been working independently from each other

16:30this is what we're calling silent signals effectively at the moment when we detect a particular an attack there'll be several signals that we can understand how that attack actually has unfolded we put those into labels and train the machine on them generally speaking though what we would do is find the strongest signals and then use those as blocks and largely kind of like leave the other signals alone and not keep and decide that they weren't strong enough to to enforce against what we're doing now though is splitting out the kind of areas where we would look to block an attack from where we can monitor this gives us the ability to effectively start to fingerprint attackers so when they get blocked then they go away and come back we can start to frustrate some of their adaptations far faster than if we were just starting from again.

17:18We're also starting to baseline what normal looks like. At Cloudflare we often talk about fingerprinting the signals against our network. Here what we're doing is understanding things like browser version, operating system, language, geographic location, etc. What that enables us to do is start to build patterns so we can understand. how many English-speaking users in Paraguay are on the latest version of Chrome, for example. Once that baseline is set in the system and adaptive intelligence understands what that looks like, when there are variances within those signals, adaptive intelligence can automatically signal that something is wrong and either flag it for a human review or go into some sort of enforcement action as well.

18:12So this is more about our ability to react faster without a human in the loop doing some level of triage first and lastly on the ephemeral rule side of things uh we call this disposable rules disposable detections is probably a better way of thinking about this um what we do here actually when i was saying there was a incredibly strong signal that we give to attackers when we start to block them what we want to do here is inject a lot of noise into the signal. So we raise lots of disposable detections into the mix, force the adaptations and then effectively just retire these and they'll never get used again. What we're looking at doing here is frustrating the attacker and making them waste their time.

19:00Everything up until disposable rules is stuff that we're looking at delivering within Q4, Q1 timeframe. Disposable rules what we want to make sure is that we've got really good guard rails in place so we don't end up causing more of like false positives or friction for our customers so from that perspective there's a little bit more time and r d that we're putting in place to make sure that these launch as frictionless as possible so drawing to a close key takeaways to this is that we're seeing sophisticated attacks on the rise and that's one of the main reasons why we had launched Adaptive Intelligence. Our aim here is to put best defense in place and combine that with frustrating the attacker's ability to adapt.

19:45We think this is the best way for us to win as opposed to the cat and mouse game that we play today. Adaptive Intelligence is rolling out. The first version of this has already launched on the 31st of August. There are going to be more frequent launches as we go through. Q4 and Q1. The models will update automatically as well to make sure that the coverage is as good as it can be. Not every customer has auto upgrade machine learning toggled on, vast majority do, but the ask for me is just look on the dashboard, make sure you work with your representatives and get yourself on our most up -to -date protections.

20:31Thank you very much.