---
title: '3 AI Agent Browser Automation Challenges That Keep Getting Harder'
source: 'https://youtube.com/watch?v=rodYMnGntdI'
video_id: 'rodYMnGntdI'
date: 2026-07-28
duration_sec: 1007
---

# 3 AI Agent Browser Automation Challenges That Keep Getting Harder

> Source: [3 AI Agent Browser Automation Challenges That Keep Getting Harder](https://youtube.com/watch?v=rodYMnGntdI)

## Summary

The video tests an AI browser automation agent (Cloud Code) on three progressively difficult AWS console challenges: creating an S3 static website, launching a Linux VM with remote desktop, and building a video upload web app. The agent successfully completes all three, though it occasionally cheats by using Cloud Shell.

### Key Points

- **Challenge Introduction** [00:01] — The creator proposes three levels of AWS console challenges for their AI browser agent: S3 static site (easy), Linux VM (medium), and video upload web app (hard).
- **Level 1: S3 Static Website** [01:53] — The agent creates an S3 bucket, uploads an image and index.html, enables static hosting, and makes the bucket public. It takes 40 minutes due to trial and error, but eventually succeeds.
- **Level 2: Linux VM with Remote Desktop** [06:47] — The agent launches a free Linux VM, sets up graphical remote desktop, and attempts to play a YouTube video. It partially succeeds but has connectivity issues; the creator still passes it.
- **Level 3: Video Upload Web App** [10:47] — The agent builds and publishes a web app using Cloud Shell that allows video upload and playback. It works, but the creator notes the agent cheated by using CLI instead of pure browser automation.
- **Results and Conclusion** [14:38] — The agent passes all three challenges. The creator is impressed but acknowledges that levels 2 and 3 involved some cheating. The video demonstrates the power of AI agents when given proper tools.

### Conclusion

The AI browser agent successfully navigated AWS's complex UI to complete three increasingly difficult tasks, showcasing its adaptability and problem-solving capabilities even when facing unforeseen challenges.

## Transcript

interesting challenge. I wanted to figure out some kind of challenge for our browser automation using our Cloud Code Agent. So, I thought what is the most difficult UI I kind of know to navigate. And the first thing I thought
of was of course AWS. If you have seen their UI, it's very complicated if you're not very Yeah, well-established in their console system. So, I kind of came up with three different challenges. I want to see if our AI AI browser agent
can solve. So, you can see we have level one here. The challenge is to create an S3 bucket, upload an image, launch a static web page that displays the image and some kind of text here. Uh [snorts] on level two, we have launch a Linux uh
VM, make it accessible with a graphical remote desktop, get it online, and use its browser to open a YouTube video about Cloud Code. I don't know if that's possible, but we'll see. Our level three is uh build and publish a small web app
Uh and the app then displays a public page where the uploaded video can be played back. So, basically like a small uh YouTube, right? So, these are the three challenges. So, what we're going to do now is head over to the Mac Mini.
I'm going to set everything up. I have a created like an AWS account. And from there, we're just going to see if it can deal with all of these three levels of challenge. So, yeah, let's just head over to the Mac Mini. So, if you haven't
seen any of my previous browser automation videos, I'm going to try to explain quickly what we are actually using. So, we are running Cloud Code that has this Chrome automation CLI setup uh that gives it the opportunity
for any kind of AI coding agent to control Chrome, open pages, navigate with uh Chrome developer protocol. So, that is what we are using and you'll kind of see it in action as we go on here.
So, basically, now we're just going to clear up this because this is the browser we're going to use. So, I guess we can just go to AWS here. Uh let's see if we're signed into the console. Yeah, you can see this. I did some tests here
and it seems to be working. So, that's pretty good. So, we are logged in. That's good to see. So, if you go back to Cursor now, you can see here is our challenges using only the ABS console in the browser. This is going to be level
one, right? So, we're going to try to give it this challenge first. So, I'm just going to open up like a new fresh Cloud Code instant here that is in our Cloud Code instant here that is in our browser automated setup.
Uh let's just paste in the the challenge here. And I'm just going to say uh you should be logged in on console when you navigate there. So, I just closed down it. So, let's just start this now. And I'm going to use
kind of the evolutional principle here that is just going to keep trying. this. So, I want to see now if it's just going So, I want to see now if it's just going to open up the AWS console first and see
Yeah, you can see it went straight to S3. That's pretty good. So, I kind of want to follow along here for a while, but if it's going to take down the camera and do some screen recording. But uh you can see it's
already on the S3 page here. That's pretty good. And you can see we have the create bucket here. Yeah, it's navigating to that pretty easy so far. Uh now it's going to probably have to do
like a bucket name here, I guess. Uh yeah, let me type in the bucket name first and that's going to be Maybe I can zoom in a bit here. Let's see. Yeah, that's a bit better. So, we can see we have the bucket name
here. So, it's probably going to figure out the way to just use the Chrome setup we have uh to actually just put in like a name here. put in like a name here. Okay, so it put in EJ Oslo site 2026. It
just keeps scrolling down now. Maybe it's looking for the create bucket, I guess. Yeah, it scrolled all the way down and now it probably just have to down and now it probably just have to click on create bucket. Yeah.
And that's it. Let me move this thing here. So, you can see we created the bucket. Here we have it. Perfect. So, I want to see now if he kind of moves on to the next part and that is going to be to upload Yeah, we are on the upload
part now. So, here is going to be upload. And we gave it that me.png image. Okay, so you can see it put in me.png and Oslo index.html. That's looking pretty good. It added a
new file index.html. Okay. But now it removed the image, too. Yeah, it said it removed the image, too. So, now it wants to add the image back. Okay. Yeah, that was done. Yeah, it's doing a screenshot to confirm and
upload. Okay. So, you can see now we have our two We have the image file and index.html. Now goes to the properties and we want to set some static website hosting, I guess.
Okay, so it says it found the static website edit button. Clicked it. Okay. And now it needs to select probably enable website hosting. select probably enable website hosting. Yes. So, it's going to type index.html
in this document here, I think. And it's saved. saved. Did we get like a URL for this? I think it's looking at actually doing some public access settings. See it now.
Because we didn't do that. Yeah, it found it. So, it uncheck block public access and probably just has to save this now. And here we have like a confirmation. So, now it needs to type in confirm.
Okay, so now you can see this is off. So, that's pretty good. So, then we can kind of move on, I guess. Okay, so this was pretty interesting. It having some issues editing the bucket policy. So, now it's going to try to install ABS
Cloud Shell uh to try to do it that way. So, I think instead of just bashing your head at the same thing, try something else. And I have a video coming up on that. I think that's going to be pretty interesting.
let's see what commands it's going to put in here now. This is a bit cheating, going to do the CLI command here. Yeah, Okay, so it looks pretty happy with the command it used in Cloud Shell. And
yeah, that looks pretty good to be honest. And if we go to this here now, yeah, we got it. I guess it's not secure, but me in Oslo, we have the page and the image. So,
yeah, very happy about this. I would say it passed this. It spent some time, though. It spent 40 minutes. So, that was not optimal, but we're going to do one thing now. So, I'm going to say good job
time and learnings. So, next time you are on W AWS, you will save time navigating. So, this is kind of how we train our browser agent to be more effective the next time you're going to use it, right?
So, I'm just going to create this skill and then we're going to move on to challenge number two. Okay, so now that we have created our skill kind of to navigate, right? I think we're just going to clear the window, the context,
and we're going to start with read. I guess we can just to be sure just do a full restart here and let's just read the AWS skill here first.
And then we're going to give the second challenge. So, I'm going to write up that. And I can we end up You did pass the challenge level one. Now here is challenge two. I would put in like create the AWS console, free Linux VM,
Good luck completing a challenge. So, basically, it's going to try to launch a free Linux virtual machine, get some graphical remote desktop, get it online, and use the browser to play a YouTube video. I don't know if this is
um a chance. Okay. So, I'm going to kick this off. Uh but this time I'm not going to stay here and long-running uh task, right? So, I'm just going to
turn off the camera. I'm going to keep recording and I'm just going to play you back and then we're going to look at kind of how it solved this uh or what the results we ended up with, right? So, like I said, uh let's see if it fires up
the browser here. Yeah, we go straight to launch an instance. Okay. So, I'm and I'm going to just record on the Mac Mini. And let's see what we end up with at the end here.
Okay, so you can see now we have actually launched the the VM. Okay, so some credentials here we need to enter, so like a password. I'm not quite sure if it can do that. If not, I'm going to probably do it manually.
Okay, I think we are in. So, you can see now we have launched the Ubuntu um instance here. So, that's pretty cool. So, I don't think we are online, though. But let's see how it's going to navigate this now. You can clearly see we have
the Ubuntu VM up here. Okay, so it says it wants to use the Okay, so it says it wants to use the Cloud Shell to launch Firefox. Okay. Yeah, it wants to launch with Cloud Code plus Anthropic
on Firefox. Okay, so you can see it's going to a YouTube video, but it doesn't look like there's any connection here. So, it doesn't work, I think we're just going to call it there, but because I'm
super happy anyway how it turned out. I guess we only had like a small issue at the end here. There might be some even maybe even Okay, we are loading. So, that is pretty cool. That is pretty crazy. I wasn't really expecting us to
actually be able to do this just by using the browser automation. I guess that's your shows how powerful this has become now. So, let's give it a few minutes and see if this loads, but uh I don't think it's going to do. It doesn't
say if it has enough memory for this. No, it doesn't look like anything is pass because we did actually create the instance, we launched the VM, we set everything up, and we actually went to the VM in like a virtual non-headless
mode, and we did put in like a YouTube address, and it did render, but not 100%, but yeah, I got to give this a pass. Now, let's do the final level three challenge. Okay, so now of course we're just going to do you did pass
for level three. Uh and it's going to be using only the ABS console in browser, build and publish small web app where the user can upload a video, and it displays a public page where that uploaded video can be
um I'm just going to say uh yeah, we repeat challenge. Use the ABS skill to navigate. Um as previous, that is all
I'm going to do. I'm going to remove the old things here. First, clean this up. camera, and I'm just going to let this run, and I'm going to back if we are looking that we are actually going to complete this.
cheated a bit here because it only went to the cloud shell, even though I told it to only use the browser automation or use the browser. So, I went and did something else, and I came back, and I see it's just in the cloud shell. But,
I'm going to give it a pass, and I think it's actually closing in on the end here now, and I had a quick look at what it has done so far, and it's been super fast. I think it spent like three, four minutes so far actually
So, I'm going to see how close we are now. Uh we're going to do some HTML and stuff now for the front end. And from there now, I think we are pretty close actually to actually launching the app, and we can actually test it out. You can
see we did the HTML now with the CSS. And we can actually test it out, upload a file, and the user can actually Yeah, we're uploading the index now, and the user can play it back. So, it's
actually works. Okay, so here you can see see this is the app. So, we share, upload a video, get a public playback page. Do I have any videos here?
I might do that. So, let me find a video and try to upload it. Yeah, I have like an old introduction video here to my AI agent I tested for a long time ago. So, let me just drag this in here. Okay, so it failed to fetch. That's
interesting. Let's see if we can actually log this. Send log. So, it did install a log here. That's pretty good. let's try now. So, let's do the same video, and
hopefully Okay, so it's uploading. And here we have it. So, that's pretty cool. We get a direct link. So, what I'm going to do now is I'm going to head over to this PC here or
this MacBook here, and I'm actually going to go to that link and see if we can play it. Okay, so here is the link, right? So, let me copy this, and let's right? So, let me copy this, and let's see now if not there if we actually can
see the video. Yeah, it is loading. Can we play it? Hi guys. Hope you are doing Yeah, and let's see if we can upload. So, now I want to do a bit Let's do a 200 megabyte file here.
Okay. And yeah, it is uploading. That's pretty So, I'm going to switch back now to the other to the Mac mini and see if the
video pops up there. Okay, so let's just refresh this. Does it play? I try to smile. [music] I was I try to smile. [music] I was suffocating though, but here we Yeah,
that works. So, [snorts] now we kind of have our kind of shared video platform have our kind of shared video platform where users can upload videos. So, yeah, uh I think it actually did cheat a bit. Uh because it kind of only leveraged
running the the cloud pass because I didn't wasn't here to watch it, so I didn't really pick up on it. But, other than that, how easy was that?
I created this video upload platform that is kind of online that is kind of online in like five, 10 minutes. Just by using Cloud Code and the agent. We didn't really get to test the browser
part here, but other than that, I was super happy. So, I would definitely, if we go back to the challenges, the first one was of course slow because we actually used the console for everything. Uh I think. Uh
and the two other one was a bit cheating because we used the cloud Uh we didn't use the cloud shell in the beginning of level two, but in level three we only used it. So, uh but overall, I think this just kind
of shows how powerful these agents are getting now, and especially Cloud Code and these Codex CLIs, how many things they can do if you only have the tools available. So, I'm going to do a video soon about some kind of theory I
have. It has something to do with like evolution, and yeah, some kind of fun theory I have about how these systems are kind of evolving. So, that's going to be later. So, I hope you enjoyed this kind of this three-part challenge. And
again, I think it's passed pretty flawlessly, like I said. So, if you like content like this, and you want to try see more of this, just give this video a like. Uh also, if you want to
skills Let me see. skillsmd.store. If you want to get kind of the setup I have, you can just go to info and read here if this is something you think you need. So, I do have a few videos on this in my back catalog if you want to watch
it. So, yeah. Thank you for tuning in. Hope you found it interesting, and I'll Hope you found it interesting, and I'll see you again soon.