suchintan

Depends on the scope of the changes. What did you have in mind?

We have an open issue for this right now -- we would LOVE some contributions here. The biggest problem until Llama 3.2 came out was that most (good) open source llms were text-only, and Skyvern needs …

Give it a try! It's very capable of doing simple tasks like logging in and clicking around. You'll need to prompt assertions like "Complete if..." and "Terminate if..."

Agreed. In the short term (X months) I expect the HTML Distillation + giving text to LLMs to win out.. but the long term (Y years) screenshot only + pixels will definitely be the more "scalable&q…

We've had a decent amount of luck with InternVL 2.0 w/ Llama, and are pretty excited about Llama 3.2 It's still super early in the open source x vision model space. The limiter actually…

Not yet! We haven't shared them publicly yet because our internal dataset is super biased. Keep your eyes peeled though! They'll be coming out in the next few weeks :)

Yes! We're helping a few companies with this right now. This use-case actually surprised me. I never realized how important it is to track invoices in Europe (where VAT needs to be closely tracke…

Nothing -- we use DataDog for our cloud telemetry and haven't built a great way to separate dependencies between cloud and open source

Great question -- I was waiting for someone to ask this! Their product and launch is super cool. It's incredible how much it's able to do by just relying on tool use + micro agents + screen …

It was a state level permit website I think. Very interesting!

I made a LinkedIn post about it yesterday, but the funniest has been our customer DoSing our service by accident (sending 10K tasks per hour for 24h straight) Toughest was Skyvern accidentally talking…

Yeah! We've seen this especially useful if you want to work in highly dynamic situations Ex: filling out contact forms on hundreds of websites? It's really tough for normal code to be able t…

Thank you for the star! We had someone talk about us the other day on r/localllama ( https://www.reddit.com/r/LocalLLaMA/comments/1g9zhbd/if_your... ) and I sti…

Interesting. We will fix it

The most fascinating part is how tough that work really is. Everyone we've talked to loathes the manual stuff, but until a better solution comes out, you have to allocate X% of your time to it

Great question. We haven't helped anyone with that exact use case yet, but we're in the middle of integrating with a company to help them automate purchasing flights with Alaska and Southwes…

We actually started off using the AutoGPT framework. There are a ton of remnants of that (tasks, steps) but we found the framework extremely limiting as we wanted to expand and do more complex things …

Yeah we've been surprised by how many interesting things companies do in the background to keep them running The craziest one we heard about was this government portal in India that was hard to a…

We're one of those players ( https://github.com/Skyvern-AI/skyvern ) and we're definitely watching the space with a lot of excitement We thought it was inevitable that Op…

Good question! A lot of CRMs have CloudFlare enabled with location based blocking by default, so we needed a way to spoof a local location to be able to interact with the website

Haha unfortunately we use residential proxies under the hood to simulate real users (as you'd expect from AI agents), where bandwidth is significantly more expensive!

Agreed. Just for reference, one of our most popular use-cases is automating data entry into CRMs without APIs... No one wants to be doing this stuff manually, and automating it has some serious positi…

https://techcrunch.com/2024/01/24/court-rules-in-favor-of-a-... This is another interesting example where it was allowed…

Yeah exactly. One action item from this is that we need to add anomaly detection to our proxy usage metrics so we can catch this in 15 minutes instead of 6 hours :)

Haha, apologies for the language! We use residential proxy networks when running Skyvern to help simulate real human behaviour (because that's what Skyvern is trying to do). We run headful browse…

This is a great callout. We had an internal discussion about how to manage dependencies effectively, and we made the decision accept the risk that comes with blindly relying on Chrome for now, instead…

We were pretty careful about what we were blocking here -- had the exact same concern. Hopefully it doesn't come back to bite us in the future (new blogpost incoming?)

It definitely could have been much worse. We burned through our monthly allocation in 6 hours HAHA, I'm grateful that our allocation wasn't something like 10TB

This is really cool! I'll check it out :)