send the page code and screenshot to some best vllm , return the instruction step by step to skyvern to act in browsers to fill the goal you set,that is an good idea.
The solution works! And it’s resilient to changes to the website designs and tagging and process. I highly recommend it for operational tasks that involves moving through various webpages to collect a piece of information or make an action.