Screenshot sent after every action, and getting rate limited

[sheepdestroyer]

I ask the demo to search a button, click it and wait 60 seconds before doing that again.
However, the tool takes a screenshot, clicks the button than automatically sends another screenshot just after clicking.

This second screenshot is useless and I am getting rate limited for it :

You have been rate limited. Retry after 0:01:25 (HH:MM:SS). See our API [documentation](https://docs.anthropic.com/en/api/rate-limits) for more details.

Error code: 429 - {'type': 'error', 'error': {'type': 'rate_limit_error', 'message': 'This request would exceed your organization’s rate limit of 40,000 input tokens per minute.

I tried expressly asking the tool to only take once screenshot per cycle, only before clicking, to which it agreed.
But it then instantly disregarded this to send screenshots again, just after taking an action.

[sheepdestroyer]

Hello,

Even though I have now made changes to limit the input tokens I still get rate limited :

• I made sure that st.session_state.only_n_most_recent_images = 1
  so only the last screenshot is sent each time.

• I also modified the demo's code so no screenshot are taken :

1. after moving the mouse,
2. and after left-clicking

• I ask Claude to wait 65 seconds between each cycle :

1. take a screenshot and locate the button,
2. move the mouse,
3. click the button,
4. then wait 65 seconds before starting again

Effectively now, only one screenshot is sent per 65s cycle.
However, I still get rate limited after a few iterations.