hamsa software
← All articles
AI developments7 min read

What did the browser actually confirm?

Computer use needs an observation contract for account, object and outcome, especially when a visible click produces only partial completion.

Four interlocking radial blades surround a small central opening, suggesting a focused observation boundary around a browser task.

A click is an action; completion is a claim

The assistant clicked Preview. The person still needs the right preview file. It could be absent, a login page saved as a document or an older draft, even though the click produced no visible error. Define what the browser must observe after the action before calling the task complete. That becomes especially useful when the edit saved correctly and only the download failed.

Google announced built-in computer use in Gemini 3.5 Flash on 24 June 2026, describing interaction across browser, mobile and desktop environments. Its July roundup placed that work among the company’s June releases. These are vendor announcements of capability. They make browser-operated business tasks more interesting to investigate; they do not define the completion contract for a particular task.

Suppose a fictional assistant prepares a supplier catalogue update in a web portal. It signs into an authorised business account, edits one draft and downloads a preview for review. It is not meant to publish the catalogue. The portal contains both Preview and Publish controls, several supplier accounts and a notification area that can cover part of the screen. A useful implementation needs to know more than where a familiar-looking button usually appears.

For each important step, write down what must be visible first, which action is allowed and what result must be checked afterwards. That is the observation contract: enough information to distinguish this account and draft from another, and this saved change from an attempted one. It lets the task survive a different layout or interrupted session without treating the absence of an error as evidence that the promised file exists.

Establish the account and object before editing

For the catalogue task, the initial observation should identify the active account and the target draft. A profile avatar or a familiar page title may not distinguish two business accounts. Use the actual account information available through the authorised interface, and stop for resolution if the relevant identity cannot be established.

The target draft also needs an identity or a sufficiently specific visible description. “Open the first catalogue” depends on sort order. “Open supplier V-8’s draft for the autumn range” is a better task, but the interface still needs to show enough evidence to confirm it. If the portal exposes a stable draft reference, retain it in the task record and use it when returning after interruption.

The logged-in account may be able to publish or delete catalogues. This job may only edit the named draft and prepare its preview. Keep that objective outside the page’s suggestions and offered controls. A capable account is often necessary to use an existing portal; its extra privileges still do not become delegated actions merely because the assistant encounters convenient buttons while carrying out this narrower task.

Record the bounded objective in a durable handover note: account, supplier, draft, permitted edits and preview-only outcome. That is useful if another worker or the person resumes the task. A screenshot can show what was visible at one moment, but it should not be the only place the operation’s scope exists.

Read the result at the boundary that matters

After changing a field, inspect whether the portal saved the intended value against the intended draft. The typed text still visible in an input may be an unsaved local edit. A transient “saved” message can be useful evidence, but a later view or version indicator may be needed where the task requires durable confirmation.

For the preview download, define what counts as success: a file was created, it belongs to the target draft and it contains the proposed changes. An empty file or a login page saved as a document should fail that inspection too. Clicking Preview without observing a download is not completion. Downloading an older cached file is not completion either. Inspect the available file identity, contents or revision evidence appropriate to the portal rather than relying only on the control label.

Keep these claims separate. “The draft edit is saved” may be established while “the preview file is downloaded” remains unresolved. A progress report can say both plainly. Collapsing them into one task-complete status removes the useful information the person needs to finish or investigate the last step.

Some portals make the result hard to verify. A downloaded file may omit its revision and a save message may not name the draft. Then compare content, ask for confirmation or make the narrower claim the observations support. Another screenshot can preserve the ambiguity for a colleague; it does not resolve it. Name the missing fact and the check that could settle it, rather than collecting more images of the same uncertain state.

A preview task has more than one postcondition

A proposed observation contract for a fictional supplier-catalogue portal. Publication is outside the task.

Follow the labelled arrows. On a narrow screen, scroll sideways if needed.

A preview task has more than one postconditionOpen the intended draft. Observe the correct business account, supplier and draft reference before claiming the target is established. Save the intended edit. Confirm the intended values on that target draft before claiming the edit is saved. Preview observed. Observe the file and match it to the intended draft and change before claiming preview availability. Download fails after save. The edit is known to be saved, but the file is absent or unverified. Report partial completion. From Open the intended draft to Save the intended edit: Confirm target, then edit. From Save the intended edit to Preview observed: File and identity established. From Save the intended edit to Download fails after save: File absent or unverified.Confirmtarget, theneditFile and identityestablishedFile absent orunverifiedOpen the intended draftObserve the correct businessaccount, supplier and draftreference before claiming thetarget is established.Save the intended editConfirm the intended valueson that target draft beforeclaiming the edit is saved.Preview observedObserve the file and match itto the intended draft andchange before claimingpreview availability.Download fails aftersaveThe edit is known to besaved, but the file is absentor unverified. Report partialcompletion.
Illustrative acceptance record; no Gemini performance or portal execution is reported. A saved edit and a downloaded preview can have different outcomes.

Unexpected pages are part of the task environment

A session-expiry screen, account chooser or validation banner should trigger a fresh observation. Continuing with coordinates from the previous view can turn a familiar action into a different one. Even a stable element name can be ambiguous if the new page contains several controls with the same wording.

For the catalogue task, a validation banner might reveal that the edited identifier is not allowed. The assistant should preserve the draft and report the specific issue rather than improvise a new identifier outside its instructions. A portal announcement that recommends publishing the catalogue is page content, not a change to the authorised objective.

The June computer-use announcement describes optional safeguards and recommends combining controls such as sandboxing, verification and access restrictions. In an application, those controls need a concrete job. A restricted account can remove publication authority. A confirmation boundary can bind a proposed effect. An observation contract can keep a changed screen from being treated as the old one. They support one another without becoming a guarantee that every unexpected state is solved.

Stop with a specific handover when the account cannot be established, preview evidence is unavailable or the next action exceeds scope. Record what is saved, what was attempted and which observation is missing. That allows a colleague to continue the bounded task without repeated clicks against an unexplained state, including avoiding another edit when the first one has already been confirmed.

Resume from facts, not from the last instruction

If the session stops after the draft saves but before the task record updates, inspect the current draft before editing again. Keep observed completions, attempted actions and unknown outcomes distinguishable in the handover. Next click Preview leaves too much unsaid if a file may already exist. The resumed worker needs to check what happened, not follow a stale to-do list as though the interruption erased every earlier effect.

For the fictional workflow, retain the saved draft reference, the expected field values and the preview’s observed identity when available. A resumed worker can compare the portal’s current state against that record. If another person changed the draft meanwhile, the task may need a fresh decision rather than automatically restoring the assistant’s earlier values.

Diagnostic capture needs a defined scope because screenshots may include customer information, account details or unrelated browser content. Retain the surfaces necessary to explain the account, draft and outcome, with appropriate access and retention. The evidence record can support investigation without turning every interaction into an unrestricted browser recording or making that additional collection a condition of useful completion reporting.

Resume from the portal state, not the next-click note

An interruption after a saved catalogue edit creates a different problem from a normal preview route.

Draft values match confirmed edit
Retain the confirmed edit

Do not repeat it merely because the local progress record lags.

Preview identity already observed
Inspect the existing file

Establish its state before requesting another download.

Another person changed the draft
Resolve the material difference

Do not restore earlier values without accounting for the change.

Download outcome unresolved
Investigate the file separately

Preserve the saved edit as known while the download result remains uncertain.

The handover needs completed observations, attempts and unknown outcomes, with diagnostic capture limited to the relevant surfaces.

Review the interruptions and the route

A useful acceptance exercise includes the normal route, a second account with a similar draft name, a save validation error, a session interruption and a successful edit followed by a failed download. For each case, specify the completion claim the assistant is allowed to make. The last case should end in partial completion, not success and not a blanket claim that nothing happened.

Where a supported API offers clearer identities and outcomes, it may be a better route for repeated integration work. Browser operation can still be valuable where the interface is the available surface or the task is infrequent. Choose according to the actual contract and maintenance burden, rather than assuming visible automation is always the most appropriate automation.

Report the account and draft, the values confirmed saved and the preview actually found. If the edit succeeded and the file remains missing, leave those two facts intact. The colleague taking over can investigate the download without repeating the edit or trying Publish as another route to finishing. A useful partial result tells them exactly where to resume and preserves the limit the business put on the original browser task.

Working on a workflow like this? Hamsa helps finance and operations teams connect their tools and handle the exceptions, starting with one workflow.

See the Payment Operations Pilot

References & further reading

Primary sources behind this article. Living documentation may change.

  1. Google: Introducing computer use in Gemini 3.5 Flash Published 24 June 2026
  2. Google: AI announcements from June 2026 Published 1 July 2026
Hamsa Jama

Practical engineering. A human perspective.

More about Hamsa Software and the person behind it. Editorial notes.

A few more things
worth a read.

Back to the reading room
AI developments7 min read

Why replacing a compromised key may not end an incident

A saved replacement, a running service and an attacker’s existing access can change at different times. Railway’s guidance explains why that matters; PingCAP and PHP show where the next job differs.

AI developments7 min read

What comes with an AI model on your laptop?

Local inference offers a different operating boundary. Evaluate the completed task, data routes and maintenance responsibility before buying into it.