Choose how to read

The full view retains the technical content, figures and sources. The plain-language explanation introduces the ideas without changing the findings.

Terms explained

Research & Climate AI

AI Agents for Caribbean Climate Research: Evidence and Validation

Adrian Dunkley | Published 14 April 2026 | Revised 11 November 2026

An automated workflow can retrieve weather records, run a model and compare its output with observations. Each operation needs a separate check. A working data pipeline does not establish forecast accuracy.

This article distinguishes published weather-model results from proposed uses of agents in Caribbean research. The current eight-paper collection reports the experiments completed on this site and identifies the work that remains proposed.

What the weather benchmark establishes

Lam and colleagues evaluated GraphCast against ECMWF's high-resolution deterministic forecasting system, HRES. GraphCast performed better on 90% of 1,380 verification targets in that study. These targets combine variables, atmospheric levels and forecast lead times. The result is not a 90% improvement in accuracy, and it is not a Caribbean hurricane-intensity validation. [1]

GraphCast is a forecasting model. An agent that starts a GraphCast run adds workflow control. It does not acquire a measured forecast advantage through that action alone. A local evaluation must specify the forecast variable, location, lead time, reference model and observation source.

What physical constraints can guarantee

A physics-informed neural network can penalise violations of a governing equation during training. A penalty does not ensure that every output satisfies the equation. Krishnapriyan and colleagues describe the usual approach as “soft constraints on an empirical loss function”. Their experiments show failures in convection, reaction and diffusion problems. [2]

An exact constraint has a narrower guarantee: it enforces the relation built into that constraint. It cannot guarantee that the inputs, other equations or reconstructed field are correct. In P1, the conserving model matches its supplied rainfall totals, but seasonal allocation has lower error against CHIRPS. In P7, shared transfers constrain the numerical record while the atmospheric reconstruction remains proposed.

Define the agent's permitted operations

For a proposed research workflow, give each agent a specific operation: retrieve a named dataset, check its units, run a fixed model version, or calculate a defined error measure. Record the input version, issue time, parameters and output location. Stop the workflow when a required input or check fails.

Keep model calculations separate from decisions about public warnings. The workflow should present its evidence to the responsible meteorologist or researcher. This is a proposed control design, not evidence that an operational Caribbean system has passed these tests.

Test the workflow before operational use

Reserve observations that were not used to select the model. Compare the candidate with relevant simple controls on the same dates. Evaluate ordinary conditions and the events that matter to the intended decision. Report missing observations and input delays.

The site's rainfall data-constraints study and Timestral comparison show why the observation-availability rule belongs in the evaluation. Their retrospective rainfall results do not establish hurricane-track, rapid-intensification or operational warning performance.

If a system reports probabilities, assess those probabilities against outcomes. If it supplies a physical constraint, test the residual independently of the training loss. Document failures as well as average performance. These are evaluation requirements for the proposed workflow; they are not results from a deployed service.

Sources and correction record

[1] Lam, R., et al. (2023). Learning skillful medium-range global weather forecasting. Science, 382, 1416–1421. See also the authors' account of the evaluation.

[2] Krishnapriyan, A., Gholami, A., Zhe, S., Kirby, R., and Mahoney, M. W. (2021). Characterizing possible failure modes in physics-informed neural networks. Advances in Neural Information Processing Systems, 34.

Correction, 11 November 2026. The previous version included unsupported percentages for cyclone-track and rapid-intensification improvements. It also overstated physical guarantees and commercial-system validation. Those claims have been removed. The GraphCast comparison now identifies its benchmark and denominator.

Read the current experiments

Open the paper collection

© 2026 PhysicsAI | Adrian Dunkley. Climate Intelligence Research. Kingston, Jamaica.

FIG. WORK-AI-AGENTS-CARIBBEAN-CLIMATE-2026

Inspect a shared numerical transfer

Illustration of numerical atmospheric modules and a shared transfer record. This is an explanatory model, not an observed atmospheric field.
Constructed teaching model. Use the control to inspect the relationship.

These are numerical atmospheric modules, with typed states and physical units.

This diagram represents numerical modules in the proposed D-LEGOS formulation. It does not represent language-model agents or an observed atmospheric field. Geometry uses Anatomy (MIT).

Terms explained

Select a term to read its meaning in this study.

Baseline

A comparison method used to judge whether a more complicated method adds useful information.

Residual

The amount by which a value fails to satisfy a stated equation or constraint. A small residual checks that relation, not every source of scientific error.

Protocol

A plan specifying a study question, methods, comparisons and evaluation rules. Planned outcomes are not completed results.