{"success":true,"data":{"author":"AODN","bucketAccessType":"public","bucketListable":true,"bucketName":"aodn-cloud-optimised","bucketPrefix":"satellite_austemp_sst-anomaly_australia.zarr","category":"Earth Observation & Geospatial","cloudProvider":"aws","createdAt":"2026-10-04T00:00:00.000Z","description":"This dataset contains the Sea Surface Water Temperature anomalies (SSTa) from 1 January 2012, comparing the current SST to long-term averages (1993-2003, the CSIRO Legacy climatology, or 2002-2011, the IMOS climatology). The magnitude and duration of anomalously warm sea temperatures correlate well with past coral bleaching events. Where SST cannot be calculated because of cloud the grid cell is left blank. The product follows on from the Bureau of Meteorology's decommissioned ReefTemp Next Generation, which was declared operational on 22 October 2013 and is based on the IMOS 1-day L3S night-only SST product; the original research version (2007) was a collaboration between the Bureau, CSIRO Marine and Atmospheric Research and the Great Barrier Reef Marine Park Authority. This Zarr store holds a rolling daily window (2023-11-17 to the present when read on 2026-10-04) of nightly SST, SST anomaly, their 14-day mosaics and mosaic age on the 0.02-degree Australian grid, in single-day chunks.\n\nMarine heatwave conditions in these AusTemp metrics are the driver the South Australian Government linked to the 2025-26 Karenia harmful algal bloom in the South Australian gulfs.","displayTitle":"Satellite - Sea surface temperature - AusTemp - SST anomaly - Australia - Rolling daily","fuseMountBrowsable":true,"id":"267e40c4-7c6d-5db2-87f0-1dd8f09843c9","license":"http://creativecommons.org/licenses/by/4.0/","objectCountEstimate":8,"probeStatus":"ok","region":"ap-southeast-2","schemaCard":{"accessHints":[{"language":"bash","snippet":"# Task: list the store root (NOT recursive) and print every array's dtype/shape/chunks from the consolidated metadata\naws s3 ls --no-sign-request --region ap-southeast-2 s3://aodn-cloud-optimised/satellite_austemp_sst-anomaly_australia.zarr/\naws s3 cp --no-sign-request --region ap-southeast-2 s3://aodn-cloud-optimised/satellite_austemp_sst-anomaly_australia.zarr/.zmetadata - | python3 -c \"import json,sys; m=json.load(sys.stdin)['metadata']; [print(k[:-8], m[k]['dtype'], m[k]['shape'], m[k]['chunks']) for k in sorted(m) if k.endswith('/.zarray')]\""},{"language":"python-anonymous","snippet":"# Task: open anonymously. The time axis is 1048 single-step objects, so the open itself is the expensive step:\n# ~190 s with s3fs defaults (a HEAD precedes every GET), ~30 s with these settings. Open once per session.\nimport xarray as xr, zarr\nzarr.config.set({'async.concurrency': 64})\nSO = {'anon': True, 'client_kwargs': {'region_name': 'ap-southeast-2'},\n      'config_kwargs': {'max_pool_connections': 64}, 'max_concurrency': 1}\nds = xr.open_zarr('s3://aodn-cloud-optimised/satellite_austemp_sst-anomaly_australia.zarr',\n                  consolidated=True, storage_options=SO)\nds = ds.drop_duplicates('time')   # 2025-04-08 appears twice; a duplicated index breaks reindex/resample\nprint(dict(ds.sizes), str(ds.time.values[0])[:16], '->', str(ds.time.values[-1])[:16])\nprint('lat', float(ds.lat[0]), '->', float(ds.lat[-1]), '(descending) | lon', float(ds.lon[0]), '->', float(ds.lon[-1]))"},{"snippet":"# Task: open from the FUSE mount inside the pod\nimport xarray as xr\nds = xr.open_zarr('/mnt/archive', consolidated=True).drop_duplicates('time')\nprint(dict(ds.sizes), list(ds.data_vars))","language":"python-local"},{"language":"python-anonymous","snippet":"# Task: nightly SST anomaly at Gulf St Vincent since 2025-03-01. Chunks are [1, 500, 500] (~0.45 MB compressed),\n# so a point series costs one object per night: cheap in bytes but ~580 requests.\nimport time, xarray as xr, zarr\nzarr.config.set({'async.concurrency': 64})\nSO = {'anon': True, 'client_kwargs': {'region_name': 'ap-southeast-2'},\n      'config_kwargs': {'max_pool_connections': 64}, 'max_concurrency': 1}\nds = xr.open_zarr('s3://aodn-cloud-optimised/satellite_austemp_sst-anomaly_australia.zarr',\n                  consolidated=True, storage_options=SO).drop_duplicates('time')\npt = ds.sst_anom.sel(lat=-34.9, lon=138.3, method='nearest').sel(time=slice('2025-03-01', None))\nt0 = time.time(); s = pt.to_series(); dt = time.time() - t0\nprint(f'{len(s)} nights, {pt.data.npartitions} chunk objects, {dt:.1f}s; cloud-free nights: {int(s.notna().sum())}')\nprint('monthly mean nightly SST anomaly at Gulf St Vincent (deg C, cloud-free nights only):')\nprint(s.resample('MS').mean().round(2).to_string())"},{"snippet":"# Task: one full-domain map for one night (1890 x 2685 cells = 24 objects per variable).\nimport time, numpy as np, xarray as xr, zarr\nzarr.config.set({'async.concurrency': 64})\nSO = {'anon': True, 'client_kwargs': {'region_name': 'ap-southeast-2'},\n      'config_kwargs': {'max_pool_connections': 64}, 'max_concurrency': 1}\nds = xr.open_zarr('s3://aodn-cloud-optimised/satellite_austemp_sst-anomaly_australia.zarr',\n                  consolidated=True, storage_options=SO).drop_duplicates('time')\nday = ds[['sst_anom', 'sst_anom_mosaic', 'sst_mosaic_age']].sel(time='2025-03-15', method='nearest')\nt0 = time.time(); day = day.compute(); dt = time.time() - t0\nprint(f'{str(day.time.values)[:16]} {dict(day.sizes)} {day.nbytes/1e6:.0f} MB in memory, {dt:.1f}s')\nprint('valid cells nightly / mosaic:', int(day.sst_anom.notnull().sum()), int(day.sst_anom_mosaic.notnull().sum()))\nage = day.sst_mosaic_age.values; age = age[~np.isnan(age)]\nprint('sst_mosaic_age values seen:', np.unique(age).tolist()[:20])","language":"python-anonymous"}],"caveats":["Scale: the open is the expensive step. time is chunked [1], so building the index reads 1,048+ tiny objects: 187 s with s3fs defaults (zarr 3.1.6, 17:50 UTC), 28.7 s with storage_options max_concurrency=1 + config_kwargs max_pool_connections=64 + zarr.config async.concurrency=64 (18:02), 11-15 s on later opens. Open once and keep the Dataset.","Quirk (image): the geospatial notebook image built before 2026-10-05 ships s3fs 0.4.2 (a 2020 synchronous release) next to zarr 3.1.6, so EVERY s3:// open through xarray or zarr there fails with \"Session.__init__() got an unexpected keyword argument 'asynchronous'\" (measured 2026-10-04 in a real pod). On that image read the FUSE mount instead: xr.open_zarr('/mnt/archive', consolidated=True, ...) works but the open took 39-240 s for these stores in the probe. `pip install -U s3fs` in the pod also fixes it. The starterCell tries s3:// first and falls back to the mount on TypeError.","Scale: chunks are [1, 500, 500] (2 MB raw, 0.2-0.7 MB compressed), so bytes are cheap but request counts are high: 580 nights at one point = 578 GETs, 226 MB, 119 s; the SA-gulfs box for the same nights = 579 GETs, 354 MB, 131 s; a full-domain night of three variables = 72 GETs, 33 MB, 29 s (all 2026-10-04, ~3 MB/s link). For multi-year point series use the sibling satellite_austemp_sst_14day (7-night chunks, float32, 2012 onward).","Quirk: the time index has a DUPLICATE: 2025-04-08 15:20 appears twice (indices 509-510). A duplicated index breaks reindex/resample and makes .sel(time='2025-04-08') return two steps; call ds.drop_duplicates('time') right after opening (lazy).","Departure from canonical: this is NOT the 'summer SSTa since 2012' the abstract describes. The store is a rolling, year-round window that began 2023-11-17 and is appended nightly (1,048 steps 2026-09-28 at 17:14 UTC, 1,051 steps ..2026-10-01 at 19:09 UTC on 2026-10-04); .zattrs date_created (2024-04-29) and stop_time (99991231) are not maintained. The 2012-2023 history lives in satellite_austemp_sst_14day.","Quirk: lat is DESCENDING (-8.21 -> -45.99): sel(lat=slice(-32.0, -36.5)) (north first); the ascending form returns an empty box. The grid is 110.01-163.69E, 8.21-45.99S, narrower than the heatwave store's 96-174E.","Quirk: the anomaly baseline is the monthly IMOS (2002-2011) / CSIRO legacy (1993-2003) climatology, not the SSTAARS daily climatology used by satellite_austemp_heatwave_14day; the two SSTa fields differ by up to several tenths of a degree at the same pixel and are not interchangeable.","Quirk: sst_anom (nightly) is NaN under cloud (1.36 M valid cells of 5.07 M on 2025-03-14; 382 of 580 nights cloud-free at Gulf St Vincent); sst_anom_mosaic is the gap-filled field (3.26 M valid cells the same night). sst_mosaic_age is float32 with values 1..13 seen (1 = that night's observation; the heatwave store encodes its mosaic_age differently and starts at 0).","Quirk: valid_min/valid_max attributes (0..500 on sst and sst_anom) are placeholders, not ranges to mask by; sst_anom is signed (monthly means at Gulf St Vincent ranged -0.46 to +1.33 C over 2025-03..2026-10).","Quirk: timestamps are 15:20 UTC (the nominal L3S night file time), so a string date selects that night (sel(time='2025-03-15') -> 2025-03-15T15:20) while method='nearest' from a midnight timestamp picks the PREVIOUS night; the heatwave store's timestamps are midnight. Align the family by date.","Quirk: .zattrs still carries the ReefTemp-era 'summer Dec-Apr' abstract and start_time 2012; trust the time coordinate."],"columns":[{"name":"time","type":"int32 [time], chunks [1] (1048 single-step objects), 'seconds since 1981-01-01', gregorian; decodes to 15:20 UTC nightly; 2023-11-17..2026-09-28 with 2025-04-08 duplicated"},{"type":"float32 [lat], 1890 values -8.21..-45.99 DESCENDING (north to south), step 0.02","name":"lat"},{"name":"lon","type":"float32 [lon], 2685 values 110.01..163.69 ascending, step 0.02"},{"name":"sst","type":"float64 [time, lat, lon], chunks [1,500,500], fill NaN; sea surface skin temperature, degrees_Celsius (valid_min/max 0..500 are placeholders); night-time L3S, NaN under cloud"},{"name":"sst_anom","type":"float64 [time, lat, lon], chunks [1,500,500], fill NaN; nightly SST anomaly vs the monthly IMOS (2002-2011) / CSIRO legacy (1993-2003) climatology, degrees_Celsius"},{"name":"sst_mosaic","type":"float64 [time, lat, lon], chunks [1,500,500], fill NaN; 14-day composite SST (most recent valid night in the window), degrees_Celsius"},{"name":"sst_anom_mosaic","type":"float64 [time, lat, lon], chunks [1,500,500], fill NaN; 14-day composite SST anomaly, degrees_Celsius"},{"name":"sst_mosaic_age","type":"float32 [time, lat, lon], chunks [1,500,500], fill NaN; age in days of the observation used in the mosaic, units 1"}],"format":"v2-hybrid","generatedAt":"2026-10-04T00:00:00Z","layout":{"pattern":"Flat Zarr v2 directory: .zmetadata (9 kB), .zattrs, .zgroup and one directory per array; no filename array. 3-D chunk keys t.y.x with t = one night, y = 0..3 (500-row blocks), x = 0..5 (500-col blocks): 24 objects per night per variable; sst_anom directory listed 2026-10-04: 24,979 chunk objects, 11.70 GB, median 0.44 MB, max 1.5 MB. Compressed size per 500x500 chunk for 2025-03-15 (SA-gulfs chunk 2.2): sst 0.23 MB, sst_anom 0.22, sst_mosaic 0.67, sst_anom_mosaic 0.72, sst_mosaic_age 0.07 (open-ocean chunks 0.01-0.13 MB; all-NaN chunks may be absent: 580 requested nights fetched 578 objects). time is 1,048+ objects of ONE value each. blosc/lz4 level 5, byte shuffle."},"mountPath":"/mnt/archive","overview":"IMOS/BoM AusTemp SST-anomaly product (ReefTemp Next Generation lineage): nightly IMOS MultiSensor L3S GHRSST skin SST and its anomaly against the monthly IMOS (2002-2011) / CSIRO legacy (1993-2003) climatology, with 14-day most-recent-valid-pixel mosaics and a mosaic-age layer. The 'australia' twin of satellite_austemp_sst_14day: same 0.02-degree grid (1890 lat DESCENDING -8.21..-45.99 x 2685 lon 110.01..163.69, 15:20 UTC nightly timestamps) but a ROLLING window, 2023-11-17..2026-09-28 (1,048 steps) at 17:14 UTC on 2026-10-04 and ..2026-10-01 (1,051 steps, one duplicate) by 19:09 UTC, float64, chunked [1 night, 500, 500]. Single-night chunks make this the store for a recent MAP or a short, box-shaped recent history, and make the open the expensive step (1,048 single-step time objects: 187 s to read with s3fs defaults, 11-29 s with the tuned settings below). Measured 2026-10-04 from a ~3 MB/s link: one full-domain night of three variables = 72 objects, 33 MB, 29 s; 580 nights at Gulf St Vincent of sst_anom = 578 objects, 226 MB, 119 s (382 cloud-free nights); the SA-gulfs box (225 x 225, one spatial chunk) for the same 580 nights of sst_anom_mosaic = 579 objects, 354 MB, 131 s, 62 percent NaN (land plus never-observed). The SA-gulfs mosaic anomaly averaged +1.50 C in Mar 2025, +1.20 C in Apr and +0.95 C in May 2025, back to -0.17 C by Aug 2025.","rowCount":"time 1,051 x lat 1,890 x lon 2,685 cells per variable (5.3 billion cells; 5 3-D variables) when read 2026-10-04 19:09 UTC (1,048 at 17:14 UTC the same day)","sampleHeaders":[{"truncatedAt":512,"key":"satellite_austemp_sst-anomaly_australia.zarr/lat/.zarray","bytes":"{\n    \"chunks\": [\n        1890\n    ],\n    \"compressor\": {\n        \"blocksize\": 0,\n        \"clevel\": 5,\n        \"cname\": \"lz4\",\n        \"id\": \"blosc\",\n        \"shuffle\": 1\n    },\n    \"dtype\": \"<f4\",\n    \"fill_value\": \"NaN\",\n    \"filters\": null,\n    \"order\": \"C\",\n    \"shape\": [\n        1890\n    ],\n    \"zarr_format\": 2\n}","encoding":"utf8"},{"bytes":"{\n    \"_ARRAY_DIMENSIONS\": [\n        \"lat\"\n    ],\n    \"axis\": \"Y\",\n    \"long_name\": \"latitude\",\n    \"reference_datum\": \"WGS84 geographic coordinate system\",\n    \"standard_name\": \"latitude\",\n    \"units\": \"degrees_north\",\n    \"valid_max\": 90.0,\n    \"valid_min\": -90.0\n}","encoding":"utf8","key":"satellite_austemp_sst-anomaly_australia.zarr/lat/.zattrs","truncatedAt":512}],"sampleObjects":[".zmetadata","sst_anom/.zarray","sst_anom/484.2.2","sst_anom_mosaic/484.2.2","sst_mosaic_age/484.2.2","time/484"],"sampleRows":[{"sst_anom":2.182,"lat":-34.91,"where":"Gulf St Vincent","sst_anom_mosaic":2.182,"time":"2025-03-14T15:20","lon":138.31},{"sst_anom_mosaic":2.337,"where":"Spencer Gulf","lat":-33.49,"lon":137.61,"time":"2025-03-14T15:20","sst_anom":2.337},{"time":"2025-04-19T15:20","lat":-34.91,"sst_anom":null,"lon":138.31,"where":"Gulf St Vincent","sst_anom_mosaic":1.739},{"time":"2025-04-19T15:20","sst_anom_mosaic":2.063,"lat":-33.49,"sst_anom":null,"lon":137.61,"where":"Spencer Gulf"},{"lon":138.31,"sst_anom":null,"sst_anom_mosaic":1.507,"time":"2026-09-27T15:20","where":"Gulf St Vincent","lat":-34.91},{"lon":137.61,"where":"Spencer Gulf","lat":-33.49,"sst_anom":1.789,"time":"2026-09-27T15:20","sst_anom_mosaic":1.789}],"sourceObjectKey":"satellite_austemp_sst-anomaly_australia.zarr/lat/.zarray","starterCell":"import time, xarray as xr, zarr\nzarr.config.set({'async.concurrency': 64})\nSO = {'anon': True, 'client_kwargs': {'region_name': 'ap-southeast-2'},\n      'config_kwargs': {'max_pool_connections': 64}, 'max_concurrency': 1}\nt0 = time.time()\ntry:\n    ds = xr.open_zarr('s3://aodn-cloud-optimised/satellite_austemp_sst-anomaly_australia.zarr', consolidated=True, storage_options=SO)\nexcept TypeError:  # geospatial image before 2026-10-05: s3fs 0.4.2 cannot back zarr 3; the FUSE mount works, slower open\n    ds = xr.open_zarr('/mnt/archive', consolidated=True)\nds = ds.drop_duplicates('time')\nprint(f'opened in {time.time()-t0:.0f}s (the time axis is 1048 single-night objects; this is the slow step)')\n# South Australian gulfs since the 2025 Karenia bloom began. lat runs north to south in this store, and the\n# bbox sits inside one 500x500 chunk, so this costs one ~0.45 MB object per night.\nsa = ds.sst_anom_mosaic.sel(lat=slice(-32.0, -36.5), lon=slice(135.0, 139.5), time=slice('2025-03-01', None))\nt0 = time.time(); sa = sa.compute(); print(f'loaded {dict(sa.sizes)} in {time.time()-t0:.1f}s; NaN share {float(sa.isnull().mean()):.3f}')\nprint('monthly mean 14-day-mosaic SST anomaly over the SA gulfs (deg C):')\nprint(sa.mean(('lat', 'lon')).resample(time='1MS').mean().round(2).to_pandas().to_string())","starterSamplePath":".","totalObjects":"125,968 objects, ~62 GB (orchestrator summarize, early 2026-10-04); .zmetadata math: 5 variables x 1,051 nights x 24 = 126,120 chunk objects plus 1,051 time objects; one listed variable directory (sst_anom) = 24,979 objects, 11.70 GB","verifiedRead":{"verifiedAt":"2026-10-04T20:56:05.087Z","path":".","rssDeltaMb":0.5,"seconds":238.87,"starterCell":{"ok":false,"error":"TypeError: Session.__init__() got an unexpected keyword argument 'asynchronous'","seconds":0},"facts":["the mount root is a Zarr store: open it with xarray.open_zarr on the root, not the chunk files","under 'satellite_austemp_sst-anomaly_australia.zarr/': 8 directories (e.g. lat, lon, sst, sst_anom); 3 objects named like .zattrs, 22 B to 9 KB","under 'satellite_austemp_sst-anomaly_australia.zarr/time/': 1000+ objects named like ###, 20 B to 295 B"],"summary":"xarray Dataset dims [time=1051, lat=1890, lon=2685], 5 variables e.g. ['sst', 'sst_anom', 'sst_anom_mosaic', 'sst_mosaic', 'sst_mosaic_age']","image":"531775725781.dkr.ecr.us-east-1.amazonaws.com/scigantic-notebook-geospatial:latest","attempts":[{"family":"text-head","seconds":1.11,"ok":false,"error":"ValueError: binary content, not text","path":"time/502"},{"path":"time/502","seconds":0.92,"family":"bytes-head","ok":true},{"ok":false,"path":"time/502","family":"netcdf-xarray","error":"ValueError: did not find a match in any of xarray's currently installed IO backends ['netcdf4', 'h5netcdf', 'scipy', 'cfradial1', 'datamet', 'furuno', 'gamic', 'gini', 'hpl', 'iris', 'metek', 'nexradlevel2', 'odim', 'rainbow', 'rasterio', 'uf', 'zarr']. Consider explicitly selecting one of the installed engines","seconds":5.34},{"path":".","family":"zarr","seconds":238.87,"ok":true}],"replacedStarterCell":"import time, xarray as xr, zarr\nzarr.config.set({'async.concurrency': 64})\nSO = {'anon': True, 'client_kwargs': {'region_name': 'ap-southeast-2'},\n      'config_kwargs': {'max_pool_connections': 64}, 'max_concurrency': 1}\nt0 = time.time()\nds = xr.open_zarr('s3://aodn-cloud-optimised/satellite_austemp_sst-anomaly_australia.zarr',\n                  consolidated=True, storage_options=SO).drop_duplicates('time')\nprint(f'opened in {time.time()-t0:.0f}s (the time axis is 1048 single-night objects; this is the slow step)')\n# South Australian gulfs since the 2025 Karenia bloom began. lat runs north to south in this store, and the\n# bbox sits inside one 500x500 chunk, so this costs one ~0.45 MB object per night.\nsa = ds.sst_anom_mosaic.sel(lat=slice(-32.0, -36.5), lon=slice(135.0, 139.5), time=slice('2025-03-01', None))\nt0 = time.time(); sa = sa.compute(); print(f'loaded {dict(sa.sizes)} in {time.time()-t0:.1f}s; NaN share {float(sa.isnull().mean()):.3f}')\nprint('monthly mean 14-day-mosaic SST anomaly over the SA gulfs (deg C):')\nprint(sa.mean(('lat', 'lon')).resample(time='1MS').mean().round(2).to_pandas().to_string())","library":"xarray/zarr","snippet":"import os\nimport xarray as xr\nds = xr.open_zarr(os.path.join(os.environ['SCIGANTIC_MOUNT_PATH'], '.'))\nprint(ds)","family":"zarr"},"verifiedReadAttempt":{"at":"2026-11-13T07:38:52.575Z","attempts":[{"error":"ValueError: binary content, not text","family":"text-head","ok":false,"path":"time/462","seconds":1.12},{"family":"bytes-head","ok":true,"path":"time/462","seconds":0.9},{"error":"ValueError: did not find a match in any of xarray's currently installed IO backends ['netcdf4', 'h5netcdf', 'scipy', 'cfradial1', 'datamet', 'furuno', 'gamic', 'gini', 'hpl', 'iris', 'metek', 'nexradlevel2', 'odim', 'rainbow', 'rasterio', 'uf', 'zarr']. Consider explicitly selecting one of the installed engines","family":"netcdf-xarray","ok":false,"path":"time/462","seconds":5.16}],"facts":["the mount root is a Zarr store: open it with xarray.open_zarr on the root, not the chunk files","under 'satellite_austemp_sst-anomaly_australia.zarr/': 8 directories (e.g. lat, lon, sst, sst_anom); 3 objects named like .zattrs, 22 B to 9 KB","under 'satellite_austemp_sst-anomaly_australia.zarr/time/': 1000+ objects named like ###, 20 B to 295 B"],"image":"531775725781.dkr.ecr.us-east-1.amazonaws.com/scigantic-notebook-geospatial:latest","outcome":"no-reader","starterCell":{"ok":true}}},"summary":"This dataset contains the Sea Surface Water Temperature anomalies (SSTa) from 1 January 2012, comparing the current SST to long-term averages (1993-2003, the CSIRO Legacy…","title":"Satellite - Sea surface temperature - AusTemp - SST anomaly - Australia - Rolling daily","updatedAt":"2026-10-07T13:52:03.033Z","visibility":"public","websiteUrl":"https://catalogue-imos.aodn.org.au/geonetwork/srv/eng/catalog.search#/metadata/62f6b449-90dc-45bf-8acb-ae52e8a58c5c"}}