{"success":true,"data":{"author":"AODN","bucketAccessType":"public","bucketListable":true,"bucketName":"aodn-cloud-optimised","bucketPrefix":"satellite_austemp_sst_14day.zarr","category":"Earth Observation & Geospatial","cloudProvider":"aws","createdAt":"2026-10-04T00:00:00.000Z","description":"This dataset contains the Sea Surface Water Temperature anomalies (SSTa) from 1 January 2012, comparing the current SST to long-term averages (1993-2003, the CSIRO Legacy climatology, or 2002-2011, the IMOS climatology). The magnitude and duration of anomalously warm sea temperatures correlate well with past coral bleaching events. Where SST cannot be calculated because of cloud the grid cell is left blank. The product follows on from the Bureau of Meteorology's decommissioned ReefTemp Next Generation, which was declared operational on 22 October 2013 and is based on the IMOS 1-day L3S night-only SST product; the original research version (2007) was a collaboration between the Bureau, CSIRO Marine and Atmospheric Research and the Great Barrier Reef Marine Park Authority. This Zarr store is the full daily record from 2012-01-01 to the present of nightly SST, SST anomaly, their 14-day mosaics and mosaic age on the 0.02-degree Australian grid, stored as float32 in weekly chunks.\n\nMarine heatwave conditions in these AusTemp metrics are the driver the South Australian Government linked to the 2025-26 Karenia harmful algal bloom in the South Australian gulfs.","displayTitle":"Satellite - Sea surface temperature - AusTemp - SST and SST anomaly - 14 day mosaic","fuseMountBrowsable":true,"id":"36ab11ac-3ee5-5078-9952-ebfb27c2036e","license":"http://creativecommons.org/licenses/by/4.0/","objectCountEstimate":9,"probeStatus":"ok","region":"ap-southeast-2","schemaCard":{"generatedAt":"2026-10-04T00:00:00Z","sampleObjects":[".zmetadata","sst/.zarray","sst/688.1.1","sst_anom_mosaic/688.1.1","sst_anom_mosaic/688.2.1","time/52","filename/52"],"sampleRows":[{"where":"Gulf St Vincent","sst_anom_mosaic":2.182,"time":"2025-03-14T15:20","lat":-34.91,"lon":138.31,"sst":23.252},{"lat":-33.49,"sst_anom_mosaic":2.337,"lon":137.61,"where":"Spencer Gulf","time":"2025-03-14T15:20","sst":24.368},{"lon":138.31,"where":"Gulf St Vincent","lat":-34.91,"sst_anom_mosaic":1.983,"time":"2025-04-19T15:20","sst":21.501},{"lat":-33.49,"where":"Spencer Gulf","sst":21.967,"time":"2025-04-19T15:20","sst_anom_mosaic":1.863,"lon":137.61},{"sst_anom_mosaic":0.812,"lon":138.31,"time":"2016-02-09T15:20","sst":22.496,"lat":-34.91,"where":"Gulf St Vincent"},{"lat":-33.49,"sst_anom_mosaic":0.36,"sst":23.353,"lon":137.61,"where":"Spencer Gulf","time":"2016-02-09T15:20"}],"caveats":["Scale: chunks are [7, 630, 895] float32: one object per week per variable, 0.4-5.8 MB compressed (small over the SA gulfs because most of the chunk is land/NaN, up to 12 MB in open ocean). Measured 2026-10-04 (~3 MB/s link): a full-domain night of sst + sst_mosaic = 18 objects, 102 MB, 60 s (the whole 7-night chunk is fetched for one night); Mar-Jun 2025 at a point = 19 objects, 98 MB, 55 s; the SA-gulfs box spans TWO lat chunks (rows 1 and 2), so each week costs two objects: 38 objects (226 MB, 142 s) for Mar-Jun 2025, 166 (~1 GB) for the full run since 2025-03-01.","Quirk (image): the geospatial notebook image built before 2026-10-05 ships s3fs 0.4.2 (a 2020 synchronous release) next to zarr 3.1.6, so EVERY s3:// open through xarray or zarr there fails with \"Session.__init__() got an unexpected keyword argument 'asynchronous'\" (measured 2026-10-04 in a real pod). On that image read the FUSE mount instead: xr.open_zarr('/mnt/archive', consolidated=True, ...) works but the open took 39-240 s for these stores in the probe. `pip install -U s3fs` in the pod also fixes it. The starterCell tries s3:// first and falls back to the mount on TypeError.","Scale: the time axis is 91-step objects, so the open is cheap (5.3 s measured with the tuned storage options; 10 s class). This is the store for multi-year series; the single-night-chunk sibling (satellite_austemp_sst-anomaly_australia) is for the latest map.","Quirk: lat is DESCENDING (-8.21 -> -45.99): sel(lat=slice(-32.0, -36.5)); the ascending form returns an empty box.","Quirk: one night is missing from the index (2025-12-10; 2025-12-09 -> 2025-12-11), otherwise strictly daily and monotonic since 2012-01-01. The store is appended daily (5,384 -> 5,387 steps during 2026-10-04, update ~16:12 UTC); .zattrs date_created/start_time/stop_time describe the latest source NetCDF.","Departure from canonical: the anomaly baseline is the monthly IMOS (2002-2011) / CSIRO legacy (1993-2003) climatology (ReefTemp lineage), not the SSTAARS daily climatology of satellite_austemp_heatwave_14day; .zattrs still carries the 'summer Dec-Apr' abstract although the store is year-round.","Quirk: sst and sst_anom are nightly and NaN under cloud (1.36 M of 5.07 M cells valid on 2025-03-14; 88 of 122 nights cloud-free at Gulf St Vincent Mar-Jun 2025); *_mosaic are the gap-filled fields (3.26 M valid cells the same night), each pixel the most recent valid night within 14 days (sst_mosaic_age in days, float32).","Quirk: dtype is float32 here (the *_australia twin is float64); valid_max 100 / valid_min -100 on sst are placeholders. Night-time skin SST range on 2025-03-14 was 6.0-33.8 C.","Quirk: timestamps are 15:20 UTC; sel(time='2025-03-15') selects that night, while method='nearest' from midnight picks the previous night. filename (object dtype, 91-step objects) read fine under zarr 3.1.6; drop_variables=['filename'] is harmless insurance.","DO NOT: list the store recursively (34,793 objects) or loop .sel per night over years: each night re-fetches its 15.8 MB-raw weekly chunk. Slice a week-aligned range once and compute on the block."],"overview":"IMOS/BoM AusTemp SST-anomaly product (ReefTemp Next Generation lineage), the full-record twin of satellite_austemp_sst-anomaly_australia: nightly IMOS MultiSensor L3S GHRSST skin SST and its anomaly against the monthly IMOS (2002-2011) / CSIRO legacy (1993-2003) climatology, 14-day most-recent-valid-pixel mosaics and mosaic age, on the 0.02-degree grid 1890 lat (DESCENDING -8.21..-45.99) x 2685 lon (110.01..163.69), 15:20 UTC nightly, 5,384 nights 2012-01-01..2026-09-28 at 17:17 UTC on 2026-10-04 and 5,387 (..2026-10-01) by 19:21 UTC: appended daily, one missing night (2025-12-10). Stored float32, chunked [7 nights, 630, 895] (15.8 MB raw, 0.4-5.8 MB compressed), with time in 91-step objects, so it opens in 5-10 s and wants WEEK-ALIGNED BOXES: a full-domain night of sst + sst_mosaic = 18 objects, 102 MB, 60 s; Mar-Jun 2025 at Gulf St Vincent of sst = 19 objects, 98 MB, 55 s (88 of 122 nights cloud-free); the SA-gulfs box (225 x 225) straddles two 630-row chunks, so Mar-Jun 2025 of sst_anom_mosaic = 38 objects, 226 MB, 142 s (62 percent NaN, land). The full run since 2025-03-01 (83 weekly blocks) would be 83 objects (~0.5 GB) for a point and 166 (~1 GB) for the box; nothing here approaches the 2 GB map limit. Timings are from a ~3 MB/s link. Nightly SST at Gulf St Vincent averaged 22.4 C in Mar 2025, 20.9 C in Apr, 18.2 C in May and 15.0 C in Jun 2025.","starterCell":"import time, xarray as xr, zarr\nzarr.config.set({'async.concurrency': 64})\nSO = {'anon': True, 'client_kwargs': {'region_name': 'ap-southeast-2'},\n      'config_kwargs': {'max_pool_connections': 64}, 'max_concurrency': 1}\ntry:\n    ds = xr.open_zarr('s3://aodn-cloud-optimised/satellite_austemp_sst_14day.zarr', consolidated=True, storage_options=SO, drop_variables=['filename'])\nexcept TypeError:  # geospatial image before 2026-10-05: s3fs 0.4.2 cannot back zarr 3; the FUSE mount works, slower open\n    ds = xr.open_zarr('/mnt/archive', consolidated=True, drop_variables=['filename'])\n# South Australian gulfs, Mar-Jun 2025 (bloom onset). lat runs north to south. The bbox straddles two 630-row\n# lat chunks, so each week costs two ~5.8 MB objects; extend the slice end to None for the full run (~1 GB).\nsa = ds.sst_anom_mosaic.sel(lat=slice(-32.0, -36.5), lon=slice(135.0, 139.5), time=slice('2025-03-01', '2025-06-30'))\nt0 = time.time(); sa = sa.compute(); print(f'loaded {dict(sa.sizes)} in {time.time()-t0:.1f}s; NaN share {float(sa.isnull().mean()):.3f}')\nprint('monthly mean 14-day-mosaic SST anomaly over the SA gulfs (deg C, IMOS/legacy monthly climatology):')\nprint(sa.mean(('lat', 'lon')).resample(time='1MS').mean().round(2).to_pandas().to_string())","columns":[{"name":"time","type":"int32 [time], chunks [91], 'seconds since 1981-01-01', gregorian; decodes to 15:20 UTC nightly; 5384 values 2012-01-01..2026-09-28, monotonic, one missing night (2025-12-10)"},{"type":"float32 [lat], 1890 values -8.21..-45.99 DESCENDING (north to south), step 0.02","name":"lat"},{"name":"lon","type":"float32 [lon], 2685 values 110.01..163.69 ascending, step 0.02"},{"name":"filename","type":"object (vlen-utf8) [time], chunks [91]; source NetCDF name e.g. 20250315_IMOS_AusTemp-sst-anomaly_AUS_fv02.nc; reads fine under zarr 3.1.6, drop it if your zarr complains"},{"type":"float32 [time, lat, lon], chunks [7,630,895], fill NaN; sea surface skin temperature, degrees_Celsius, valid -100..100; night-time L3S, NaN under cloud","name":"sst"},{"type":"float32 [time, lat, lon], chunks [7,630,895], fill NaN; nightly SST anomaly vs the monthly IMOS (2002-2011) / CSIRO legacy (1993-2003) climatology, degrees_Celsius, valid -50..50","name":"sst_anom"},{"type":"float32 [time, lat, lon], chunks [7,630,895], fill NaN; 14-day composite SST, degrees_Celsius","name":"sst_mosaic"},{"name":"sst_anom_mosaic","type":"float32 [time, lat, lon], chunks [7,630,895], fill NaN; 14-day composite SST anomaly, degrees_Celsius"},{"name":"sst_mosaic_age","type":"float32 [time, lat, lon], chunks [7,630,895], fill NaN; age in days of the observation used in the mosaic, units 1"}],"starterSamplePath":".","layout":{"pattern":"Flat Zarr v2 directory: .zmetadata (14 kB), .zattrs, .zgroup, one directory per array including filename. 3-D chunk keys t.y.x with t = 0..769 (7-night blocks), y = 0..2 (630-row blocks), x = 0..2 (895-col blocks): 9 objects per week per variable; sst_anom directory listed 2026-10-04: 6,930 chunk objects, 37.85 GB, median 5.79 MB, max 12.4 MB. Compressed size per chunk for the block holding 2025-03-15: SA-gulfs chunk (1.1) sst 0.42 MB, sst_anom 0.46, sst_mosaic 0.56, sst_anom_mosaic 0.63, sst_mosaic_age 0.11; the mostly-ocean chunk 0.1 is 1.4-5.8 MB. time and filename are 60 objects of 91 steps; lat, lon one each. blosc/lz4 level 5, byte shuffle."},"mountPath":"/mnt/archive","totalObjects":"34,793 objects, ~191 GB (orchestrator summarize, early 2026-10-04); .zmetadata math: 5 variables x 770 weekly blocks x 9 = 34,650 chunk objects plus 60 time + 60 filename objects; one listed variable directory (sst_anom) = 6,930 objects, 37.85 GB","sourceObjectKey":"satellite_austemp_sst_14day.zarr/filename/.zarray","sampleHeaders":[{"bytes":"{\n    \"chunks\": [\n        91\n    ],\n    \"compressor\": {\n        \"blocksize\": 0,\n        \"clevel\": 5,\n        \"cname\": \"lz4\",\n        \"id\": \"blosc\",\n        \"shuffle\": 1\n    },\n    \"dimension_separator\": \".\",\n    \"dtype\": \"|O\",\n    \"fill_value\": null,\n    \"filters\": [\n        {\n            \"id\": \"vlen-utf8\"\n        }\n    ],\n    \"order\": \"C\",\n    \"shape\": [\n        5387\n    ],\n    \"zarr_format\": 2\n}","key":"satellite_austemp_sst_14day.zarr/filename/.zarray","encoding":"utf8","truncatedAt":512},{"encoding":"utf8","key":"satellite_austemp_sst_14day.zarr/filename/.zattrs","bytes":"{\n    \"_ARRAY_DIMENSIONS\": [\n        \"time\"\n    ]\n}","truncatedAt":512}],"verifiedRead":{"verifiedAt":"2026-10-04T21:16:53.680Z","starterCell":{"seconds":61.02,"ok":true},"rssDeltaMb":1.4,"snippet":"import os\nimport xarray as xr\nds = xr.open_zarr(os.path.join(os.environ['SCIGANTIC_MOUNT_PATH'], '.'))\nprint(ds)","library":"xarray/zarr","path":".","facts":["the mount root is a Zarr store: open it with xarray.open_zarr on the root, not the chunk files","under 'satellite_austemp_sst_14day.zarr/': 9 directories (e.g. filename, lat, lon, sst); 3 objects named like .zattrs, 24 B to 14 KB","under 'satellite_austemp_sst_14day.zarr/time/': 62 objects named like ##, 101 B to 348 B"],"seconds":29.75,"summary":"xarray Dataset dims [time=5387, lat=1890, lon=2685], 6 variables e.g. ['filename', 'sst', 'sst_anom', 'sst_anom_mosaic', 'sst_mosaic', 'sst_mosaic_age']","attempts":[{"error":"ValueError: binary content, not text","seconds":1.06,"path":"time/6","ok":false,"family":"text-head"},{"seconds":0.84,"path":"time/6","ok":true,"family":"bytes-head"},{"error":"ValueError: did not find a match in any of xarray's currently installed IO backends ['netcdf4', 'h5netcdf', 'scipy', 'cfradial1', 'datamet', 'furuno', 'gamic', 'gini', 'hpl', 'iris', 'metek', 'nexradlevel2', 'odim', 'rainbow', 'rasterio', 'uf', 'zarr']. Consider explicitly selecting one of the installed engines","family":"netcdf-xarray","ok":false,"path":"time/6","seconds":5.63},{"ok":true,"seconds":29.75,"path":".","family":"zarr"}],"image":"531775725781.dkr.ecr.us-east-1.amazonaws.com/scigantic-notebook-geospatial:latest","family":"zarr"},"format":"v2-hybrid","rowCount":"time 5,387 x lat 1,890 x lon 2,685 cells per variable (27.3 billion cells; 5 3-D variables) when read 2026-10-04 19:21 UTC (5,384 at 17:17 UTC the same day)","accessHints":[{"language":"bash","snippet":"# Task: list the store root (NOT recursive) and print every array's dtype/shape/chunks from the consolidated metadata\naws s3 ls --no-sign-request --region ap-southeast-2 s3://aodn-cloud-optimised/satellite_austemp_sst_14day.zarr/\naws s3 cp --no-sign-request --region ap-southeast-2 s3://aodn-cloud-optimised/satellite_austemp_sst_14day.zarr/.zmetadata - | python3 -c \"import json,sys; m=json.load(sys.stdin)['metadata']; [print(k[:-8], m[k]['dtype'], m[k]['shape'], m[k]['chunks']) for k in sorted(m) if k.endswith('/.zarray')]\""},{"language":"python-anonymous","snippet":"# Task: open anonymously. Time is stored in 91-step objects, so this store opens fast (~10 s) with these settings.\nimport xarray as xr, zarr\nzarr.config.set({'async.concurrency': 64})\nSO = {'anon': True, 'client_kwargs': {'region_name': 'ap-southeast-2'},\n      'config_kwargs': {'max_pool_connections': 64}, 'max_concurrency': 1}\nds = xr.open_zarr('s3://aodn-cloud-optimised/satellite_austemp_sst_14day.zarr',\n                  consolidated=True, storage_options=SO, drop_variables=['filename'])\nprint(dict(ds.sizes), str(ds.time.values[0])[:16], '->', str(ds.time.values[-1])[:16], ds.sst.dtype)\nprint('lat', float(ds.lat[0]), '->', float(ds.lat[-1]), '(descending) | lon', float(ds.lon[0]), '->', float(ds.lon[-1]))\nprint({v: ds[v].encoding['chunks'] for v in ds.data_vars})"},{"language":"python-local","snippet":"# Task: open from the FUSE mount inside the pod\nimport xarray as xr\nds = xr.open_zarr('/mnt/archive', consolidated=True, drop_variables=['filename'])\nprint(dict(ds.sizes), list(ds.data_vars))"},{"snippet":"# Task: nightly SST at Gulf St Vincent. Chunks are [7, 630, 895] float32 (~5.8 MB compressed), so a point series\n# costs one object per week: Mar-Jun 2025 here was 19 objects, 98 MB; the full run from 2025-03-01 would be 83 (~0.45 GB).\nimport time, xarray as xr, zarr\nzarr.config.set({'async.concurrency': 64})\nSO = {'anon': True, 'client_kwargs': {'region_name': 'ap-southeast-2'},\n      'config_kwargs': {'max_pool_connections': 64}, 'max_concurrency': 1}\nds = xr.open_zarr('s3://aodn-cloud-optimised/satellite_austemp_sst_14day.zarr',\n                  consolidated=True, storage_options=SO, drop_variables=['filename'])\npt = ds.sst.sel(lat=-34.9, lon=138.3, method='nearest').sel(time=slice('2025-03-01', '2025-06-30'))\nt0 = time.time(); s = pt.to_series(); dt = time.time() - t0\nprint(f'{len(s)} nights, {pt.data.npartitions} chunk objects, {dt:.1f}s; cloud-free nights: {int(s.notna().sum())}')\nprint('monthly mean nightly SST at Gulf St Vincent (deg C):'); print(s.resample('MS').mean().round(2).to_string())","language":"python-anonymous"},{"language":"python-anonymous","snippet":"# Task: one full-domain map for one night (3 x 3 = 9 objects per variable; the whole 7-night chunk is fetched).\nimport time, xarray as xr, zarr\nzarr.config.set({'async.concurrency': 64})\nSO = {'anon': True, 'client_kwargs': {'region_name': 'ap-southeast-2'},\n      'config_kwargs': {'max_pool_connections': 64}, 'max_concurrency': 1}\nds = xr.open_zarr('s3://aodn-cloud-optimised/satellite_austemp_sst_14day.zarr',\n                  consolidated=True, storage_options=SO, drop_variables=['filename'])\nday = ds[['sst', 'sst_mosaic']].sel(time='2025-03-15', method='nearest')\nt0 = time.time(); day = day.compute(); dt = time.time() - t0\nprint(f'{str(day.time.values)[:16]} {dict(day.sizes)} {day.nbytes/1e6:.0f} MB in memory, {dt:.1f}s')\nprint('valid cells nightly / mosaic:', int(day.sst.notnull().sum()), int(day.sst_mosaic.notnull().sum()),\n      '| sst range', round(float(day.sst.min()), 2), round(float(day.sst.max()), 2))"}]},"summary":"This dataset contains the Sea Surface Water Temperature anomalies (SSTa) from 1 January 2012, comparing the current SST to long-term averages (1993-2003, the CSIRO Legacy…","title":"Satellite - Sea surface temperature - AusTemp - SST and SST anomaly - 14 day mosaic","updatedAt":"2026-10-07T13:47:26.143Z","visibility":"public","websiteUrl":"https://catalogue-imos.aodn.org.au/geonetwork/srv/eng/catalog.search#/metadata/62f6b449-90dc-45bf-8acb-ae52e8a58c5c"}}