{"success":true,"data":{"author":"IMOS","bucketAccessType":"public","bucketListable":true,"bucketName":"imos-data","bucketPrefix":"IMOS/BGC_DB/harvested_from_CSIRO","category":"Life Sciences","cloudProvider":"aws","createdAt":"2026-10-04T00:00:00.000Z","description":"This dataset comprises the phytoplankton and zooplankton abundance, biovolume and biomass measurements, HPLC pigments, picoplankton flow cytometry, total suspended solids and water chemistry (salinity, nutrients, carbon, alkalinity, oxygen) from samples collected at the Integrated Marine Observing System (IMOS) National Reference Stations (NRS), the Southern Ocean Time Series (SOTS), the Bonney Coast mooring, the SARDI South Australian mooring array and other repeatedly sampled coastal stations, together with the Australian Continuous Plankton Recorder (AusCPR) survey samples towed by ships of opportunity. Sampling and analysis follow the IMOS NRS Biogeochemical Operations Manual (Davies and Sommerville 2020) and Eriksen et al. 2019; SOTS phytoplankton follow Eriksen et al. 2018; SARDI mooring samples are collected with a Niskin bottle and analysed by Microalgal Solutions. This store is the raw harvest layer behind the AODN plankton products: 20 CSV tables (45.7 MB) exported from the CSIRO BGC database on 2026-09-29, with NRS tables keyed by TRIP_CODE, CPR tables keyed by SAMPLE, taxon lookups (phytoinfo, zoopinfo) carrying a harmful-algal-bloom flag, and taxonomic changelogs, covering 2002 to September 2026 and including the active South Australian stations at Kangaroo Island, Gulf St Vincent, Spencer Gulf and Coffin Bay. For the 2025-26 South Australian harmful algal bloom this is the hosted source of Karenia cell counts: the SARDI Gulf St Vincent, Spencer Gulf and Kangaroo Island stations recorded Karenia spp., Karenia mikimotoi and Karenia cristata through 2025, so it is the dataset to open for the bloom's phytoplankton record.","displayTitle":"Biogeochemical Database - National Reference Station and Continuous Plankton Recorder plankton, pigments and chemistry (CSV)","fuseMountBrowsable":true,"id":"b93484c7-9cf9-5b1a-af04-4d711e9fdb31","license":"http://creativecommons.org/licenses/by/4.0/","probeStatus":"ok","region":"ap-southeast-2","schemaCard":{"overview":"The IMOS/CSIRO Biogeochemical (BGC) database behind the AODN plankton products (reference-station phytoplankton, zooplankton and combined BGC products plus the AusCPR products); the Plankton product specification names IMOS/BGC_DB/harvested_from_CSIRO as the public S3 drop of the layers harvested from CSIRO. This is the un-pivoted RAW layer: 20 flat CSVs, 45.7 MB, written 2026-09-29. Measured 2026-10-04: bgc_trip 4,114 trips at 64 station codes, 2002-02-19 to 2026-09-02; bgc_phyto_raw 46,217 taxon-by-trip rows (969 taxa, to 2026-06-11); bgc_zoop_raw 66,266; cpr_samp 37,313 CPR samples 2007-11-25 to 2026-07-03 with 76,319 phyto and 153,586 zoop rows; phytoinfo 2,726 taxa, 332 flagged HAB. Everything is small (largest file 11.7 MB; bgc_trip + bgc_phyto_raw read anonymously from outside the region and joined in 23.5 s, 15 MB in pandas), so the access direction is 'load whole tables, join in pandas': NRS tables join bgc_trip on exact TRIP_CODE, CPR tables join cpr_samp on SAMPLE, taxa join phytoinfo/zoopinfo on TAXON_NAME, all 100% matches. South Australia is covered through the bloom: Kangaroo Island NRS is active (last trip 2026-07-21) and the SARDI array adds Gulf St Vincent, Upper Spencer Gulf, Spencer Gulf mouth and Coffin Bay; 23 Karenia rows since 2025-03-01 include Karenia mikimotoi 3,000 cells/L and Karenia spp. 110,000 cells/L at Gulf St Vincent on 2025-07-03.","rowCount":"bgc_trip 4,114; bgc_phyto_raw 46,217; bgc_zoop_raw 66,266; bgc_chemistry 9,316; bgc_pigments 3,077; bgc_picoplankton 5,177; bgc_picoplankton_meta 8,706; bgc_tss 1,518; bgc_tss_meta 3,534; bgc_lfish_samples 3,760; bgc_lfish_countraw 46,759; bgc_phyto_changelog 2,739; bgc_zoop_changelog 2,267; cpr_samp 37,313; cpr_phyto_raw 76,319; cpr_zoop_raw 153,586; cpr_phyto_changelog 496; cpr_zoop_changelog 1,339; phytoinfo 2,726; zoopinfo 2,246 (all counted 2026-10-04)","totalObjects":"20 objects, 45,694,984 bytes (45.7 MB) from aws s3 ls --summarize on 2026-10-04","accessHints":[{"snippet":"# Task: list the 20 CSVs (flat folder, 45.7 MB)\naws s3 ls s3://imos-data/IMOS/BGC_DB/harvested_from_CSIRO/ --no-sign-request --region ap-southeast-2 --human-readable\nls -la /mnt/archive/\nhead -3 /mnt/archive/bgc_trip.csv","language":"bash"},{"snippet":"# Task: station table (one row per station) with first/last sampling dates, NRS + SARDI (South Australia) rows\nimport pandas as pd\ntrip = pd.read_csv('/mnt/archive/bgc_trip.csv', parse_dates=['SAMPLEDATELOCAL', 'SAMPLEDATEUTC'])\nstations = (trip.groupby(['PROJECTNAME', 'STATIONCODE', 'STATIONNAME'])\n                .agg(trips=('TRIP_CODE', 'size'), lat=('LATITUDE', 'median'), lon=('LONGITUDE', 'median'),\n                     first=('SAMPLEDATELOCAL', 'min'), last=('SAMPLEDATELOCAL', 'max')).reset_index())\nprint(stations[stations.PROJECTNAME.isin(['NRS', 'SARDI'])].to_string())","language":"python-local"},{"language":"python-anonymous","snippet":"# Task: station table (one row per station) with first/last sampling dates, NRS + SARDI (South Australia) rows\nimport pandas as pd\nso = {'anon': True, 'client_kwargs': {'region_name': 'ap-southeast-2'}}\nbase = 's3://imos-data/IMOS/BGC_DB/harvested_from_CSIRO'\ntrip = pd.read_csv(f'{base}/bgc_trip.csv', parse_dates=['SAMPLEDATELOCAL', 'SAMPLEDATEUTC'], storage_options=so)\nstations = (trip.groupby(['PROJECTNAME', 'STATIONCODE', 'STATIONNAME'])\n                .agg(trips=('TRIP_CODE', 'size'), lat=('LATITUDE', 'median'), lon=('LONGITUDE', 'median'),\n                     first=('SAMPLEDATELOCAL', 'min'), last=('SAMPLEDATELOCAL', 'max')).reset_index())\nprint(stations[stations.PROJECTNAME.isin(['NRS', 'SARDI'])].to_string())"},{"snippet":"# Task: phytoplankton abundance with station/date (join on exact TRIP_CODE; 100% match) and the HAB flag from phytoinfo\nimport pandas as pd\ntrip = pd.read_csv('/mnt/archive/bgc_trip.csv', parse_dates=['SAMPLEDATELOCAL'])\nphy = pd.read_csv('/mnt/archive/bgc_phyto_raw.csv')\ninfo = pd.read_csv('/mnt/archive/phytoinfo.csv')\nhab_taxa = set(info.loc[info.HAB.astype(str).str.upper().isin(['1', 'TRUE']), 'TAXON_NAME'])   # 332 taxa; mixed '1'/'TRUE' encoding\ndf = phy.merge(trip, on='TRIP_CODE', how='left', validate='many_to_one')\ndf['HAB'] = df.TAXON_NAME.isin(hab_taxa)\nprint(df[df.HAB].groupby('STATIONCODE').CELL_L.max().sort_values(ascending=False).head(10))","language":"python-local"},{"snippet":"# Task: phytoplankton abundance with station/date (join on exact TRIP_CODE; 100% match) and the HAB flag from phytoinfo\nimport pandas as pd\nso = {'anon': True, 'client_kwargs': {'region_name': 'ap-southeast-2'}}\nbase = 's3://imos-data/IMOS/BGC_DB/harvested_from_CSIRO'\ntrip = pd.read_csv(f'{base}/bgc_trip.csv', parse_dates=['SAMPLEDATELOCAL'], storage_options=so)\nphy = pd.read_csv(f'{base}/bgc_phyto_raw.csv', storage_options=so)\ninfo = pd.read_csv(f'{base}/phytoinfo.csv', storage_options=so)\nhab_taxa = set(info.loc[info.HAB.astype(str).str.upper().isin(['1', 'TRUE']), 'TAXON_NAME'])\nprint(len(hab_taxa), 'HAB-flagged taxa;', 'Karenia mikimotoi' in hab_taxa)\ndf = phy.merge(trip, on='TRIP_CODE', how='left', validate='many_to_one')","language":"python-anonymous"},{"snippet":"# Task: CPR tows on the South Australian shelf (sample table keyed by SAMPLE), then their phytoplankton rows\nimport pandas as pd\ncpr = pd.read_csv('/mnt/archive/cpr_samp.csv', parse_dates=['SAMPLEDATEUTC'])\nbox = cpr[cpr.LATITUDE.between(-40, -32) & cpr.LONGITUDE.between(130, 142)]      # Great Australian Bight / Melbourne-Adelaide routes\nprint(len(box), 'CPR samples,', box.SAMPLEDATEUTC.min().date(), 'to', box.SAMPLEDATEUTC.max().date(), '| routes:', sorted(box.TRIP_CODE.str[:4].unique()))\ncp = pd.read_csv('/mnt/archive/cpr_phyto_raw.csv')\nsub = cp[cp.SAMPLE.isin(box.SAMPLE)]\nprint(len(sub), 'phyto rows;', sub.TAXON_NAME.nunique(), 'taxa')","language":"python-local"},{"snippet":"# Task: CPR tows on the South Australian shelf (sample table keyed by SAMPLE), then their phytoplankton rows\nimport pandas as pd\nso = {'anon': True, 'client_kwargs': {'region_name': 'ap-southeast-2'}}\nbase = 's3://imos-data/IMOS/BGC_DB/harvested_from_CSIRO'\ncpr = pd.read_csv(f'{base}/cpr_samp.csv', parse_dates=['SAMPLEDATEUTC'], storage_options=so)\nbox = cpr[cpr.LATITUDE.between(-40, -32) & cpr.LONGITUDE.between(130, 142)]\nprint(len(box), 'CPR samples on the SA shelf,', box.SAMPLEDATEUTC.min().date(), 'to', box.SAMPLEDATEUTC.max().date(), '| routes:', sorted(box.TRIP_CODE.str[:4].unique()))\ncp = pd.read_csv(f'{base}/cpr_phyto_raw.csv', storage_options=so)\nsub = cp[cp.SAMPLE.isin(box.SAMPLE)]\nprint(len(sub), 'CPR phyto rows on the SA shelf;', sub.TAXON_NAME.nunique(), 'taxa')","language":"python-anonymous"},{"language":"python-local","snippet":"# Task: nutrient time series at one station, keeping only flagged-good values (flag 1) and treating flag 6 as below detection\nimport pandas as pd\nchem = pd.read_csv('/mnt/archive/bgc_chemistry.csv', parse_dates=['SAMPLEDATELOCAL'])\ngsv = chem[chem.TRIP_CODE.str.startswith('GSV')].sort_values('SAMPLEDATELOCAL')\ngood = gsv[gsv.NITRATE_FLAG.isin([1, 6])]          # 6 co-occurs with a value of exactly 0.0 in every row\nprint(good[['SAMPLEDATELOCAL', 'SAMPLEDEPTH_M', 'NITRATE_UMOLL', 'NITRATE_FLAG', 'AMMONIUM_UMOLL', 'AMMONIUM_FLAG']].tail(12).to_string(index=False))"}],"caveats":["Departure from canonical: this folder is the RAW harvest (one row per taxon per trip, as exported from the CSIRO database on 2026-09-29), not the AODN 'analysis-ready' wide products described in the Plankton product specification. There is no -999 'not looked for' sentinel anywhere (0 cells in all 20 files); absence of a row means 'not recorded', and only the 647 CELL_L == 0 rows are explicit zeros. Use the *_changelog STARTDATE to know when a taxon began to be distinguished before calling an earlier gap an absence.","DO NOT: assume South Australia is unsampled. Kangaroo Island NRS (KAI, -35.832, 136.447) has 98 trips from 2008-02-12 to 2026-07-21 and is still active; the SARDI array adds Gulf St Vincent GSV (-35.023, 138.460; 28 trips 2019-08-13 to 2025-10-17), Upper Spencer Gulf USG (-33.111, 137.708; to 2026-05-11), Spencer Gulf mouth 8SG and Coffin Bay 5CB (both to 2026-03-03) and the KAID1/2/3 5/50/60 m series (to 2025-10-28); 2CP, B01-B03 and KIB are historical (ended 2010-2023). 486 SA trips in total, 33 in 2025 and 8 in 2026 so far.","Quirk: Karenia IS in the bloom window. 85 Karenia rows nationally (Karenia spp. 51, K. mikimotoi 12, K. papilionacea 10, K. cristata 5, cf./longicanalis 7), 47 of them at SA stations and 23 since 2025-03-01: GSV 2025-07-03 Karenia spp. 110,000 cells/L + K. mikimotoi 3,000 cells/L; GSV 2025-10-17 K. cristata 42,000 + K. mikimotoi 1,500 cells/L; KAID2 2025-10-28 K. mikimotoi 400 cells/L; USG and KAI lower. No Karenia rows exist in the CPR tables, and the latest SA phytoplankton sample is 2026-03-03 (the 2026-05 to 2026-07 KAI trips have chemistry/pico rows but no phyto rows yet).","Quirk: the NRS-side join key is the EXACT TRIP_CODE string. All of bgc_chemistry, bgc_pigments, bgc_picoplankton(_meta), bgc_tss(_meta), bgc_phyto_raw and bgc_zoop_raw match bgc_trip.TRIP_CODE 100%. Do not strip the '_102.100.100/<n>' handle suffix that Coastal Stations trips carry (1,863 rows) or split on '_' (SOTS codes contain underscores): the exact string is unique in bgc_trip. bgc_lfish_* TRIP_CODEs match bgc_trip only 18%: use I_SAMPLE_ID between the two lfish tables and the lat/lon/date columns inside bgc_lfish_samples.","Quirk: CPR tables have no TRIP_CODE on the raw side; join cpr_phyto_raw / cpr_zoop_raw to cpr_samp on SAMPLE ('<tow>-<segment>', e.g. '716-15'), which matches 100%. cpr_samp.TRIP_CODE is '<route><YYYYMMDD>' where the 4-letter route is a port pair (MEAB Melbourne-Adelaide, ABAB, ADAB, HOAN Hobart-Antarctica ...).","Scale: CPR coverage of the SA gulfs box (lat -36.5..-32, lon 135..139.5) is thin and old: 460 samples, all Great Australian Bight route, 2010-10-23 to 2018-12-20, none since 2025-03-01. Widen to the SA shelf (lat -40..-32, lon 130..142) for 4,331 samples to 2025-11-07, including 2025 Melbourne-Adelaide tows MEAB20250607 (lon 134.4-141.9), MEAB20251004 and MEAB20251106, which run along the shelf south of the gulfs.","Quirk: phytoinfo.HAB is a string column with two encodings, '1' (319 taxa) and 'TRUE' (13 taxa); 2,394 are NULL. 332 taxa are flagged and the list is broad (it includes 'Unid diatom', 'Pennate diatom 75-100 µm', Trichodesmium, Noctiluca-type groups), so 'HAB-flagged present' is not 'bloom'. Karenia mikimotoi, K. brevis, K. papilionacea, K. cristata, K. bicuneiformis, K. brevisulcata and 'Karenia spp.' are flagged; 'Karenia longicanalis' is not (its row has no WoRMS alignment either).","Quirk: QC flags are per-variable integer columns (<VAR>_FLAG) and the values co-occur like this in bgc_chemistry (measured): 0 pairs with a NULL value (not measured/not QC'd, e.g. OXYGEN_FLAG 0 on 6,983 rows), 1 with a value (good), 2 with a value (probably good), 4 with a value (bad), 6 with a value of exactly 0.0 on every one of 1,392 nitrate rows (below detection: keep the zero, do not treat as missing), 9 with NULL (missing). PIGMENTS_FLAG, TSS_FLAG and the picoplankton flags use the same digits. Flag meanings are defined in the IMOS NRS BGC Operations Manual, which this card did not fetch; the co-occurrence above is what the data shows.","Quirk: SAMPLEDEPTH_M is a STRING in bgc_pigments, bgc_picoplankton(_meta) and bgc_tss(_meta) because it holds 'WC' (water-column integrated) on 697 pigment rows and some pico rows; it is float64 in bgc_chemistry. Cast with pd.to_numeric(errors='coerce') when you need metres, or filter the 'WC' rows explicitly.","Quirk: bgc_trip.LATITUDE/LONGITUDE are NOMINAL station coordinates (identical for every KAI, KAID1, KAID2, KAID3 and KIB trip: -35.83217, 136.44733), not cast positions. SAMPLETYPE is NULL on every Coastal Stations trip and on 244 SARDI trips, so do not use it to decide whether phyto rows exist; check bgc_phyto_raw instead. The Coastal Stations project (1,864 trips, GBR / Botany Bay / Port Phillip, 2020-2026) has picoplankton rows but no phytoplankton counts.","Quirk: dates are plain 'YYYY-MM-DD HH:MM:SS' strings, local and UTC side by side on trip tables, LOCAL only on the chemistry/pigment/TSS/pico tables; pass parse_dates. The column name SYNECOCHOCCUS_CELLSML is misspelled in the source and must be used as written. bgc_pigments CPHL_C1C2, BETA_EPI_CAR and BETA_BETA_CAR are 100% NULL.","Quirk: no single GeoNetwork record describes this folder. The Plankton product specification names it as the public S3 drop for the harvested tables; the AODN products built from it are GeoNetwork f098f0d0 (Phytoplankton Abundance and Biovolume, reference stations), bc14672f (Zooplankton Abundance and Biomass, reference stations), b442c3e8 (Combined Biogeochemical parameters), 8e594cd1 (Phytoplankton Abundance and Biovolume, CPR) and bf287dfe (Zooplankton Abundance and Biomass Index, CPR), all CC-BY 4.0, none with a dataset DOI. The older static 'Australian Phytoplankton Database (1844 - ongoing)' record 75f4f1fc is a different, project-merged compilation, not this harvest. No registry.opendata.aws page exists for imos-data (404 on 2026-10-04)."],"layout":{"pattern":"Flat folder of 20 CSV files directly under the prefix (no subfolders, no sidecars, no partitioning); /mnt/archive/<file>.csv. Sizes 46 KB (cpr_phyto_changelog) to 11.7 MB (cpr_zoop_raw), 45,694,984 bytes total; bgc_* and *info files dated 2026-09-29 23:07 UTC, cpr_* files 2026-09-29 23:27. Three families: bgc_* (NRS/SOTS/SARDI/coastal station tables keyed by TRIP_CODE, plus bgc_lfish_* larval fish keyed by I_SAMPLE_ID), cpr_* (Continuous Plankton Recorder: cpr_samp sample table keyed by SAMPLE, raw taxon tables keyed by SAMPLE), and lookups phytoinfo / zoopinfo keyed by TAXON_NAME. Headers are UPPER_SNAKE_CASE with units in the name (CELL_L, ZOOP_ABUNDANCE_M3, SALINITY_PSU). Dates are 'YYYY-MM-DD HH:MM:SS' strings (local and UTC columns both present on trip tables)."},"starterSamplePath":"bgc_chemistry.csv","mountPath":"/mnt/archive","format":"v2-hybrid","sampleRows":[{"LATITUDE":-35.83217,"file":"bgc_trip.csv","SAMPLEDATELOCAL":"2008-04-15 06:30:00","LONGITUDE":136.44733,"SAMPLEDATEUTC":"2008-04-14 21:00:00","SAMPLETYPE":null,"PROJECTNAME":"NRS","STATIONNAME":"Kangaroo Island","TRIP_CODE":"KAI20080414","STATIONCODE":"KAI"},{"file":"bgc_phyto_raw.csv","TAXON_GROUP":"Dinoflagellate","GENUS":"Karenia","SAMPVOL_L":null,"CELL_L":110000,"TRIP_CODE":"GSV20250703","SPECIES":"spp.","TAXON_NAME":"Karenia spp.","BIOVOLUME_UM3L":828396800,"METHODS":"LM","CELL_COUNT":null,"SPCODE":231788},{"LATITUDE":-38.91426,"LONGITUDE":142.36553,"TRIP_CODE":"MEAB20200923","REGION":"Great Australian Bight","PCI":1,"SAMPLE":"566-22","SAMPLEDATEUTC":"2020-09-23 17:38:44","file":"cpr_samp.csv","SAMPLETYPE":null,"SAMPLEDATELOCAL":"2020-09-24 03:38:44","BIOMASS_MGM3":null}],"sampleObjects":["bgc_trip.csv","bgc_phyto_raw.csv","phytoinfo.csv","bgc_chemistry.csv","cpr_samp.csv","cpr_phyto_raw.csv"],"generatedAt":"2026-10-04T00:00:00Z","sampleHeaders":[{"encoding":"utf8","truncatedAt":512,"key":"IMOS/BGC_DB/harvested_from_CSIRO/bgc_chemistry.csv","bytes":"TRIP_CODE,SAMPLEDEPTH_M,SAMPLEDATELOCAL,SALINITY_PSU,SALINITY_FLAG,SILICATE_UMOLL,SILICATE_FLAG,NITRATE_UMOLL,NITRATE_FLAG,PHOSPHATE_UMOLL,PHOSPHATE_FLAG,AMMONIUM_UMOLL,AMMONIUM_FLAG,NITRITE_UMOLL,NITRITE_FLAG,DIC_UMOLKG,CARBON_FLAG,TALKALINITY_UMOLKG,ALKALINITY_FLAG,OXYGEN_UMOLL,OXYGEN_FLAG,MICROBIOMESAMPLE_ID\r\nNSI20200625,57,2020-06-25 11:30:00,35.657,1,2.1,1,5.7,1,0.46,1,,9,0.12,1,2093.09,1,2336.27,1,,0,\r\nNSI20200720,20,2020-07-20 11:15:00,35.567,1,0.4,1,0.2,1,0.12,1,,9,0,6,,0,,0,,0,http://hdl.handle.net"},{"key":"IMOS/BGC_DB/harvested_from_CSIRO/bgc_lfish_countraw.csv","encoding":"utf8","truncatedAt":512,"bytes":"I_SAMPLE_ID,TRIP_CODE,SCIENTIFICNAME,SPCODE,TAXON_COUNT,COMMENTS\r\n3166,MAI20160303,Monacanthidae_Monacanthidae_37465903,37465903,3,\r\n3166,MAI20160303,Mugilidae_Mugilidae_37381000,37381000,23,\r\n3166,MAI20160303,Platycephalidae_Platycephalidae_37296900,37296900,17,\r\n3166,MAI20160303,Syngnathidae_Syngnathidae_37282000,37282000,1,\r\n3166,MAI20160303,Triglidae_Lepidotrigla.spp_37288901,37288901,10,\r\n3167,MAI20160321,Superclass_Pisces_37000000,37000000,3,Unidentified as too damaged or unknown\r\n3168,MAI20160321,Bot"}],"columns":[{"type":"string, unique key (4,114); '<STATIONCODE><YYYYMMDD>' for NRS/SARDI (e.g. 'KAI20250520', 'GSV20250703'); Coastal Stations rows append a handle: 'LOR20230127_102.100.100/402191'; SOTS: 'SOTS_IN2019_V02_CTD12_11.7'; NWS: 'NWS_10.1'. Join key for every other bgc_* table except bgc_lfish_*","name":"bgc_trip.TRIP_CODE"},{"name":"bgc_trip.PROJECTNAME","type":"string: Coastal Stations 1,864 / NRS 1,302 / SARDI 388 / SOTS 273 / NRS Ichthyoplankton 160 / NWS 46 / Moreton Bay 29 / RV Revelle 28 / IIOE 24"},{"name":"bgc_trip.STATIONNAME / STATIONCODE","type":"string; 64 codes. NRS: DAR, ESP (to 2013), KAI Kangaroo Island, MAI, NIN (to 2013), NSI, PH4 (to 2009), PHB, ROT, VBM Bonney Coast (from 2024), YON. SARDI (SA): 2CP, 5CB Coffin Bay, 8SG Spencer Gulf mouth, B01-B03 SAIMOS (2008-2010), GSV Gulf St Vincent, KAID1/2/3 Kangaroo Island 5/50/60 m, KIB, USG Upper Spencer Gulf. Coastal Stations: BAI, TRP (Botany Bay), HOB, LOR (Port Phillip), CTL, DBI, FLB, GNI, PTD, YKK, RMR, TRM (GBR). SOTS, SOTS_RAS, REV1-21, NWS, IIOE, PEI, NSF, PHA, ROF"},{"name":"bgc_trip.LATITUDE / LONGITUDE","type":"float64 degrees, nominal station position (not per-cast); e.g. KAI -35.83217, 136.44733; GSV -35.023, 138.46; USG -33.111, 137.708"},{"name":"bgc_trip.SAMPLEDATELOCAL / SAMPLEDATEUTC","type":"string 'YYYY-MM-DD HH:MM:SS' (parse with parse_dates); 2002-02-19 to 2026-09-02"},{"type":"float64 m, filled on 1,350 / 1,577 trips","name":"bgc_trip.ZOOPSAMPLEDEPTH_M / PHYTOSAMPLEDEPTH_M"},{"type":"float64 zooplankton dry weight / ash-free dry weight, filled on 1,183 / 404 trips","name":"bgc_trip.BIOMASS_MGM3 / ASHFREEBIOMASS_MGM3"},{"type":"float64 m, 1,119 trips","name":"bgc_trip.SECCHI_M"},{"type":"string, 1,987 filled: letters for what was sampled, P phyto, Z zoop, F fish larvae (PZ 1,015; P 466; FPZ 301; F 156; Z 40; PZZ 6; FFPZ 2; FZ 1); NULL on all Coastal Stations rows and 244 SARDI rows","name":"bgc_trip.SAMPLETYPE"},{"name":"bgc_phyto_raw.TRIP_CODE","type":"string; 1,495 trips, 100% present in bgc_trip.TRIP_CODE (exact string join)"},{"type":"string; 969 values; 99.98% present in phytoinfo.TAXON_NAME; includes size classes and groups such as 'Pseudo-nitzschia delicatissima group <=3 µm' and 'Karenia spp.'","name":"bgc_phyto_raw.TAXON_NAME"},{"type":"string: Centric diatom 16,321 / Dinoflagellate 9,292 / Pennate diatom 8,767 / Flagellate 5,037 / Ciliate 2,694 / Coccolithophore 1,155 / Chlorophyta / Silicoflagellate / Cyanobacteria / Other / Haptophyta / Foraminifera / Radiozoa / Diatom / Protozoa / Charophyta","name":"bgc_phyto_raw.TAXON_GROUP"},{"name":"bgc_phyto_raw.GENUS / SPECIES","type":"string, NULL on 10,667 rows (group-level taxa); SPECIES holds 'spp.' for genus-level records"},{"name":"bgc_phyto_raw.SPCODE","type":"float64 (AphiaID-like integer code, 679 distinct, 557 NULL); joins to phytoinfo.SPCODE"},{"type":"float64 cells per litre, never NULL; 647 rows are exactly 0 (looked for, not seen). THE abundance column.","name":"bgc_phyto_raw.CELL_L"},{"type":"float64 cubic micrometres per litre, 718 NULL","name":"bgc_phyto_raw.BIOVOLUME_UM3L"},{"name":"bgc_phyto_raw.CELL_COUNT / SAMPVOL_L","type":"float64 raw count and settled volume in litres, filled on 38,796 rows; NULL where COMMENTS says counts were back-calculated or unavailable"},{"type":"string: LM (light microscopy) 45,117 / SEM 1,100","name":"bgc_phyto_raw.METHODS"},{"type":"string: 'Count data from datasheets' 29,028 / 'Count data back calculated from abundance as datasheets not available' 6,589 / 'counts and sample volumes not available' 5,105 / NULL 5,495","name":"bgc_phyto_raw.COMMENTS"},{"name":"phytoinfo.TAXON_NAME / SPCODE","type":"string key (2,726) / float64 code (2,659 filled); lookup for both bgc_phyto_raw and cpr_phyto_raw"},{"name":"phytoinfo.HAB","type":"string flag with MIXED encoding: '1' on 319 taxa, 'TRUE' on 13, NULL on 2,394; 332 taxa flagged in total. Karenia mikimotoi is flagged ('1'); Karenia cristata is 'TRUE'; Karenia longicanalis is NULL (unflagged). Test with HAB.astype(str).str.upper().isin(['1','TRUE'])"},{"type":"string group (Dinoflagellate 914, Centric diatom 564 ...); WoRMS status (accepted 2,042, unassessed 389, unaccepted 90, uncertain, quarantined ...); accepted name; AphiaID (float64)","name":"phytoinfo.FUNCTIONALGROUP / STATUS / VALID_SCIENTIFIC_NAME / VALID_APHIA_ID"},{"name":"phytoinfo.BV_CELL / MONT2001PGN_CELL / PGC_CELL / TROPHY","type":"per-cell biovolume (um3), Menden-Deuer and Lessard 2001 pg N and pg C per cell (float64, ~70% filled); TROPHY phytoplankton / protozooplankton / mixoplankton on 684 taxa"},{"name":"cpr_samp.SAMPLE","type":"string key (37,313 unique) '<tow>-<segment>' e.g. '716-15'; join key for cpr_phyto_raw and cpr_zoop_raw (100% match both ways)"},{"name":"cpr_samp.TRIP_CODE","type":"string '<route><YYYYMMDD>' e.g. 'MEAB20250607' (route = port pair: MEAB Melbourne-Adelaide, ABAB, HOAN Hobart-Antarctica, BRPK Brisbane-Port Kembla, SYME Sydney-Melbourne ...); 390 trips"},{"type":"string: Southern Ocean 10,392 / Great Australian Bight 8,131 / Southern East Australian Current 6,456 / Northern EAC 5,226 / Great Barrier Reef 4,007 / Western Australia 1,461 / Tasmania 1,180 / North West Australia 381 / Northern Australia 79","name":"cpr_samp.REGION"},{"name":"cpr_samp.LATITUDE / LONGITUDE","type":"float64 per-segment position; lat -65.52 to -9.25, lon 55.06 to 174.34"},{"type":"string timestamps, 2007-11-25 to 2026-07-03","name":"cpr_samp.SAMPLEDATEUTC / SAMPLEDATELOCAL"},{"type":"int64 Phytoplankton Colour Index 0-3 (0: 18,933; 1: 12,654; 2: 4,076; 3: 1,650)","name":"cpr_samp.PCI"},{"name":"cpr_samp.BIOMASS_MGM3 / SAMPLETYPE / GHRSST_6D_DEGC / CHLOC3_MGM3","type":"zooplankton biomass (4,878 filled); which analyses exist for the segment (B biomass, P, Z; 13,380 filled); matched satellite SST (9,640) and chlorophyll (2,419)"},{"name":"cpr_phyto_raw.*","type":"SAMPLE, TAXON_NAME (502), TAXON_GROUP, GENUS, SPECIES, SPCODE, PHYTO_ABUNDANCE_M3 (cells per m3, never NULL), BIOVOL_UM3M3, FOV_COUNT (fields of view), SAMPVOL_M3"},{"type":"SAMPLE, TAXON_NAME (1,114, with life-stage/sex suffixes 'f', 'm', 'j'), COPEPOD (COPEPOD / NON-COPEPOD), TAXON_GROUP, GENUS, SPECIES, SPCODE, TAXON_COUNT, SAMPVOL_M3, ZOOP_ABUNDANCE_M3","name":"cpr_zoop_raw.*"},{"name":"bgc_zoop_raw.*","type":"TRIP_CODE (1,203 trips, 100% in bgc_trip), TAXON_NAME (1,034, 100% in zoopinfo), COPEPOD (COPEPOD 45,797 / NON-COPEPOD 20,065 / NOCTILUCA 404), TAXON_GROUP, GENUS, SPECIES, SPCODE, ZOOP_ABUNDANCE_M3 (individuals per m3), TAXON_COUNT, SAMPVOL_M3"},{"name":"zoopinfo.*","type":"TAXON_NAME key (2,246), SUBGENERA, FUNCTIONALGROUP, GENUS, SPECIES, SPCODE, LENGTH_MM, SIZEREFERENCE (e.g. 'Boltovskoy 1999'), DIET (Herbivore / Carnivore / Omnivore ...)"},{"type":"TRIP_CODE (2,229 trips, 100% in bgc_trip), SAMPLEDEPTH_M (float), SAMPLEDATELOCAL, then value+flag pairs: SALINITY_PSU/SALINITY_FLAG, SILICATE_UMOLL, NITRATE_UMOLL, PHOSPHATE_UMOLL, AMMONIUM_UMOLL, NITRITE_UMOLL (each with _FLAG), DIC_UMOLKG/CARBON_FLAG, TALKALINITY_UMOLKG/ALKALINITY_FLAG, OXYGEN_UMOLL/OXYGEN_FLAG (int64 flags), MICROBIOMESAMPLE_ID (handle URL, 3,768 filled). 2008-02-13 to 2026-09-02","name":"bgc_chemistry.*"},{"type":"TRIP_CODE (1,181 trips), SAMPLEDATELOCAL, SAMPLEDEPTH_M (STRING: numeric or 'WC' water column on 697 rows), 43 HPLC pigment columns (CPHL_A, DV_CPHL_A, CPHL_B, CPHL_C1/C2/C3, FUCO, HEX_FUCO, BUT_FUCO, PERID, ALLO, ZEA, LUT, DIADINO, DIATO, NEO, VIOLA, PRAS, ASTA, GYRO, MYXO, CANTHA, ECHIN, LYCO, PHIDE_A, PHYTIN_A/B, PYROPHIDE_A, PYROPHYTIN_A, CPHLIDE_A, MG_DVP, ALPHA_BETA_CAR, ...; CPHL_C1C2, BETA_EPI_CAR, BETA_BETA_CAR are entirely NULL), PIGMENTS_FLAG (int: 0 2,132 / 1 744 / 2 146 / 3 4 / 4 18 / 9 33), PIGMENTS_COMMENTS. 2009-02-24 to 2026-09-02","name":"bgc_pigments.*"},{"name":"bgc_picoplankton.* / bgc_picoplankton_meta.*","type":"TRIP_CODE (2,939 trips), SAMPLEDEPTH_M (STRING, includes 'WC'), SAMPLEDATELOCAL, PROCHLOROCOCCUS_CELLSML, SYNECOCHOCCUS_CELLSML (sic), PICOEUKARYOTES_CELLSML, BACTERIA_CELLSML, VIRUS_CELLSML, each with _FLAG; the _meta table holds per-replicate values (REPLICATE, SAMPLE_CODE) plus analysis provenance (ANALYSIS_LOCATION e.g. SARDI, ANALYSIS_DATE, ANALYST_NAME, INSTRUMENT_BRAND_MODEL, LASER_NM, FLOW_RATE_UL_PER_MIN ...). 2009-02-18 to 2026-03-23"},{"name":"bgc_tss.* / bgc_tss_meta.*","type":"TRIP_CODE (1,191 / 1,396 trips), SAMPLEDATELOCAL, SAMPLEDEPTH_M (STRING), TSS_MGL, INORGANICFRACTION_MGL, ORGANICFRACTION_MGL, TSS_FLAG (0 889 / 1 383 / 2 245 / 3 1); _meta adds REPLICATE, TSS_COMMENTS, BLANKADJUSTAVAILABLE. 2008-02-12 to 2026-09-02"},{"type":"larval fish (NIMO + NRS ichthyoplankton, 1983-01-01 to 2021-12-22): I_SAMPLE_ID key (100% match between the two), PROJECTNAME ('NIMO_Kamala_89' ...), TRIP_CODE (only 18% match bgc_trip: do NOT join on it), SAMPLEDATELOCAL/UTC, LATITUDE, LONGITUDE, STATIONNAME, SAMPVOL_M3, VESSEL, TOWTYPE, GEARDEPTH_M, GEARMESH_UM, DEPTH_M, TEMPERATURE_C, SALINITY_PSU, COMMENTS, QC_FLAG (0/1/8/9), FLAG_COMMENT; countraw: SCIENTIFICNAME ('Family_Family_CAABcode'), SPCODE, TAXON_COUNT, COMMENTS","name":"bgc_lfish_samples.* / bgc_lfish_countraw.*"},{"type":"TAXON_NAME, STARTDATE (first date the taxon was looked for, 2008-09-29 to 2016-11-01), PARENT_NAME (what it was counted as before), TRAINING, COMMENTS. Needed to tell 'absent' from 'not yet distinguished' in time series","name":"bgc_phyto_changelog / bgc_zoop_changelog / cpr_phyto_changelog / cpr_zoop_changelog"}],"starterCell":"# South Australian stations (lat -36.5..-32, lon 135..139.5): Karenia records since 2025-03-01, with timing\nimport time, pandas as pd\nt0 = time.time()\ntrip = pd.read_csv('/mnt/archive/bgc_trip.csv', parse_dates=['SAMPLEDATELOCAL'])\nphy = pd.read_csv('/mnt/archive/bgc_phyto_raw.csv')\ninfo = pd.read_csv('/mnt/archive/phytoinfo.csv')\nhab_taxa = set(info.loc[info.HAB.astype(str).str.upper().isin(['1', 'TRUE']), 'TAXON_NAME'])\ndf = phy.merge(trip, on='TRIP_CODE', how='left')\nsa = df[df.LATITUDE.between(-36.5, -32.0) & df.LONGITUDE.between(135.0, 139.5)]\nprint(f'{len(phy):,} phyto rows nationally, {len(sa):,} at SA stations {sorted(sa.STATIONCODE.unique())}, read+join {time.time()-t0:.1f}s')\nkar = sa[sa.TAXON_NAME.str.contains('Karenia', na=False) & (sa.SAMPLEDATELOCAL >= '2025-03-01')]\nprint(kar.sort_values('SAMPLEDATELOCAL')[['SAMPLEDATELOCAL', 'STATIONNAME', 'TAXON_NAME', 'CELL_L']].to_string(index=False))\nhab = sa[sa.TAXON_NAME.isin(hab_taxa) & (sa.SAMPLEDATELOCAL >= '2025-03-01')]\nprint('HAB-flagged taxa recorded at SA stations since 2025-03-01:', hab.TAXON_NAME.nunique(), '| latest SA phyto sample:', sa.SAMPLEDATELOCAL.max())\n# measured 2026-10-04 (anonymous S3 from outside the region): 46,217 national / 7,248 SA rows, 23.9 s; 23 Karenia rows since 2025-03-01, peak Karenia spp. 110,000 cells/L + K. mikimotoi 3,000 cells/L at GSV on 2025-07-03; 57 HAB taxa; latest SA sample 2026-03-03","sourceObjectKey":"IMOS/BGC_DB/harvested_from_CSIRO/bgc_chemistry.csv","verifiedRead":{"family":"csv","seconds":0.67,"attempts":[{"seconds":0.67,"path":"bgc_lfish_samples.csv","ok":true,"family":"csv"}],"path":"bgc_lfish_samples.csv","facts":["under 'IMOS/BGC_DB/harvested_from_CSIRO/': 20 objects named like bgc_chemistry.csv, 45 KB to 11.2 MB"],"snippet":"import os\nimport pandas as pd\ndf = pd.read_csv(os.path.join(os.environ['SCIGANTIC_MOUNT_PATH'], 'bgc_lfish_samples.csv'), nrows=1000)\ndf.head()","summary":"CSV/TSV: columns ['I_SAMPLE_ID', 'PROJECTNAME', 'TRIP_CODE', 'SAMPLEDATELOCAL', 'SAMPLEDATEUTC', 'LATITUDE', 'LONGITUDE', 'STATIONNAME', 'SAMPVOL_M3', 'VESSEL', 'TOWTYPE', 'GEARDEPTH_M'], dtypes ['int64', 'object', 'object', 'object', 'object', 'float64', 'float64', 'object', 'float64', 'object', 'object', 'float64'], first 1000 rows read","rssDeltaMb":1.1,"image":"531775725781.dkr.ecr.us-east-1.amazonaws.com/scigantic-notebook-genomics:latest","library":"pandas","starterCell":{"seconds":6.13,"ok":true},"bytes":550540,"verifiedAt":"2026-10-04T21:07:01.738Z"}},"summary":"This dataset comprises the phytoplankton and zooplankton abundance, biovolume and biomass measurements, HPLC pigments, picoplankton flow cytometry, total suspended solids and…","title":"Biogeochemical Database - National Reference Station and Continuous Plankton Recorder plankton, pigments and chemistry (CSV)","updatedAt":"2026-10-07T13:16:26.821Z","visibility":"public","websiteUrl":"https://catalogue-imos.aodn.org.au/geonetwork/srv/eng/catalog.search#/metadata/f098f0d0-88ac-4f4b-addb-24b3e5e8d0b9"}}