From 5ecdfd3340633db0455db1e4d08ff581ee14f105 Mon Sep 17 00:00:00 2001 From: Kevin Tyle Date: Wed, 7 Dec 2022 22:12:23 +0000 Subject: [PATCH 1/2] Revisions for current intake-esm --- notebooks/foundations/enhanced-catalog.ipynb | 3224 +++++++++++++++++- 1 file changed, 3124 insertions(+), 100 deletions(-) diff --git a/notebooks/foundations/enhanced-catalog.ipynb b/notebooks/foundations/enhanced-catalog.ipynb index 7295a6d..c06b2e5 100644 --- a/notebooks/foundations/enhanced-catalog.ipynb +++ b/notebooks/foundations/enhanced-catalog.ipynb @@ -26,7 +26,7 @@ "metadata": {}, "source": [ "## Overview\n", - "This notebook compares the original [Intake-ESM](https://intake-esm.readthedocs.io/en/stable/) catalog with an enhanced catalog that includes additional attributes. Both catalogs are an inventory of the NCAR Community Earth System Model (CESM) Large Ensemble (LENS) data hosted on AWS S3 ([doi:10.26024/wt24-5j82](https://doi.org/10.26024/wt24-5j82))." + "This notebook compares one [Intake-ESM](https://intake-esm.readthedocs.io/en/stable/) catalog with an enhanced version that includes additional attributes. Both catalogs are an inventory of the NCAR Community Earth System Model (CESM) Large Ensemble (LENS) data hosted on AWS S3 ([doi:10.26024/wt24-5j82](https://doi.org/10.26024/wt24-5j82))." ] }, { @@ -58,20 +58,12 @@ }, { "cell_type": "code", - "execution_count": null, + "execution_count": 1, "metadata": {}, "outputs": [], "source": [ "import intake\n", - "import pandas as pd\n", - "import pprint\n", - "\n", - "# Allow multiple lines per cell to be displayed without print (default is just last line)\n", - "from IPython.core.interactiveshell import InteractiveShell\n", - "InteractiveShell.ast_node_interactivity = \"all\"\n", - "\n", - "# Enable more explicit control of DataFrame display (e.g., to omit annoying line numbers)\n", - "from IPython.display import HTML" + "import pandas as pd" ] }, { @@ -85,70 +77,760 @@ "cell_type": "markdown", "metadata": {}, "source": [ - "Open the original collection description file:" + "At import time, the `intake-esm` plugin is available in `intake`’s registry as `esm_datastore` and can be accessed with `intake.open_esm_datastore()` function. " ] }, { "cell_type": "code", - "execution_count": null, + "execution_count": 2, "metadata": {}, - "outputs": [], + "outputs": [ + { + "data": { + "text/html": [ + "

aws-cesm1-le catalog with 56 dataset(s) from 442 asset(s):

\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
unique
variable78
long_name75
component5
experiment4
frequency6
vertical_levels3
spatial_domain5
units25
start_time12
end_time13
path427
derived_variable0
\n", + "
" + ], + "text/plain": [ + "" + ] + }, + "metadata": {}, + "output_type": "display_data" + } + ], "source": [ "cat_url_orig = 'https://ncar-cesm-lens.s3-us-west-2.amazonaws.com/catalogs/aws-cesm1-le.json'\n", - "coll_orig = intake.open_esm_datastore(cat_url_orig)" + "coll_orig = intake.open_esm_datastore(cat_url_orig)\n", + "coll_orig" + ] + }, + { + "cell_type": "markdown", + "metadata": {}, + "source": [ + "Here's a summary representation:" ] }, { "cell_type": "code", - "execution_count": null, + "execution_count": 3, "metadata": {}, - "outputs": [], + "outputs": [ + { + "name": "stdout", + "output_type": "stream", + "text": [ + "\n" + ] + } + ], "source": [ - "print(coll_orig.esmcol_data['description']) #Description of collection\n", - "print(\"Catalog file:\", coll_orig.esmcol_data['catalog_file'])\n", - "print(coll_orig) # Summary of collection structure" + "print(coll_orig)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ - "Show an expanded version of the collection structure with details:" + "In an Intake-ESM catalog object, the `esmcat` class provides many useful attributes and functions. For example, we can get the collection's description:" ] }, { "cell_type": "code", - "execution_count": null, + "execution_count": 4, "metadata": {}, - "outputs": [], + "outputs": [ + { + "data": { + "text/plain": [ + "'This is an ESM collection for CESM1 Large Ensemble Zarr dataset publicly available on Amazon S3 (us-west-2 region)'" + ] + }, + "execution_count": 4, + "metadata": {}, + "output_type": "execute_result" + } + ], "source": [ - "uniques_orig = coll_orig.unique(columns=[\"component\", \"frequency\", \"experiment\", \"variable\"])\n", - "pprint.pprint(uniques_orig, compact=True, indent=1, width=80)" + "coll_orig.esmcat.description" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ - "Show the first few lines of the catalog. There are as many lines as there are paths. The order is the same as that of the CSV catalog file listed in the JSON description file." + "We can also get the URL pointing to the catalog's underlying tabular representation:" ] }, { "cell_type": "code", - "execution_count": null, + "execution_count": 5, "metadata": {}, - "outputs": [], + "outputs": [ + { + "data": { + "text/plain": [ + "'https://ncar-cesm-lens.s3-us-west-2.amazonaws.com/catalogs/aws-cesm1-le.csv'" + ] + }, + "execution_count": 5, + "metadata": {}, + "output_type": "execute_result" + } + ], "source": [ - "print(\"Catalog file:\", coll_orig.esmcol_data['catalog_file'])\n", - "df = coll_orig.df\n", - "HTML(df.head(10).to_html(index=False))" + "coll_orig.esmcat.catalog_file" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ - "**Table**: First few lines of the original Intake-ESM catalog showing the model component, the temporal frequency, the experiment, the abbreviated variable name, and the AWS S3 path for each Zarr store." + "That's a CSV file ... let's take a peek." + ] + }, + { + "cell_type": "code", + "execution_count": 6, + "metadata": {}, + "outputs": [ + { + "data": { + "text/html": [ + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
variablelong_namecomponentexperimentfrequencyvertical_levelsspatial_domainunitsstart_timeend_timepath
0FLNSnet longwave flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS....
1FLNSCclearsky net longwave flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNSC...
2FLUTupwelling longwave flux at top of modelatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLUT....
3FSNSnet solar flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNS....
4FSNSCclearsky net solar flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNSC...
....................................
437WVELvertical velocityocnRCP85monthly60.0global_oceancentimeter/s2006-01-16 12:00:002100-12-16 12:00:00s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W...
438NaNNaNocnCTRLstaticNaNglobal_oceanNaNNaNNaNs3://ncar-cesm-lens/ocn/static/grid.zarr
439NaNNaNocnHISTstaticNaNglobal_oceanNaNNaNNaNs3://ncar-cesm-lens/ocn/static/grid.zarr
440NaNNaNocnRCP85staticNaNglobal_oceanNaNNaNNaNs3://ncar-cesm-lens/ocn/static/grid.zarr
441NaNNaNocn20CstaticNaNglobal_oceanNaNNaNNaNs3://ncar-cesm-lens/ocn/static/grid.zarr
\n", + "

442 rows × 11 columns

\n", + "
" + ], + "text/plain": [ + " variable long_name component experiment \\\n", + "0 FLNS net longwave flux at surface atm 20C \n", + "1 FLNSC clearsky net longwave flux at surface atm 20C \n", + "2 FLUT upwelling longwave flux at top of model atm 20C \n", + "3 FSNS net solar flux at surface atm 20C \n", + "4 FSNSC clearsky net solar flux at surface atm 20C \n", + ".. ... ... ... ... \n", + "437 WVEL vertical velocity ocn RCP85 \n", + "438 NaN NaN ocn CTRL \n", + "439 NaN NaN ocn HIST \n", + "440 NaN NaN ocn RCP85 \n", + "441 NaN NaN ocn 20C \n", + "\n", + " frequency vertical_levels spatial_domain units \\\n", + "0 daily 1.0 global W/m2 \n", + "1 daily 1.0 global W/m2 \n", + "2 daily 1.0 global W/m2 \n", + "3 daily 1.0 global W/m2 \n", + "4 daily 1.0 global W/m2 \n", + ".. ... ... ... ... \n", + "437 monthly 60.0 global_ocean centimeter/s \n", + "438 static NaN global_ocean NaN \n", + "439 static NaN global_ocean NaN \n", + "440 static NaN global_ocean NaN \n", + "441 static NaN global_ocean NaN \n", + "\n", + " start_time end_time \\\n", + "0 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", + "1 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", + "2 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", + "3 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", + "4 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", + ".. ... ... \n", + "437 2006-01-16 12:00:00 2100-12-16 12:00:00 \n", + "438 NaN NaN \n", + "439 NaN NaN \n", + "440 NaN NaN \n", + "441 NaN NaN \n", + "\n", + " path \n", + "0 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS.... \n", + "1 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNSC... \n", + "2 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLUT.... \n", + "3 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNS.... \n", + "4 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNSC... \n", + ".. ... \n", + "437 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... \n", + "438 s3://ncar-cesm-lens/ocn/static/grid.zarr \n", + "439 s3://ncar-cesm-lens/ocn/static/grid.zarr \n", + "440 s3://ncar-cesm-lens/ocn/static/grid.zarr \n", + "441 s3://ncar-cesm-lens/ocn/static/grid.zarr \n", + "\n", + "[442 rows x 11 columns]" + ] + }, + "execution_count": 6, + "metadata": {}, + "output_type": "execute_result" + } + ], + "source": [ + "df_orig = pd.read_csv(coll_orig.esmcat.catalog_file)\n", + "df_orig" + ] + }, + { + "cell_type": "markdown", + "metadata": {}, + "source": [ + "However, we can save a step since an ESM catalog object provides a `df` instance which returns a dataframe too:" + ] + }, + { + "cell_type": "code", + "execution_count": 7, + "metadata": {}, + "outputs": [ + { + "data": { + "text/html": [ + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
variablelong_namecomponentexperimentfrequencyvertical_levelsspatial_domainunitsstart_timeend_timepath
0FLNSnet longwave flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS....
1FLNSCclearsky net longwave flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNSC...
2FLUTupwelling longwave flux at top of modelatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLUT....
3FSNSnet solar flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNS....
4FSNSCclearsky net solar flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNSC...
....................................
437WVELvertical velocityocnRCP85monthly60.0global_oceancentimeter/s2006-01-16 12:00:002100-12-16 12:00:00s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W...
438NaNNaNocnCTRLstaticNaNglobal_oceanNaNNaNNaNs3://ncar-cesm-lens/ocn/static/grid.zarr
439NaNNaNocnHISTstaticNaNglobal_oceanNaNNaNNaNs3://ncar-cesm-lens/ocn/static/grid.zarr
440NaNNaNocnRCP85staticNaNglobal_oceanNaNNaNNaNs3://ncar-cesm-lens/ocn/static/grid.zarr
441NaNNaNocn20CstaticNaNglobal_oceanNaNNaNNaNs3://ncar-cesm-lens/ocn/static/grid.zarr
\n", + "

442 rows × 11 columns

\n", + "
" + ], + "text/plain": [ + " variable long_name component experiment \\\n", + "0 FLNS net longwave flux at surface atm 20C \n", + "1 FLNSC clearsky net longwave flux at surface atm 20C \n", + "2 FLUT upwelling longwave flux at top of model atm 20C \n", + "3 FSNS net solar flux at surface atm 20C \n", + "4 FSNSC clearsky net solar flux at surface atm 20C \n", + ".. ... ... ... ... \n", + "437 WVEL vertical velocity ocn RCP85 \n", + "438 NaN NaN ocn CTRL \n", + "439 NaN NaN ocn HIST \n", + "440 NaN NaN ocn RCP85 \n", + "441 NaN NaN ocn 20C \n", + "\n", + " frequency vertical_levels spatial_domain units \\\n", + "0 daily 1.0 global W/m2 \n", + "1 daily 1.0 global W/m2 \n", + "2 daily 1.0 global W/m2 \n", + "3 daily 1.0 global W/m2 \n", + "4 daily 1.0 global W/m2 \n", + ".. ... ... ... ... \n", + "437 monthly 60.0 global_ocean centimeter/s \n", + "438 static NaN global_ocean NaN \n", + "439 static NaN global_ocean NaN \n", + "440 static NaN global_ocean NaN \n", + "441 static NaN global_ocean NaN \n", + "\n", + " start_time end_time \\\n", + "0 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", + "1 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", + "2 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", + "3 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", + "4 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", + ".. ... ... \n", + "437 2006-01-16 12:00:00 2100-12-16 12:00:00 \n", + "438 NaN NaN \n", + "439 NaN NaN \n", + "440 NaN NaN \n", + "441 NaN NaN \n", + "\n", + " path \n", + "0 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS.... \n", + "1 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNSC... \n", + "2 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLUT.... \n", + "3 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNS.... \n", + "4 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNSC... \n", + ".. ... \n", + "437 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... \n", + "438 s3://ncar-cesm-lens/ocn/static/grid.zarr \n", + "439 s3://ncar-cesm-lens/ocn/static/grid.zarr \n", + "440 s3://ncar-cesm-lens/ocn/static/grid.zarr \n", + "441 s3://ncar-cesm-lens/ocn/static/grid.zarr \n", + "\n", + "[442 rows x 11 columns]" + ] + }, + "execution_count": 7, + "metadata": {}, + "output_type": "execute_result" + } + ], + "source": [ + "df_orig = coll_orig.df\n", + "df_orig" + ] + }, + { + "cell_type": "markdown", + "metadata": {}, + "source": [ + "Print out a sorted list of the unique values of selected columns" + ] + }, + { + "cell_type": "code", + "execution_count": 8, + "metadata": {}, + "outputs": [ + { + "name": "stdout", + "output_type": "stream", + "text": [ + "component: ['atm', 'ice_nh', 'ice_sh', 'lnd', 'ocn'] count: 5 \n", + "\n", + "frequency: ['daily', 'hourly6-1990-2005', 'hourly6-2026-2035', 'hourly6-2071-2080', 'monthly', 'static'] count: 6 \n", + "\n", + "experiment: ['20C', 'CTRL', 'HIST', 'RCP85'] count: 4 \n", + "\n", + "variable: ['DIC', 'DOC', 'FLNS', 'FLNSC', 'FLUT', 'FSNO', 'FSNS', 'FSNSC', 'FSNTOA', 'FW', 'H2OSNO', 'HMXL', 'ICEFRAC', 'LHFLX', 'O2', 'PD', 'PRECC', 'PRECL', 'PRECSC', 'PRECSL', 'PRECT', 'PRECTMX', 'PS', 'PSL', 'Q', 'Q850', 'QBOT', 'QFLUX', 'QREFHT', 'QRUNOFF', 'QSW_HBL', 'QSW_HTP', 'RAIN', 'RESID_S', 'SALT', 'SFWF', 'SFWF_WRST', 'SHF', 'SHFLX', 'SHF_QSW', 'SNOW', 'SOILLIQ', 'SOILWATER_10CM', 'SSH', 'SST', 'T', 'TAUX', 'TAUX2', 'TAUY', 'TAUY2', 'TEMP', 'TMQ', 'TREFHT', 'TREFHTMN', 'TREFHTMX', 'TREFMNAV_U', 'TREFMXAV_U', 'TS', 'U', 'UBOT', 'UES', 'UET', 'UVEL', 'V', 'VBOT', 'VNS', 'VNT', 'VVEL', 'WSPDSRFAV', 'WTS', 'WTT', 'WVEL', 'Z3', 'Z500', 'aice', 'aice_d', 'hi', 'hi_d'] count: 78 \n", + "\n" + ] + } + ], + "source": [ + "for col in ['component', 'frequency', 'experiment', 'variable']:\n", + " unique_vals = coll_orig.unique()[col]\n", + " unique_vals.sort()\n", + " count = len(unique_vals)\n", + " print (col + ': ' ,unique_vals, \" count: \", count, '\\n')" ] }, { @@ -167,12 +849,264 @@ }, { "cell_type": "code", - "execution_count": null, + "execution_count": 9, "metadata": {}, - "outputs": [], + "outputs": [ + { + "data": { + "text/html": [ + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
variablelong_namecomponentexperimentfrequencyvertical_levelsspatial_domainunitsstart_timeend_timepath
0FLNSnet longwave flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS....
1FLNSnet longwave flux at surfaceatmCTRLdaily1.0globalW/m20402-01-01 12:00:002200-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-CTRL-FLNS...
2FLNSnet longwave flux at surfaceatmHISTdaily1.0globalW/m21850-01-01 12:00:001919-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-HIST-FLNS...
3FLNSnet longwave flux at surfaceatmRCP85daily1.0globalW/m22006-01-01 12:00:002100-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-RCP85-FLN...
4FLNSnet longwave flux at surfaceatm20Chourly6-1990-20051.0globalW/m21990-01-01 00:00:002006-01-01 00:00:00s3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm...
5FLNSnet longwave flux at surfaceatmRCP85hourly6-2026-20351.0globalW/m22026-01-01 00:00:002036-01-01 00:00:00s3://ncar-cesm-lens/atm/hourly6-2026-2035/cesm...
6FLNSnet longwave flux at surfaceatmRCP85hourly6-2071-20801.0globalW/m22071-01-01 00:00:002081-01-01 00:00:00s3://ncar-cesm-lens/atm/hourly6-2071-2080/cesm...
7FLNSnet longwave flux at surfaceatm20Cmonthly1.0globalW/m21920-01-16 12:00:002005-12-16 12:00:00s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-FLN...
8FLNSnet longwave flux at surfaceatmCTRLmonthly1.0globalW/m20400-01-16 12:00:002200-12-16 12:00:00s3://ncar-cesm-lens/atm/monthly/cesmLE-CTRL-FL...
9FLNSnet longwave flux at surfaceatmHISTmonthly1.0globalW/m21850-01-16 12:00:001919-12-16 12:00:00s3://ncar-cesm-lens/atm/monthly/cesmLE-HIST-FL...
10FLNSnet longwave flux at surfaceatmRCP85monthly1.0globalW/m22006-01-16 12:00:002100-12-16 12:00:00s3://ncar-cesm-lens/atm/monthly/cesmLE-RCP85-F...
\n", + "
" + ], + "text/plain": [ + " variable long_name component experiment \\\n", + "0 FLNS net longwave flux at surface atm 20C \n", + "1 FLNS net longwave flux at surface atm CTRL \n", + "2 FLNS net longwave flux at surface atm HIST \n", + "3 FLNS net longwave flux at surface atm RCP85 \n", + "4 FLNS net longwave flux at surface atm 20C \n", + "5 FLNS net longwave flux at surface atm RCP85 \n", + "6 FLNS net longwave flux at surface atm RCP85 \n", + "7 FLNS net longwave flux at surface atm 20C \n", + "8 FLNS net longwave flux at surface atm CTRL \n", + "9 FLNS net longwave flux at surface atm HIST \n", + "10 FLNS net longwave flux at surface atm RCP85 \n", + "\n", + " frequency vertical_levels spatial_domain units \\\n", + "0 daily 1.0 global W/m2 \n", + "1 daily 1.0 global W/m2 \n", + "2 daily 1.0 global W/m2 \n", + "3 daily 1.0 global W/m2 \n", + "4 hourly6-1990-2005 1.0 global W/m2 \n", + "5 hourly6-2026-2035 1.0 global W/m2 \n", + "6 hourly6-2071-2080 1.0 global W/m2 \n", + "7 monthly 1.0 global W/m2 \n", + "8 monthly 1.0 global W/m2 \n", + "9 monthly 1.0 global W/m2 \n", + "10 monthly 1.0 global W/m2 \n", + "\n", + " start_time end_time \\\n", + "0 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", + "1 0402-01-01 12:00:00 2200-12-31 12:00:00 \n", + "2 1850-01-01 12:00:00 1919-12-31 12:00:00 \n", + "3 2006-01-01 12:00:00 2100-12-31 12:00:00 \n", + "4 1990-01-01 00:00:00 2006-01-01 00:00:00 \n", + "5 2026-01-01 00:00:00 2036-01-01 00:00:00 \n", + "6 2071-01-01 00:00:00 2081-01-01 00:00:00 \n", + "7 1920-01-16 12:00:00 2005-12-16 12:00:00 \n", + "8 0400-01-16 12:00:00 2200-12-16 12:00:00 \n", + "9 1850-01-16 12:00:00 1919-12-16 12:00:00 \n", + "10 2006-01-16 12:00:00 2100-12-16 12:00:00 \n", + "\n", + " path \n", + "0 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS.... \n", + "1 s3://ncar-cesm-lens/atm/daily/cesmLE-CTRL-FLNS... \n", + "2 s3://ncar-cesm-lens/atm/daily/cesmLE-HIST-FLNS... \n", + "3 s3://ncar-cesm-lens/atm/daily/cesmLE-RCP85-FLN... \n", + "4 s3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm... \n", + "5 s3://ncar-cesm-lens/atm/hourly6-2026-2035/cesm... \n", + "6 s3://ncar-cesm-lens/atm/hourly6-2071-2080/cesm... \n", + "7 s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-FLN... \n", + "8 s3://ncar-cesm-lens/atm/monthly/cesmLE-CTRL-FL... \n", + "9 s3://ncar-cesm-lens/atm/monthly/cesmLE-HIST-FL... \n", + "10 s3://ncar-cesm-lens/atm/monthly/cesmLE-RCP85-F... " + ] + }, + "execution_count": 9, + "metadata": {}, + "output_type": "execute_result" + } + ], "source": [ "df = coll_orig.search(variable='FLNS').df\n", - "HTML(df.to_html(index=False))" + "df" ] }, { @@ -184,63 +1118,225 @@ }, { "cell_type": "code", - "execution_count": null, + "execution_count": 11, "metadata": {}, - "outputs": [], + "outputs": [ + { + "data": { + "text/html": [ + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
variablelong_namecomponentexperimentfrequencyvertical_levelsspatial_domainunitsstart_timeend_timepath
0FLNSnet longwave flux at surfaceatmRCP85daily1.0globalW/m22006-01-01 12:00:002100-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-RCP85-FLN...
\n", + "
" + ], + "text/plain": [ + " variable long_name component experiment frequency \\\n", + "0 FLNS net longwave flux at surface atm RCP85 daily \n", + "\n", + " vertical_levels spatial_domain units start_time \\\n", + "0 1.0 global W/m2 2006-01-01 12:00:00 \n", + "\n", + " end_time path \n", + "0 2100-12-31 12:00:00 s3://ncar-cesm-lens/atm/daily/cesmLE-RCP85-FLN... " + ] + }, + "execution_count": 11, + "metadata": {}, + "output_type": "execute_result" + } + ], "source": [ "df = coll_orig.search(variable='FLNS', frequency='daily', experiment='RCP85').df\n", - "HTML(df.to_html(index=False))" + "df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ - "## The Problem" + "
The problem: Do all potential users know that `FLNS` is a CESM-specific abbreviation for \"net longwave flux at surface”? How would a novice user find out, other than by finding separate documentation, or by opening a Zarr store in the hopes that the long name might be recorded there? How do we address the fact that every climate model code seems to have a different, non-standard name for all the variables, thus making multi-source research needlessly difficult?
" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ - "Do all potential users know that `FLNS` is a CESM-specific abbreviation for “Net longwave flux at surface”? How would a novice user find out, other than by finding separate documentation, or by opening a Zarr store in the hopes that the long name might be recorded there? How do we address the fact that every climate model code seems to have a different, non-standard name for all the variables, thus making multi-source research needlessly difficult?" + "
The solution:
\n", + "

Enhanced Intake-ESM Catalog!

" ] }, { "cell_type": "markdown", - "metadata": { - "tags": [] - }, + "metadata": {}, "source": [ - "## Enhanced Intake-ESM Catalog" + "By adding additional columns to the Intake-ESM catalog, we should be able to improve semantic interoperability and provide potentially useful information to the users. Let's now open the *enhanced* collection description file:" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ - "By adding additional columns to the Intake-ESM catalog, we should be able to improve semantic interoperability and provide potentially useful information to the users. Let's now open the enhanced collection description file:" + "
Note: The URL for the enhanced catalog differs from the original only in that it has -enhanced appended to aws-cesm1-le
" ] }, { "cell_type": "code", - "execution_count": null, + "execution_count": 12, "metadata": {}, - "outputs": [], + "outputs": [ + { + "data": { + "text/html": [ + "

aws-cesm1-le catalog with 27 dataset(s) from 365 asset(s):

\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
unique
component5
dim2
frequency5
experiment6
start10
end11
variable75
long_name75
path365
derived_variable0
\n", + "
" + ], + "text/plain": [ + "" + ] + }, + "metadata": {}, + "output_type": "display_data" + } + ], "source": [ "cat_url = 'https://ncar-cesm-lens.s3-us-west-2.amazonaws.com/catalogs/aws-cesm1-le-enhanced.json'\n", "coll = intake.open_esm_datastore(cat_url)\n", "coll" ] }, + { + "cell_type": "markdown", + "metadata": {}, + "source": [ + "As we did for the first catalog, let's obtain the `description` and `catalog_file` attributes." + ] + }, { "cell_type": "code", - "execution_count": null, + "execution_count": 13, "metadata": {}, - "outputs": [], + "outputs": [ + { + "name": "stdout", + "output_type": "stream", + "text": [ + "This is an inventory of the Community Earth System Model (CESM) Large Ensemble (LENS) dataset in Zarr format publicly available on Amazon S3 (https://doi.org/10.26024/wt24-5j82)\n", + "Catalog file: https://ncar-cesm-lens.s3-us-west-2.amazonaws.com/catalogs/aws-cesm1-le-enhanced.csv\n", + "\n" + ] + } + ], "source": [ - "print(coll.esmcol_data['description']) # Description of collection\n", - "print(\"Catalog file:\", coll.esmcol_data['catalog_file'])\n", + "print(coll.esmcat.description) # Description of collection\n", + "print(\"Catalog file:\", coll.esmcat.catalog_file)\n", "print(coll) # Summary of collection structure" ] }, @@ -257,53 +1353,360 @@ "cell_type": "markdown", "metadata": {}, "source": [ - "In the summary above, note the addition of additional elements: `long_name`, `start`, `end`, and `dim`. Here are the first few lines of the enhanced catalog:" + "In the catalog's representation above, note the addition of additional elements: `long_name`, `start`, `end`, and `dim`. Here are the first/last few lines of the enhanced catalog:" ] }, { "cell_type": "code", - "execution_count": null, + "execution_count": 14, "metadata": {}, - "outputs": [], + "outputs": [ + { + "data": { + "text/html": [ + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
componentdimfrequencyexperimentstartendvariablelong_namepath
0atm2DmonthlyHIST1850-011919-12FLNSNet longwave flux at surfaces3://ncar-cesm-lens/atm/monthly/cesmLE-HIST-FL...
1atm2Dmonthly20C1920-012005-12FLNSNet longwave flux at surfaces3://ncar-cesm-lens/atm/monthly/cesmLE-20C-FLN...
2atm2Ddaily20C1920-01-012005-12-31FLNSNet longwave flux at surfaces3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS....
3atm2DmonthlyRCP852006-012100-12FLNSNet longwave flux at surfaces3://ncar-cesm-lens/atm/monthly/cesmLE-RCP85-F...
4atm2DdailyRCP852006-01-012100-12-31FLNSNet longwave flux at surfaces3://ncar-cesm-lens/atm/daily/cesmLE-RCP85-FLN...
..............................
360ice_sh2DdailyRCP852006-01-012100-12-31aice_dice area, aggregate (daily)s3://ncar-cesm-lens/ice_sh/daily/cesmLE-RCP85-...
361ice_sh2Dmonthly20C1920-012005-12higrid cellmean ice thicknesss3://ncar-cesm-lens/ice_sh/monthly/cesmLE-20C-...
362ice_sh2DmonthlyRCP852006-012100-12higrid cellmean ice thicknesss3://ncar-cesm-lens/ice_sh/monthly/cesmLE-RCP8...
363ice_sh2Ddaily20C1920-01-012005-12-31hi_dgrid cellmean ice thicknesss3://ncar-cesm-lens/ice_sh/daily/cesmLE-20C-hi...
364ice_sh2DdailyRCP852006-01-012100-12-31hi_dgrid cellmean ice thicknesss3://ncar-cesm-lens/ice_sh/daily/cesmLE-RCP85-...
\n", + "

365 rows × 9 columns

\n", + "
" + ], + "text/plain": [ + " component dim frequency experiment start end variable \\\n", + "0 atm 2D monthly HIST 1850-01 1919-12 FLNS \n", + "1 atm 2D monthly 20C 1920-01 2005-12 FLNS \n", + "2 atm 2D daily 20C 1920-01-01 2005-12-31 FLNS \n", + "3 atm 2D monthly RCP85 2006-01 2100-12 FLNS \n", + "4 atm 2D daily RCP85 2006-01-01 2100-12-31 FLNS \n", + ".. ... .. ... ... ... ... ... \n", + "360 ice_sh 2D daily RCP85 2006-01-01 2100-12-31 aice_d \n", + "361 ice_sh 2D monthly 20C 1920-01 2005-12 hi \n", + "362 ice_sh 2D monthly RCP85 2006-01 2100-12 hi \n", + "363 ice_sh 2D daily 20C 1920-01-01 2005-12-31 hi_d \n", + "364 ice_sh 2D daily RCP85 2006-01-01 2100-12-31 hi_d \n", + "\n", + " long_name \\\n", + "0 Net longwave flux at surface \n", + "1 Net longwave flux at surface \n", + "2 Net longwave flux at surface \n", + "3 Net longwave flux at surface \n", + "4 Net longwave flux at surface \n", + ".. ... \n", + "360 ice area, aggregate (daily) \n", + "361 grid cellmean ice thickness \n", + "362 grid cellmean ice thickness \n", + "363 grid cellmean ice thickness \n", + "364 grid cellmean ice thickness \n", + "\n", + " path \n", + "0 s3://ncar-cesm-lens/atm/monthly/cesmLE-HIST-FL... \n", + "1 s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-FLN... \n", + "2 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS.... \n", + "3 s3://ncar-cesm-lens/atm/monthly/cesmLE-RCP85-F... \n", + "4 s3://ncar-cesm-lens/atm/daily/cesmLE-RCP85-FLN... \n", + ".. ... \n", + "360 s3://ncar-cesm-lens/ice_sh/daily/cesmLE-RCP85-... \n", + "361 s3://ncar-cesm-lens/ice_sh/monthly/cesmLE-20C-... \n", + "362 s3://ncar-cesm-lens/ice_sh/monthly/cesmLE-RCP8... \n", + "363 s3://ncar-cesm-lens/ice_sh/daily/cesmLE-20C-hi... \n", + "364 s3://ncar-cesm-lens/ice_sh/daily/cesmLE-RCP85-... \n", + "\n", + "[365 rows x 9 columns]" + ] + }, + "execution_count": 14, + "metadata": {}, + "output_type": "execute_result" + } + ], "source": [ - "print(\"Catalog file:\", coll.esmcol_data['catalog_file'])\n", - "HTML(coll.df.head(10).to_html(index=False))" + "df_enh = coll.df\n", + "df_enh" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ - "**Table**: First few lines of the enhanced catalog, listing of the same information as the original catalog as well as the long name of each variable and an indication of whether each variable is 2D or 3D." + "
\n", + "

Warning

\n", + " The long_names are not CF Standard Names, but rather are those documented at \n", + "the NCAR LENS website. For interoperability, the long_name column should be replaced by a cf_name column and possibly an attribute column to disambiguate if needed.\n", + "
" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ - "
\n", - "

Warning

\n", - " The long names are not CF Standard Names, but rather are those documented at \n", - "http://www.cgd.ucar.edu/ccr/strandwg/CESM-CAM5-BGC_LENS_fields.html. For interoperability, the long_name column should be replaced by a cf_name column and possibly an attribute column to disambiguate if needed.\n", - "
" + "List all available variables by long name, sorted alphabetically:" + ] + }, + { + "cell_type": "code", + "execution_count": 15, + "metadata": {}, + "outputs": [ + { + "name": "stdout", + "output_type": "stream", + "text": [ + "Clearsky net longwave flux at surface\n", + "Clearsky net solar flux at surface\n", + "Convective precipitation rate (liq + ice)\n", + "Convective snow rate (water equivalent)\n", + "Dissolved Inorganic Carbon\n", + "Dissolved Organic Carbon\n", + "Dissolved Oxygen\n", + "Fraction of sfc area covered by sea-ice\n", + "Free-Surface Residual Heat Flux\n", + "Free-Surface Residual Salt Flux\n", + "Freshwater Flux\n", + "Geopotential Height (above sea level)\n", + "Geopotential Z at 500 mbar pressure surface\n", + "Heat Flux across top face\n", + "Heat Flux in grid-x direction\n", + "Heat Flux in grid-y direction\n", + "Horizontal total wind speed average at the surface\n", + "Internal Ocean Heat Flux Due to Ice Formation\n", + "Large-scale (stable) precipitation rate (liq + ice)\n", + "Large-scale (stable) snow rate (water equivalent)\n", + "Lowest model level zonal wind\n", + "Maximum (convective and large-scale) precipitation rate (liq+ice)\n", + "Maximum reference height temperature over output period\n", + "Meridional wind\n", + "Minimum reference height temperature over output period\n", + "Mixed-Layer Depth\n", + "Net longwave flux at surface\n", + "Net solar flux at surface\n", + "Net solar flux at top of atmosphere\n", + "Potential Density Ref to Surface\n", + "Potential Temperature\n", + "Reference height humidity\n", + "Reference height temperature\n", + "Salinity\n", + "Salt Flux across top face\n", + "Salt Flux in grid-x direction\n", + "Salt Flux in grid-y direction\n", + "Sea Surface Height\n", + "Sea level pressure\n", + "Solar Short-Wave Heat Flux\n", + "Solar Short-Wave Heat Flux in boundary layer\n", + "Solar Short-Wave Heat Flux in top layer\n", + "Specific Humidity at 850 mbar pressure surface\n", + "Specific humidity\n", + "Surface latent heat flux\n", + "Surface pressure\n", + "Surface sensible heat flux\n", + "Surface temperature (radiative)\n", + "Temperature\n", + "Total (convective and large-scale) precipitation rate (liq + ice)\n", + "Total (vertically integrated) precipitable water\n", + "Total Surface Heat Flux including short-wave\n", + "Upwelling longwave flux at top of model\n", + "Velocity in grid-x direction\n", + "Velocity in grid-y direction\n", + "Vertical Velocity\n", + "Virtual Salt Flux due to weak restoring\n", + "Virtual Salt Flux in FW Flux formulation\n", + "Wind stress (squared) in grid-x direction\n", + "Wind stress (squared) in grid-y direction\n", + "Wind stress in grid-x direction\n", + "Wind stress in grid-y direction\n", + "Zonal wind\n", + "atmospheric rain\n", + "atmospheric snow\n", + "fraction of ground covered by snow\n", + "grid cellmean ice thickness\n", + "grid cellmean ice thickness (daily)\n", + "grid cellmean ice thickness (monthly)\n", + "ice area, aggregate (daily)\n", + "ice area, aggregate (monthly)\n", + "snow depth (liquid water)\n", + "soil liquid water (vegetated landunits only)\n", + "soil liquid water + ice in top 10cm of soil (veg landunits only)\n", + "total liquid runoff (does not include QSNWCPICE)\n" + ] + } + ], + "source": [ + "nameList = coll.unique()['long_name']\n", + "nameList.sort()\n", + "print(*nameList, sep='\\n')" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ - "List all available variables by long name, sorted alphabetically:" + "## Search capabilities" ] }, { - "cell_type": "code", - "execution_count": null, + "cell_type": "markdown", "metadata": {}, - "outputs": [], "source": [ - "uniques = coll.unique(columns=['long_name'])\n", - "nameList = sorted(uniques['long_name']['values'])\n", - "print(*nameList, sep='\\n') #note *list to unpack each item for print function" + "We can use an `intake-esm` catalog object's `search` function in several ways: " ] }, { @@ -315,12 +1718,320 @@ }, { "cell_type": "code", - "execution_count": null, + "execution_count": 16, "metadata": {}, - "outputs": [], + "outputs": [ + { + "data": { + "text/html": [ + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
componentdimfrequencyexperimentstartendvariablelong_namepath
0ocn3Dmonthly20C1920-012005-12SALTSalinitys3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-SAL...
1ocn3DmonthlyRCP852006-012100-12SALTSalinitys3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-S...
2ocn3DmonthlyCTRL0400-012200-12SALTSalinitys3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-SA...
\n", + "
" + ], + "text/plain": [ + " component dim frequency experiment start end variable long_name \\\n", + "0 ocn 3D monthly 20C 1920-01 2005-12 SALT Salinity \n", + "1 ocn 3D monthly RCP85 2006-01 2100-12 SALT Salinity \n", + "2 ocn 3D monthly CTRL 0400-01 2200-12 SALT Salinity \n", + "\n", + " path \n", + "0 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-SAL... \n", + "1 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-S... \n", + "2 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-SA... " + ] + }, + "execution_count": 16, + "metadata": {}, + "output_type": "execute_result" + } + ], "source": [ "myName = 'Salinity'\n", - "HTML(coll.search(long_name=myName).df.to_html(index=False))" + "df = coll.search(long_name=myName).df\n", + "df" + ] + }, + { + "cell_type": "markdown", + "metadata": {}, + "source": [ + "Search based on multiple criteria:" + ] + }, + { + "cell_type": "code", + "execution_count": 17, + "metadata": {}, + "outputs": [ + { + "data": { + "text/html": [ + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
componentdimfrequencyexperimentstartendvariablelong_namepath
0atm3Dmonthly20C1920-012005-12QSpecific humiditys3://ncar-cesm-lens/atm/monthly/cesmLE-20C-Q.zarr
1atm3Dhourly6-1990-200520C1990-01-01T002005-12-31T18QSpecific humiditys3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm...
2atm3DmonthlyRCP852006-012100-12QSpecific humiditys3://ncar-cesm-lens/atm/monthly/cesmLE-RCP85-Q...
3atm3Dhourly6-2026-2035RCP852026-01-01T002035-12-31T18QSpecific humiditys3://ncar-cesm-lens/atm/hourly6-2026-2035/cesm...
4atm3Dhourly6-2071-2080RCP852071-01-01T002080-12-31T18QSpecific humiditys3://ncar-cesm-lens/atm/hourly6-2071-2080/cesm...
5atm3Dmonthly20C1920-012005-12TTemperatures3://ncar-cesm-lens/atm/monthly/cesmLE-20C-T.zarr
6atm3Dhourly6-1990-200520C1990-01-01T002005-12-31T18TTemperatures3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm...
7atm3DmonthlyRCP852006-012100-12TTemperatures3://ncar-cesm-lens/atm/monthly/cesmLE-RCP85-T...
8atm3Dhourly6-2026-2035RCP852026-01-01T002035-12-31T18TTemperatures3://ncar-cesm-lens/atm/hourly6-2026-2035/cesm...
9atm3Dhourly6-2071-2080RCP852071-01-01T002080-12-31T18TTemperatures3://ncar-cesm-lens/atm/hourly6-2071-2080/cesm...
\n", + "
" + ], + "text/plain": [ + " component dim frequency experiment start end \\\n", + "0 atm 3D monthly 20C 1920-01 2005-12 \n", + "1 atm 3D hourly6-1990-2005 20C 1990-01-01T00 2005-12-31T18 \n", + "2 atm 3D monthly RCP85 2006-01 2100-12 \n", + "3 atm 3D hourly6-2026-2035 RCP85 2026-01-01T00 2035-12-31T18 \n", + "4 atm 3D hourly6-2071-2080 RCP85 2071-01-01T00 2080-12-31T18 \n", + "5 atm 3D monthly 20C 1920-01 2005-12 \n", + "6 atm 3D hourly6-1990-2005 20C 1990-01-01T00 2005-12-31T18 \n", + "7 atm 3D monthly RCP85 2006-01 2100-12 \n", + "8 atm 3D hourly6-2026-2035 RCP85 2026-01-01T00 2035-12-31T18 \n", + "9 atm 3D hourly6-2071-2080 RCP85 2071-01-01T00 2080-12-31T18 \n", + "\n", + " variable long_name \\\n", + "0 Q Specific humidity \n", + "1 Q Specific humidity \n", + "2 Q Specific humidity \n", + "3 Q Specific humidity \n", + "4 Q Specific humidity \n", + "5 T Temperature \n", + "6 T Temperature \n", + "7 T Temperature \n", + "8 T Temperature \n", + "9 T Temperature \n", + "\n", + " path \n", + "0 s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-Q.zarr \n", + "1 s3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm... \n", + "2 s3://ncar-cesm-lens/atm/monthly/cesmLE-RCP85-Q... \n", + "3 s3://ncar-cesm-lens/atm/hourly6-2026-2035/cesm... \n", + "4 s3://ncar-cesm-lens/atm/hourly6-2071-2080/cesm... \n", + "5 s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-T.zarr \n", + "6 s3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm... \n", + "7 s3://ncar-cesm-lens/atm/monthly/cesmLE-RCP85-T... \n", + "8 s3://ncar-cesm-lens/atm/hourly6-2026-2035/cesm... \n", + "9 s3://ncar-cesm-lens/atm/hourly6-2071-2080/cesm... " + ] + }, + "execution_count": 17, + "metadata": {}, + "output_type": "execute_result" + } + ], + "source": [ + "df = coll.search(experiment=['20C','RCP85'], dim='3D', variable=['T','Q']).df\n", + "df" ] }, { @@ -334,51 +2045,362 @@ "cell_type": "markdown", "metadata": {}, "source": [ - "The current version of the Intake-ESM `.search()` function requires an exact full-string case-sensitive match of `long_name`. (This has been reported as an issue at [https://github.com/NCAR/cesm-lens-aws/issues/48](https://github.com/NCAR/cesm-lens-aws/issues/48)). Demonstrate a work-around: find all variables with a particular substring in the long name" + "In some cases, you may not know the exact term to look for. For such cases, inkake-esm supports searching for substring matches. With use of wildcards and/or regular expressions, we can find all items with a particular substring in a given column. Let’s search for:\n", + "- entries from experiment = ‘20C’\n", + "- all entries whose variable long name contains wind" ] }, { "cell_type": "code", - "execution_count": null, + "execution_count": 18, "metadata": {}, "outputs": [], "source": [ - "myTerm = 'Wind'\n", - "myTerm = myTerm.lower() #search regardless of case\n", - "partials = [name for name in nameList if myTerm in name.lower()]\n", - "print(f\"All datasets with name containing {myTerm}:\")\n", - "print(*partials, sep='\\n')" + "coll_subset = coll.search(experiment=\"20C\", long_name=\"Wind*\")" + ] + }, + { + "cell_type": "code", + "execution_count": 19, + "metadata": {}, + "outputs": [ + { + "data": { + "text/html": [ + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
componentdimfrequencyexperimentstartendvariablelong_namepath
0ocn2Dmonthly20C1920-012005-12TAUXWind stress in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU...
1ocn2Dmonthly20C1920-012005-12TAUX2Wind stress (squared) in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU...
2ocn2Dmonthly20C1920-012005-12TAUYWind stress in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU...
3ocn2Dmonthly20C1920-012005-12TAUY2Wind stress (squared) in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU...
\n", + "
" + ], + "text/plain": [ + " component dim frequency experiment start end variable \\\n", + "0 ocn 2D monthly 20C 1920-01 2005-12 TAUX \n", + "1 ocn 2D monthly 20C 1920-01 2005-12 TAUX2 \n", + "2 ocn 2D monthly 20C 1920-01 2005-12 TAUY \n", + "3 ocn 2D monthly 20C 1920-01 2005-12 TAUY2 \n", + "\n", + " long_name \\\n", + "0 Wind stress in grid-x direction \n", + "1 Wind stress (squared) in grid-x direction \n", + "2 Wind stress in grid-y direction \n", + "3 Wind stress (squared) in grid-y direction \n", + "\n", + " path \n", + "0 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU... \n", + "1 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU... \n", + "2 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU... \n", + "3 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU... " + ] + }, + "execution_count": 19, + "metadata": {}, + "output_type": "execute_result" + } + ], + "source": [ + "coll_subset.df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ - "Display full table for each match (could be lengthy if many matches):" + "If we wanted to search for Wind and wind, we can take advantage of [regular expression](https://docs.python.org/3/library/re.html) syntax to do so:" ] }, { "cell_type": "code", - "execution_count": null, + "execution_count": 21, "metadata": {}, "outputs": [], "source": [ - "for name in partials:\n", - " df = coll.search(long_name=name).df[['component', 'dim', 'experiment', 'variable', 'long_name']]\n", - " HTML(df.to_html(index=False))\n", - " ###df.head(1) #show only first entry in each group for compactness\n", - " # Note: It is also possible to hide column(s) instead of specifying desired columns\n", - " ###coll.search(long_name=name).df.drop(columns=['path'])" + "coll_subset = coll.search(experiment=\"20C\" , long_name=\"[Ww]ind*\")" ] }, { - "cell_type": "markdown", + "cell_type": "code", + "execution_count": 22, "metadata": {}, + "outputs": [ + { + "data": { + "text/html": [ + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
componentdimfrequencyexperimentstartendvariablelong_namepath
0atm3Dmonthly20C1920-012005-12UZonal winds3://ncar-cesm-lens/atm/monthly/cesmLE-20C-U.zarr
1atm3Dhourly6-1990-200520C1990-01-01T002005-12-31T18UZonal winds3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm...
2atm2Ddaily20C1920-01-012005-12-31UBOTLowest model level zonal winds3://ncar-cesm-lens/atm/daily/cesmLE-20C-UBOT....
3atm3Dmonthly20C1920-012005-12VMeridional winds3://ncar-cesm-lens/atm/monthly/cesmLE-20C-V.zarr
4atm3Dhourly6-1990-200520C1990-01-01T002005-12-31T18VMeridional winds3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm...
5atm2Ddaily20C1920-01-012005-12-31WSPDSRFAVHorizontal total wind speed average at the sur...s3://ncar-cesm-lens/atm/daily/cesmLE-20C-WSPDS...
6ocn2Dmonthly20C1920-012005-12TAUXWind stress in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU...
7ocn2Dmonthly20C1920-012005-12TAUX2Wind stress (squared) in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU...
8ocn2Dmonthly20C1920-012005-12TAUYWind stress in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU...
9ocn2Dmonthly20C1920-012005-12TAUY2Wind stress (squared) in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU...
\n", + "
" + ], + "text/plain": [ + " component dim frequency experiment start end \\\n", + "0 atm 3D monthly 20C 1920-01 2005-12 \n", + "1 atm 3D hourly6-1990-2005 20C 1990-01-01T00 2005-12-31T18 \n", + "2 atm 2D daily 20C 1920-01-01 2005-12-31 \n", + "3 atm 3D monthly 20C 1920-01 2005-12 \n", + "4 atm 3D hourly6-1990-2005 20C 1990-01-01T00 2005-12-31T18 \n", + "5 atm 2D daily 20C 1920-01-01 2005-12-31 \n", + "6 ocn 2D monthly 20C 1920-01 2005-12 \n", + "7 ocn 2D monthly 20C 1920-01 2005-12 \n", + "8 ocn 2D monthly 20C 1920-01 2005-12 \n", + "9 ocn 2D monthly 20C 1920-01 2005-12 \n", + "\n", + " variable long_name \\\n", + "0 U Zonal wind \n", + "1 U Zonal wind \n", + "2 UBOT Lowest model level zonal wind \n", + "3 V Meridional wind \n", + "4 V Meridional wind \n", + "5 WSPDSRFAV Horizontal total wind speed average at the sur... \n", + "6 TAUX Wind stress in grid-x direction \n", + "7 TAUX2 Wind stress (squared) in grid-x direction \n", + "8 TAUY Wind stress in grid-y direction \n", + "9 TAUY2 Wind stress (squared) in grid-y direction \n", + "\n", + " path \n", + "0 s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-U.zarr \n", + "1 s3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm... \n", + "2 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-UBOT.... \n", + "3 s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-V.zarr \n", + "4 s3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm... \n", + "5 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-WSPDS... \n", + "6 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU... \n", + "7 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU... \n", + "8 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU... \n", + "9 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU... " + ] + }, + "execution_count": 22, + "metadata": {}, + "output_type": "execute_result" + } + ], "source": [ - "
\n", - "

Warning

\n", - " The case-insensitive substring matching is not integrated into Intake-ESM, so it is not clear whether resulting search results can be passed directly to Xarray to read data.\n", - "
" + "coll_subset.df" ] }, { @@ -397,12 +2419,737 @@ }, { "cell_type": "code", - "execution_count": null, + "execution_count": 23, "metadata": {}, - "outputs": [], + "outputs": [ + { + "data": { + "text/html": [ + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
componentdimfrequencyexperimentstartendvariablelong_namepath
0ocn3Dmonthly20C1920-012005-12DICDissolved Inorganic Carbons3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-DIC...
1ocn3DmonthlyRCP852006-012100-12DICDissolved Inorganic Carbons3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-D...
2ocn3DmonthlyCTRL0400-012200-12DICDissolved Inorganic Carbons3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-DI...
3ocn3Dmonthly20C1920-012005-12DOCDissolved Organic Carbons3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-DOC...
4ocn3DmonthlyRCP852006-012100-12DOCDissolved Organic Carbons3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-D...
5ocn3DmonthlyCTRL0400-012200-12DOCDissolved Organic Carbons3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-DO...
6ocn3Dmonthly20C1920-012005-12O2Dissolved Oxygens3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-O2....
7ocn3DmonthlyRCP852006-012100-12O2Dissolved Oxygens3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-O...
8ocn3DmonthlyCTRL0400-012200-12O2Dissolved Oxygens3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-O2...
9ocn3Dmonthly20C1920-012005-12PDPotential Density Ref to Surfaces3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-PD....
10ocn3DmonthlyRCP852006-012100-12PDPotential Density Ref to Surfaces3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-P...
11ocn3DmonthlyCTRL0400-012200-12PDPotential Density Ref to Surfaces3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-PD...
12ocn3Dmonthly20C1920-012005-12SALTSalinitys3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-SAL...
13ocn3DmonthlyRCP852006-012100-12SALTSalinitys3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-S...
14ocn3DmonthlyCTRL0400-012200-12SALTSalinitys3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-SA...
15ocn3Dmonthly20C1920-012005-12TEMPPotential Temperatures3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TEM...
16ocn3DmonthlyRCP852006-012100-12TEMPPotential Temperatures3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-T...
17ocn3DmonthlyCTRL0400-012200-12TEMPPotential Temperatures3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-TE...
18ocn3Dmonthly20C1920-012005-12UESSalt Flux in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-UES...
19ocn3DmonthlyRCP852006-012100-12UESSalt Flux in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U...
20ocn3DmonthlyCTRL0400-012200-12UESSalt Flux in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-UE...
21ocn3Dmonthly20C1920-012005-12UETHeat Flux in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-UET...
22ocn3DmonthlyRCP852006-012100-12UETHeat Flux in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U...
23ocn3DmonthlyCTRL0400-012200-12UETHeat Flux in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-UE...
24ocn3Dmonthly20C1920-012005-12UVELVelocity in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-UVE...
25ocn3DmonthlyRCP852006-012100-12UVELVelocity in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U...
26ocn3DmonthlyCTRL0400-012200-12UVELVelocity in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-UV...
27ocn3Dmonthly20C1920-012005-12VNSSalt Flux in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-VNS...
28ocn3DmonthlyRCP852006-012100-12VNSSalt Flux in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V...
29ocn3DmonthlyCTRL0400-012200-12VNSSalt Flux in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-VN...
30ocn3Dmonthly20C1920-012005-12VNTHeat Flux in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-VNT...
31ocn3DmonthlyRCP852006-012100-12VNTHeat Flux in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V...
32ocn3DmonthlyCTRL0400-012200-12VNTHeat Flux in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-VN...
33ocn3Dmonthly20C1920-012005-12VVELVelocity in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-VVE...
34ocn3DmonthlyRCP852006-012100-12VVELVelocity in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V...
35ocn3DmonthlyCTRL0400-012200-12VVELVelocity in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-VV...
36ocn3Dmonthly20C1920-012005-12WTSSalt Flux across top faces3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-WTS...
37ocn3DmonthlyRCP852006-012100-12WTSSalt Flux across top faces3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W...
38ocn3DmonthlyCTRL0400-012200-12WTSSalt Flux across top faces3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-WT...
39ocn3Dmonthly20C1920-012005-12WTTHeat Flux across top faces3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-WTT...
40ocn3DmonthlyRCP852006-012100-12WTTHeat Flux across top faces3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W...
41ocn3DmonthlyCTRL0400-012200-12WTTHeat Flux across top faces3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-WT...
42ocn3Dmonthly20C1920-012005-12WVELVertical Velocitys3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-WVE...
43ocn3DmonthlyRCP852006-012100-12WVELVertical Velocitys3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W...
44ocn3DmonthlyCTRL0400-012200-12WVELVertical Velocitys3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-WV...
\n", + "
" + ], + "text/plain": [ + " component dim frequency experiment start end variable \\\n", + "0 ocn 3D monthly 20C 1920-01 2005-12 DIC \n", + "1 ocn 3D monthly RCP85 2006-01 2100-12 DIC \n", + "2 ocn 3D monthly CTRL 0400-01 2200-12 DIC \n", + "3 ocn 3D monthly 20C 1920-01 2005-12 DOC \n", + "4 ocn 3D monthly RCP85 2006-01 2100-12 DOC \n", + "5 ocn 3D monthly CTRL 0400-01 2200-12 DOC \n", + "6 ocn 3D monthly 20C 1920-01 2005-12 O2 \n", + "7 ocn 3D monthly RCP85 2006-01 2100-12 O2 \n", + "8 ocn 3D monthly CTRL 0400-01 2200-12 O2 \n", + "9 ocn 3D monthly 20C 1920-01 2005-12 PD \n", + "10 ocn 3D monthly RCP85 2006-01 2100-12 PD \n", + "11 ocn 3D monthly CTRL 0400-01 2200-12 PD \n", + "12 ocn 3D monthly 20C 1920-01 2005-12 SALT \n", + "13 ocn 3D monthly RCP85 2006-01 2100-12 SALT \n", + "14 ocn 3D monthly CTRL 0400-01 2200-12 SALT \n", + "15 ocn 3D monthly 20C 1920-01 2005-12 TEMP \n", + "16 ocn 3D monthly RCP85 2006-01 2100-12 TEMP \n", + "17 ocn 3D monthly CTRL 0400-01 2200-12 TEMP \n", + "18 ocn 3D monthly 20C 1920-01 2005-12 UES \n", + "19 ocn 3D monthly RCP85 2006-01 2100-12 UES \n", + "20 ocn 3D monthly CTRL 0400-01 2200-12 UES \n", + "21 ocn 3D monthly 20C 1920-01 2005-12 UET \n", + "22 ocn 3D monthly RCP85 2006-01 2100-12 UET \n", + "23 ocn 3D monthly CTRL 0400-01 2200-12 UET \n", + "24 ocn 3D monthly 20C 1920-01 2005-12 UVEL \n", + "25 ocn 3D monthly RCP85 2006-01 2100-12 UVEL \n", + "26 ocn 3D monthly CTRL 0400-01 2200-12 UVEL \n", + "27 ocn 3D monthly 20C 1920-01 2005-12 VNS \n", + "28 ocn 3D monthly RCP85 2006-01 2100-12 VNS \n", + "29 ocn 3D monthly CTRL 0400-01 2200-12 VNS \n", + "30 ocn 3D monthly 20C 1920-01 2005-12 VNT \n", + "31 ocn 3D monthly RCP85 2006-01 2100-12 VNT \n", + "32 ocn 3D monthly CTRL 0400-01 2200-12 VNT \n", + "33 ocn 3D monthly 20C 1920-01 2005-12 VVEL \n", + "34 ocn 3D monthly RCP85 2006-01 2100-12 VVEL \n", + "35 ocn 3D monthly CTRL 0400-01 2200-12 VVEL \n", + "36 ocn 3D monthly 20C 1920-01 2005-12 WTS \n", + "37 ocn 3D monthly RCP85 2006-01 2100-12 WTS \n", + "38 ocn 3D monthly CTRL 0400-01 2200-12 WTS \n", + "39 ocn 3D monthly 20C 1920-01 2005-12 WTT \n", + "40 ocn 3D monthly RCP85 2006-01 2100-12 WTT \n", + "41 ocn 3D monthly CTRL 0400-01 2200-12 WTT \n", + "42 ocn 3D monthly 20C 1920-01 2005-12 WVEL \n", + "43 ocn 3D monthly RCP85 2006-01 2100-12 WVEL \n", + "44 ocn 3D monthly CTRL 0400-01 2200-12 WVEL \n", + "\n", + " long_name \\\n", + "0 Dissolved Inorganic Carbon \n", + "1 Dissolved Inorganic Carbon \n", + "2 Dissolved Inorganic Carbon \n", + "3 Dissolved Organic Carbon \n", + "4 Dissolved Organic Carbon \n", + "5 Dissolved Organic Carbon \n", + "6 Dissolved Oxygen \n", + "7 Dissolved Oxygen \n", + "8 Dissolved Oxygen \n", + "9 Potential Density Ref to Surface \n", + "10 Potential Density Ref to Surface \n", + "11 Potential Density Ref to Surface \n", + "12 Salinity \n", + "13 Salinity \n", + "14 Salinity \n", + "15 Potential Temperature \n", + "16 Potential Temperature \n", + "17 Potential Temperature \n", + "18 Salt Flux in grid-x direction \n", + "19 Salt Flux in grid-x direction \n", + "20 Salt Flux in grid-x direction \n", + "21 Heat Flux in grid-x direction \n", + "22 Heat Flux in grid-x direction \n", + "23 Heat Flux in grid-x direction \n", + "24 Velocity in grid-x direction \n", + "25 Velocity in grid-x direction \n", + "26 Velocity in grid-x direction \n", + "27 Salt Flux in grid-y direction \n", + "28 Salt Flux in grid-y direction \n", + "29 Salt Flux in grid-y direction \n", + "30 Heat Flux in grid-y direction \n", + "31 Heat Flux in grid-y direction \n", + "32 Heat Flux in grid-y direction \n", + "33 Velocity in grid-y direction \n", + "34 Velocity in grid-y direction \n", + "35 Velocity in grid-y direction \n", + "36 Salt Flux across top face \n", + "37 Salt Flux across top face \n", + "38 Salt Flux across top face \n", + "39 Heat Flux across top face \n", + "40 Heat Flux across top face \n", + "41 Heat Flux across top face \n", + "42 Vertical Velocity \n", + "43 Vertical Velocity \n", + "44 Vertical Velocity \n", + "\n", + " path \n", + "0 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-DIC... \n", + "1 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-D... \n", + "2 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-DI... \n", + "3 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-DOC... \n", + "4 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-D... \n", + "5 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-DO... \n", + "6 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-O2.... \n", + "7 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-O... \n", + "8 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-O2... \n", + "9 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-PD.... \n", + "10 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-P... \n", + "11 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-PD... \n", + "12 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-SAL... \n", + "13 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-S... \n", + "14 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-SA... \n", + "15 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TEM... \n", + "16 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-T... \n", + "17 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-TE... \n", + "18 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-UES... \n", + "19 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U... \n", + "20 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-UE... \n", + "21 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-UET... \n", + "22 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U... \n", + "23 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-UE... \n", + "24 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-UVE... \n", + "25 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U... \n", + "26 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-UV... \n", + "27 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-VNS... \n", + "28 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V... \n", + "29 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-VN... \n", + "30 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-VNT... \n", + "31 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V... \n", + "32 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-VN... \n", + "33 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-VVE... \n", + "34 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V... \n", + "35 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-VV... \n", + "36 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-WTS... \n", + "37 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... \n", + "38 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-WT... \n", + "39 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-WTT... \n", + "40 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... \n", + "41 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-WT... \n", + "42 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-WVE... \n", + "43 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... \n", + "44 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-WV... " + ] + }, + "execution_count": 23, + "metadata": {}, + "output_type": "execute_result" + } + ], "source": [ "df = coll.search(dim=\"3D\",component=\"ocn\").df\n", - "HTML(df.to_html(index=False))" + "df" ] }, { @@ -425,12 +3172,287 @@ }, { "cell_type": "code", - "execution_count": null, + "execution_count": 24, "metadata": {}, - "outputs": [], + "outputs": [ + { + "data": { + "text/html": [ + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
componentdimfrequencyexperimentstartendvariablelong_namepath
0ocn3DmonthlyRCP852006-012100-12DICDissolved Inorganic Carbons3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-D...
1ocn3DmonthlyRCP852006-012100-12DOCDissolved Organic Carbons3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-D...
2ocn3DmonthlyRCP852006-012100-12O2Dissolved Oxygens3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-O...
3ocn3DmonthlyRCP852006-012100-12PDPotential Density Ref to Surfaces3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-P...
4ocn3DmonthlyRCP852006-012100-12SALTSalinitys3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-S...
5ocn3DmonthlyRCP852006-012100-12TEMPPotential Temperatures3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-T...
6ocn3DmonthlyRCP852006-012100-12UESSalt Flux in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U...
7ocn3DmonthlyRCP852006-012100-12UETHeat Flux in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U...
8ocn3DmonthlyRCP852006-012100-12UVELVelocity in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U...
9ocn3DmonthlyRCP852006-012100-12VNSSalt Flux in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V...
10ocn3DmonthlyRCP852006-012100-12VNTHeat Flux in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V...
11ocn3DmonthlyRCP852006-012100-12VVELVelocity in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V...
12ocn3DmonthlyRCP852006-012100-12WTSSalt Flux across top faces3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W...
13ocn3DmonthlyRCP852006-012100-12WTTHeat Flux across top faces3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W...
14ocn3DmonthlyRCP852006-012100-12WVELVertical Velocitys3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W...
\n", + "
" + ], + "text/plain": [ + " component dim frequency experiment start end variable \\\n", + "0 ocn 3D monthly RCP85 2006-01 2100-12 DIC \n", + "1 ocn 3D monthly RCP85 2006-01 2100-12 DOC \n", + "2 ocn 3D monthly RCP85 2006-01 2100-12 O2 \n", + "3 ocn 3D monthly RCP85 2006-01 2100-12 PD \n", + "4 ocn 3D monthly RCP85 2006-01 2100-12 SALT \n", + "5 ocn 3D monthly RCP85 2006-01 2100-12 TEMP \n", + "6 ocn 3D monthly RCP85 2006-01 2100-12 UES \n", + "7 ocn 3D monthly RCP85 2006-01 2100-12 UET \n", + "8 ocn 3D monthly RCP85 2006-01 2100-12 UVEL \n", + "9 ocn 3D monthly RCP85 2006-01 2100-12 VNS \n", + "10 ocn 3D monthly RCP85 2006-01 2100-12 VNT \n", + "11 ocn 3D monthly RCP85 2006-01 2100-12 VVEL \n", + "12 ocn 3D monthly RCP85 2006-01 2100-12 WTS \n", + "13 ocn 3D monthly RCP85 2006-01 2100-12 WTT \n", + "14 ocn 3D monthly RCP85 2006-01 2100-12 WVEL \n", + "\n", + " long_name \\\n", + "0 Dissolved Inorganic Carbon \n", + "1 Dissolved Organic Carbon \n", + "2 Dissolved Oxygen \n", + "3 Potential Density Ref to Surface \n", + "4 Salinity \n", + "5 Potential Temperature \n", + "6 Salt Flux in grid-x direction \n", + "7 Heat Flux in grid-x direction \n", + "8 Velocity in grid-x direction \n", + "9 Salt Flux in grid-y direction \n", + "10 Heat Flux in grid-y direction \n", + "11 Velocity in grid-y direction \n", + "12 Salt Flux across top face \n", + "13 Heat Flux across top face \n", + "14 Vertical Velocity \n", + "\n", + " path \n", + "0 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-D... \n", + "1 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-D... \n", + "2 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-O... \n", + "3 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-P... \n", + "4 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-S... \n", + "5 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-T... \n", + "6 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U... \n", + "7 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U... \n", + "8 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U... \n", + "9 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V... \n", + "10 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V... \n", + "11 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V... \n", + "12 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... \n", + "13 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... \n", + "14 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... " + ] + }, + "execution_count": 24, + "metadata": {}, + "output_type": "execute_result" + } + ], "source": [ "df = coll.search(dim=\"3D\",component=\"ocn\", end='2100-12').df\n", - "HTML(df.to_html(index=False))" + "df" ] }, { @@ -456,7 +3478,9 @@ "metadata": {}, "source": [ "## Resources and references\n", - "[Original notebook in the Pangeo Gallery](https://gallery.pangeo.io/repos/NCAR/cesm-lens-aws/notebooks/EnhancedIntakeCatalogDemo.html)" + "[Original notebook in the Pangeo Gallery](https://gallery.pangeo.io/repos/NCAR/cesm-lens-aws/notebooks/EnhancedIntakeCatalogDemo.html)\n", + "\n", + "[Intake-esm documentation](https://intake-esm.readthedocs.io)" ] } ], @@ -476,7 +3500,7 @@ "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", - "version": "3.9.13" + "version": "3.9.15" }, "nbdime-conflicts": { "local_diff": [ From dc4db4602917dd4e3ac3ab8f98a6da2e77b0c21d Mon Sep 17 00:00:00 2001 From: Brian Rose Date: Wed, 7 Dec 2022 21:47:38 -0500 Subject: [PATCH 2/2] Clear output from notebook --- notebooks/foundations/enhanced-catalog.ipynb | 3030 +----------------- 1 file changed, 41 insertions(+), 2989 deletions(-) diff --git a/notebooks/foundations/enhanced-catalog.ipynb b/notebooks/foundations/enhanced-catalog.ipynb index c06b2e5..dc3ad76 100644 --- a/notebooks/foundations/enhanced-catalog.ipynb +++ b/notebooks/foundations/enhanced-catalog.ipynb @@ -58,7 +58,7 @@ }, { "cell_type": "code", - "execution_count": 1, + "execution_count": null, "metadata": {}, "outputs": [], "source": [ @@ -82,94 +82,9 @@ }, { "cell_type": "code", - "execution_count": 2, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "data": { - "text/html": [ - "

aws-cesm1-le catalog with 56 dataset(s) from 442 asset(s):

\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
unique
variable78
long_name75
component5
experiment4
frequency6
vertical_levels3
spatial_domain5
units25
start_time12
end_time13
path427
derived_variable0
\n", - "
" - ], - "text/plain": [ - "" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], + "outputs": [], "source": [ "cat_url_orig = 'https://ncar-cesm-lens.s3-us-west-2.amazonaws.com/catalogs/aws-cesm1-le.json'\n", "coll_orig = intake.open_esm_datastore(cat_url_orig)\n", @@ -185,17 +100,9 @@ }, { "cell_type": "code", - "execution_count": 3, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "\n" - ] - } - ], + "outputs": [], "source": [ "print(coll_orig)" ] @@ -209,20 +116,9 @@ }, { "cell_type": "code", - "execution_count": 4, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "data": { - "text/plain": [ - "'This is an ESM collection for CESM1 Large Ensemble Zarr dataset publicly available on Amazon S3 (us-west-2 region)'" - ] - }, - "execution_count": 4, - "metadata": {}, - "output_type": "execute_result" - } - ], + "outputs": [], "source": [ "coll_orig.esmcat.description" ] @@ -236,20 +132,9 @@ }, { "cell_type": "code", - "execution_count": 5, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "data": { - "text/plain": [ - "'https://ncar-cesm-lens.s3-us-west-2.amazonaws.com/catalogs/aws-cesm1-le.csv'" - ] - }, - "execution_count": 5, - "metadata": {}, - "output_type": "execute_result" - } - ], + "outputs": [], "source": [ "coll_orig.esmcat.catalog_file" ] @@ -263,264 +148,9 @@ }, { "cell_type": "code", - "execution_count": 6, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "data": { - "text/html": [ - "
\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
variablelong_namecomponentexperimentfrequencyvertical_levelsspatial_domainunitsstart_timeend_timepath
0FLNSnet longwave flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS....
1FLNSCclearsky net longwave flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNSC...
2FLUTupwelling longwave flux at top of modelatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLUT....
3FSNSnet solar flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNS....
4FSNSCclearsky net solar flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNSC...
....................................
437WVELvertical velocityocnRCP85monthly60.0global_oceancentimeter/s2006-01-16 12:00:002100-12-16 12:00:00s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W...
438NaNNaNocnCTRLstaticNaNglobal_oceanNaNNaNNaNs3://ncar-cesm-lens/ocn/static/grid.zarr
439NaNNaNocnHISTstaticNaNglobal_oceanNaNNaNNaNs3://ncar-cesm-lens/ocn/static/grid.zarr
440NaNNaNocnRCP85staticNaNglobal_oceanNaNNaNNaNs3://ncar-cesm-lens/ocn/static/grid.zarr
441NaNNaNocn20CstaticNaNglobal_oceanNaNNaNNaNs3://ncar-cesm-lens/ocn/static/grid.zarr
\n", - "

442 rows × 11 columns

\n", - "
" - ], - "text/plain": [ - " variable long_name component experiment \\\n", - "0 FLNS net longwave flux at surface atm 20C \n", - "1 FLNSC clearsky net longwave flux at surface atm 20C \n", - "2 FLUT upwelling longwave flux at top of model atm 20C \n", - "3 FSNS net solar flux at surface atm 20C \n", - "4 FSNSC clearsky net solar flux at surface atm 20C \n", - ".. ... ... ... ... \n", - "437 WVEL vertical velocity ocn RCP85 \n", - "438 NaN NaN ocn CTRL \n", - "439 NaN NaN ocn HIST \n", - "440 NaN NaN ocn RCP85 \n", - "441 NaN NaN ocn 20C \n", - "\n", - " frequency vertical_levels spatial_domain units \\\n", - "0 daily 1.0 global W/m2 \n", - "1 daily 1.0 global W/m2 \n", - "2 daily 1.0 global W/m2 \n", - "3 daily 1.0 global W/m2 \n", - "4 daily 1.0 global W/m2 \n", - ".. ... ... ... ... \n", - "437 monthly 60.0 global_ocean centimeter/s \n", - "438 static NaN global_ocean NaN \n", - "439 static NaN global_ocean NaN \n", - "440 static NaN global_ocean NaN \n", - "441 static NaN global_ocean NaN \n", - "\n", - " start_time end_time \\\n", - "0 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", - "1 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", - "2 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", - "3 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", - "4 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", - ".. ... ... \n", - "437 2006-01-16 12:00:00 2100-12-16 12:00:00 \n", - "438 NaN NaN \n", - "439 NaN NaN \n", - "440 NaN NaN \n", - "441 NaN NaN \n", - "\n", - " path \n", - "0 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS.... \n", - "1 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNSC... \n", - "2 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLUT.... \n", - "3 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNS.... \n", - "4 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNSC... \n", - ".. ... \n", - "437 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... \n", - "438 s3://ncar-cesm-lens/ocn/static/grid.zarr \n", - "439 s3://ncar-cesm-lens/ocn/static/grid.zarr \n", - "440 s3://ncar-cesm-lens/ocn/static/grid.zarr \n", - "441 s3://ncar-cesm-lens/ocn/static/grid.zarr \n", - "\n", - "[442 rows x 11 columns]" - ] - }, - "execution_count": 6, - "metadata": {}, - "output_type": "execute_result" - } - ], + "outputs": [], "source": [ "df_orig = pd.read_csv(coll_orig.esmcat.catalog_file)\n", "df_orig" @@ -535,264 +165,9 @@ }, { "cell_type": "code", - "execution_count": 7, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "data": { - "text/html": [ - "
\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
variablelong_namecomponentexperimentfrequencyvertical_levelsspatial_domainunitsstart_timeend_timepath
0FLNSnet longwave flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS....
1FLNSCclearsky net longwave flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNSC...
2FLUTupwelling longwave flux at top of modelatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLUT....
3FSNSnet solar flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNS....
4FSNSCclearsky net solar flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNSC...
....................................
437WVELvertical velocityocnRCP85monthly60.0global_oceancentimeter/s2006-01-16 12:00:002100-12-16 12:00:00s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W...
438NaNNaNocnCTRLstaticNaNglobal_oceanNaNNaNNaNs3://ncar-cesm-lens/ocn/static/grid.zarr
439NaNNaNocnHISTstaticNaNglobal_oceanNaNNaNNaNs3://ncar-cesm-lens/ocn/static/grid.zarr
440NaNNaNocnRCP85staticNaNglobal_oceanNaNNaNNaNs3://ncar-cesm-lens/ocn/static/grid.zarr
441NaNNaNocn20CstaticNaNglobal_oceanNaNNaNNaNs3://ncar-cesm-lens/ocn/static/grid.zarr
\n", - "

442 rows × 11 columns

\n", - "
" - ], - "text/plain": [ - " variable long_name component experiment \\\n", - "0 FLNS net longwave flux at surface atm 20C \n", - "1 FLNSC clearsky net longwave flux at surface atm 20C \n", - "2 FLUT upwelling longwave flux at top of model atm 20C \n", - "3 FSNS net solar flux at surface atm 20C \n", - "4 FSNSC clearsky net solar flux at surface atm 20C \n", - ".. ... ... ... ... \n", - "437 WVEL vertical velocity ocn RCP85 \n", - "438 NaN NaN ocn CTRL \n", - "439 NaN NaN ocn HIST \n", - "440 NaN NaN ocn RCP85 \n", - "441 NaN NaN ocn 20C \n", - "\n", - " frequency vertical_levels spatial_domain units \\\n", - "0 daily 1.0 global W/m2 \n", - "1 daily 1.0 global W/m2 \n", - "2 daily 1.0 global W/m2 \n", - "3 daily 1.0 global W/m2 \n", - "4 daily 1.0 global W/m2 \n", - ".. ... ... ... ... \n", - "437 monthly 60.0 global_ocean centimeter/s \n", - "438 static NaN global_ocean NaN \n", - "439 static NaN global_ocean NaN \n", - "440 static NaN global_ocean NaN \n", - "441 static NaN global_ocean NaN \n", - "\n", - " start_time end_time \\\n", - "0 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", - "1 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", - "2 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", - "3 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", - "4 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", - ".. ... ... \n", - "437 2006-01-16 12:00:00 2100-12-16 12:00:00 \n", - "438 NaN NaN \n", - "439 NaN NaN \n", - "440 NaN NaN \n", - "441 NaN NaN \n", - "\n", - " path \n", - "0 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS.... \n", - "1 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNSC... \n", - "2 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLUT.... \n", - "3 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNS.... \n", - "4 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNSC... \n", - ".. ... \n", - "437 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... \n", - "438 s3://ncar-cesm-lens/ocn/static/grid.zarr \n", - "439 s3://ncar-cesm-lens/ocn/static/grid.zarr \n", - "440 s3://ncar-cesm-lens/ocn/static/grid.zarr \n", - "441 s3://ncar-cesm-lens/ocn/static/grid.zarr \n", - "\n", - "[442 rows x 11 columns]" - ] - }, - "execution_count": 7, - "metadata": {}, - "output_type": "execute_result" - } - ], + "outputs": [], "source": [ "df_orig = coll_orig.df\n", "df_orig" @@ -807,24 +182,9 @@ }, { "cell_type": "code", - "execution_count": 8, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "component: ['atm', 'ice_nh', 'ice_sh', 'lnd', 'ocn'] count: 5 \n", - "\n", - "frequency: ['daily', 'hourly6-1990-2005', 'hourly6-2026-2035', 'hourly6-2071-2080', 'monthly', 'static'] count: 6 \n", - "\n", - "experiment: ['20C', 'CTRL', 'HIST', 'RCP85'] count: 4 \n", - "\n", - "variable: ['DIC', 'DOC', 'FLNS', 'FLNSC', 'FLUT', 'FSNO', 'FSNS', 'FSNSC', 'FSNTOA', 'FW', 'H2OSNO', 'HMXL', 'ICEFRAC', 'LHFLX', 'O2', 'PD', 'PRECC', 'PRECL', 'PRECSC', 'PRECSL', 'PRECT', 'PRECTMX', 'PS', 'PSL', 'Q', 'Q850', 'QBOT', 'QFLUX', 'QREFHT', 'QRUNOFF', 'QSW_HBL', 'QSW_HTP', 'RAIN', 'RESID_S', 'SALT', 'SFWF', 'SFWF_WRST', 'SHF', 'SHFLX', 'SHF_QSW', 'SNOW', 'SOILLIQ', 'SOILWATER_10CM', 'SSH', 'SST', 'T', 'TAUX', 'TAUX2', 'TAUY', 'TAUY2', 'TEMP', 'TMQ', 'TREFHT', 'TREFHTMN', 'TREFHTMX', 'TREFMNAV_U', 'TREFMXAV_U', 'TS', 'U', 'UBOT', 'UES', 'UET', 'UVEL', 'V', 'VBOT', 'VNS', 'VNT', 'VVEL', 'WSPDSRFAV', 'WTS', 'WTT', 'WVEL', 'Z3', 'Z500', 'aice', 'aice_d', 'hi', 'hi_d'] count: 78 \n", - "\n" - ] - } - ], + "outputs": [], "source": [ "for col in ['component', 'frequency', 'experiment', 'variable']:\n", " unique_vals = coll_orig.unique()[col]\n", @@ -849,261 +209,9 @@ }, { "cell_type": "code", - "execution_count": 9, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "data": { - "text/html": [ - "
\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
variablelong_namecomponentexperimentfrequencyvertical_levelsspatial_domainunitsstart_timeend_timepath
0FLNSnet longwave flux at surfaceatm20Cdaily1.0globalW/m21920-01-01 12:00:002005-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS....
1FLNSnet longwave flux at surfaceatmCTRLdaily1.0globalW/m20402-01-01 12:00:002200-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-CTRL-FLNS...
2FLNSnet longwave flux at surfaceatmHISTdaily1.0globalW/m21850-01-01 12:00:001919-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-HIST-FLNS...
3FLNSnet longwave flux at surfaceatmRCP85daily1.0globalW/m22006-01-01 12:00:002100-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-RCP85-FLN...
4FLNSnet longwave flux at surfaceatm20Chourly6-1990-20051.0globalW/m21990-01-01 00:00:002006-01-01 00:00:00s3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm...
5FLNSnet longwave flux at surfaceatmRCP85hourly6-2026-20351.0globalW/m22026-01-01 00:00:002036-01-01 00:00:00s3://ncar-cesm-lens/atm/hourly6-2026-2035/cesm...
6FLNSnet longwave flux at surfaceatmRCP85hourly6-2071-20801.0globalW/m22071-01-01 00:00:002081-01-01 00:00:00s3://ncar-cesm-lens/atm/hourly6-2071-2080/cesm...
7FLNSnet longwave flux at surfaceatm20Cmonthly1.0globalW/m21920-01-16 12:00:002005-12-16 12:00:00s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-FLN...
8FLNSnet longwave flux at surfaceatmCTRLmonthly1.0globalW/m20400-01-16 12:00:002200-12-16 12:00:00s3://ncar-cesm-lens/atm/monthly/cesmLE-CTRL-FL...
9FLNSnet longwave flux at surfaceatmHISTmonthly1.0globalW/m21850-01-16 12:00:001919-12-16 12:00:00s3://ncar-cesm-lens/atm/monthly/cesmLE-HIST-FL...
10FLNSnet longwave flux at surfaceatmRCP85monthly1.0globalW/m22006-01-16 12:00:002100-12-16 12:00:00s3://ncar-cesm-lens/atm/monthly/cesmLE-RCP85-F...
\n", - "
" - ], - "text/plain": [ - " variable long_name component experiment \\\n", - "0 FLNS net longwave flux at surface atm 20C \n", - "1 FLNS net longwave flux at surface atm CTRL \n", - "2 FLNS net longwave flux at surface atm HIST \n", - "3 FLNS net longwave flux at surface atm RCP85 \n", - "4 FLNS net longwave flux at surface atm 20C \n", - "5 FLNS net longwave flux at surface atm RCP85 \n", - "6 FLNS net longwave flux at surface atm RCP85 \n", - "7 FLNS net longwave flux at surface atm 20C \n", - "8 FLNS net longwave flux at surface atm CTRL \n", - "9 FLNS net longwave flux at surface atm HIST \n", - "10 FLNS net longwave flux at surface atm RCP85 \n", - "\n", - " frequency vertical_levels spatial_domain units \\\n", - "0 daily 1.0 global W/m2 \n", - "1 daily 1.0 global W/m2 \n", - "2 daily 1.0 global W/m2 \n", - "3 daily 1.0 global W/m2 \n", - "4 hourly6-1990-2005 1.0 global W/m2 \n", - "5 hourly6-2026-2035 1.0 global W/m2 \n", - "6 hourly6-2071-2080 1.0 global W/m2 \n", - "7 monthly 1.0 global W/m2 \n", - "8 monthly 1.0 global W/m2 \n", - "9 monthly 1.0 global W/m2 \n", - "10 monthly 1.0 global W/m2 \n", - "\n", - " start_time end_time \\\n", - "0 1920-01-01 12:00:00 2005-12-31 12:00:00 \n", - "1 0402-01-01 12:00:00 2200-12-31 12:00:00 \n", - "2 1850-01-01 12:00:00 1919-12-31 12:00:00 \n", - "3 2006-01-01 12:00:00 2100-12-31 12:00:00 \n", - "4 1990-01-01 00:00:00 2006-01-01 00:00:00 \n", - "5 2026-01-01 00:00:00 2036-01-01 00:00:00 \n", - "6 2071-01-01 00:00:00 2081-01-01 00:00:00 \n", - "7 1920-01-16 12:00:00 2005-12-16 12:00:00 \n", - "8 0400-01-16 12:00:00 2200-12-16 12:00:00 \n", - "9 1850-01-16 12:00:00 1919-12-16 12:00:00 \n", - "10 2006-01-16 12:00:00 2100-12-16 12:00:00 \n", - "\n", - " path \n", - "0 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS.... \n", - "1 s3://ncar-cesm-lens/atm/daily/cesmLE-CTRL-FLNS... \n", - "2 s3://ncar-cesm-lens/atm/daily/cesmLE-HIST-FLNS... \n", - "3 s3://ncar-cesm-lens/atm/daily/cesmLE-RCP85-FLN... \n", - "4 s3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm... \n", - "5 s3://ncar-cesm-lens/atm/hourly6-2026-2035/cesm... \n", - "6 s3://ncar-cesm-lens/atm/hourly6-2071-2080/cesm... \n", - "7 s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-FLN... \n", - "8 s3://ncar-cesm-lens/atm/monthly/cesmLE-CTRL-FL... \n", - "9 s3://ncar-cesm-lens/atm/monthly/cesmLE-HIST-FL... \n", - "10 s3://ncar-cesm-lens/atm/monthly/cesmLE-RCP85-F... " - ] - }, - "execution_count": 9, - "metadata": {}, - "output_type": "execute_result" - } - ], + "outputs": [], "source": [ "df = coll_orig.search(variable='FLNS').df\n", "df" @@ -1118,78 +226,9 @@ }, { "cell_type": "code", - "execution_count": 11, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "data": { - "text/html": [ - "
\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
variablelong_namecomponentexperimentfrequencyvertical_levelsspatial_domainunitsstart_timeend_timepath
0FLNSnet longwave flux at surfaceatmRCP85daily1.0globalW/m22006-01-01 12:00:002100-12-31 12:00:00s3://ncar-cesm-lens/atm/daily/cesmLE-RCP85-FLN...
\n", - "
" - ], - "text/plain": [ - " variable long_name component experiment frequency \\\n", - "0 FLNS net longwave flux at surface atm RCP85 daily \n", - "\n", - " vertical_levels spatial_domain units start_time \\\n", - "0 1.0 global W/m2 2006-01-01 12:00:00 \n", - "\n", - " end_time path \n", - "0 2100-12-31 12:00:00 s3://ncar-cesm-lens/atm/daily/cesmLE-RCP85-FLN... " - ] - }, - "execution_count": 11, - "metadata": {}, - "output_type": "execute_result" - } - ], + "outputs": [], "source": [ "df = coll_orig.search(variable='FLNS', frequency='daily', experiment='RCP85').df\n", "df" @@ -1226,86 +265,9 @@ }, { "cell_type": "code", - "execution_count": 12, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "data": { - "text/html": [ - "

aws-cesm1-le catalog with 27 dataset(s) from 365 asset(s):

\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
unique
component5
dim2
frequency5
experiment6
start10
end11
variable75
long_name75
path365
derived_variable0
\n", - "
" - ], - "text/plain": [ - "" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], + "outputs": [], "source": [ "cat_url = 'https://ncar-cesm-lens.s3-us-west-2.amazonaws.com/catalogs/aws-cesm1-le-enhanced.json'\n", "coll = intake.open_esm_datastore(cat_url)\n", @@ -1321,19 +283,9 @@ }, { "cell_type": "code", - "execution_count": 13, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "This is an inventory of the Community Earth System Model (CESM) Large Ensemble (LENS) dataset in Zarr format publicly available on Amazon S3 (https://doi.org/10.26024/wt24-5j82)\n", - "Catalog file: https://ncar-cesm-lens.s3-us-west-2.amazonaws.com/catalogs/aws-cesm1-le-enhanced.csv\n", - "\n" - ] - } - ], + "outputs": [], "source": [ "print(coll.esmcat.description) # Description of collection\n", "print(\"Catalog file:\", coll.esmcat.catalog_file)\n", @@ -1358,227 +310,9 @@ }, { "cell_type": "code", - "execution_count": 14, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "data": { - "text/html": [ - "
\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
componentdimfrequencyexperimentstartendvariablelong_namepath
0atm2DmonthlyHIST1850-011919-12FLNSNet longwave flux at surfaces3://ncar-cesm-lens/atm/monthly/cesmLE-HIST-FL...
1atm2Dmonthly20C1920-012005-12FLNSNet longwave flux at surfaces3://ncar-cesm-lens/atm/monthly/cesmLE-20C-FLN...
2atm2Ddaily20C1920-01-012005-12-31FLNSNet longwave flux at surfaces3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS....
3atm2DmonthlyRCP852006-012100-12FLNSNet longwave flux at surfaces3://ncar-cesm-lens/atm/monthly/cesmLE-RCP85-F...
4atm2DdailyRCP852006-01-012100-12-31FLNSNet longwave flux at surfaces3://ncar-cesm-lens/atm/daily/cesmLE-RCP85-FLN...
..............................
360ice_sh2DdailyRCP852006-01-012100-12-31aice_dice area, aggregate (daily)s3://ncar-cesm-lens/ice_sh/daily/cesmLE-RCP85-...
361ice_sh2Dmonthly20C1920-012005-12higrid cellmean ice thicknesss3://ncar-cesm-lens/ice_sh/monthly/cesmLE-20C-...
362ice_sh2DmonthlyRCP852006-012100-12higrid cellmean ice thicknesss3://ncar-cesm-lens/ice_sh/monthly/cesmLE-RCP8...
363ice_sh2Ddaily20C1920-01-012005-12-31hi_dgrid cellmean ice thicknesss3://ncar-cesm-lens/ice_sh/daily/cesmLE-20C-hi...
364ice_sh2DdailyRCP852006-01-012100-12-31hi_dgrid cellmean ice thicknesss3://ncar-cesm-lens/ice_sh/daily/cesmLE-RCP85-...
\n", - "

365 rows × 9 columns

\n", - "
" - ], - "text/plain": [ - " component dim frequency experiment start end variable \\\n", - "0 atm 2D monthly HIST 1850-01 1919-12 FLNS \n", - "1 atm 2D monthly 20C 1920-01 2005-12 FLNS \n", - "2 atm 2D daily 20C 1920-01-01 2005-12-31 FLNS \n", - "3 atm 2D monthly RCP85 2006-01 2100-12 FLNS \n", - "4 atm 2D daily RCP85 2006-01-01 2100-12-31 FLNS \n", - ".. ... .. ... ... ... ... ... \n", - "360 ice_sh 2D daily RCP85 2006-01-01 2100-12-31 aice_d \n", - "361 ice_sh 2D monthly 20C 1920-01 2005-12 hi \n", - "362 ice_sh 2D monthly RCP85 2006-01 2100-12 hi \n", - "363 ice_sh 2D daily 20C 1920-01-01 2005-12-31 hi_d \n", - "364 ice_sh 2D daily RCP85 2006-01-01 2100-12-31 hi_d \n", - "\n", - " long_name \\\n", - "0 Net longwave flux at surface \n", - "1 Net longwave flux at surface \n", - "2 Net longwave flux at surface \n", - "3 Net longwave flux at surface \n", - "4 Net longwave flux at surface \n", - ".. ... \n", - "360 ice area, aggregate (daily) \n", - "361 grid cellmean ice thickness \n", - "362 grid cellmean ice thickness \n", - "363 grid cellmean ice thickness \n", - "364 grid cellmean ice thickness \n", - "\n", - " path \n", - "0 s3://ncar-cesm-lens/atm/monthly/cesmLE-HIST-FL... \n", - "1 s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-FLN... \n", - "2 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS.... \n", - "3 s3://ncar-cesm-lens/atm/monthly/cesmLE-RCP85-F... \n", - "4 s3://ncar-cesm-lens/atm/daily/cesmLE-RCP85-FLN... \n", - ".. ... \n", - "360 s3://ncar-cesm-lens/ice_sh/daily/cesmLE-RCP85-... \n", - "361 s3://ncar-cesm-lens/ice_sh/monthly/cesmLE-20C-... \n", - "362 s3://ncar-cesm-lens/ice_sh/monthly/cesmLE-RCP8... \n", - "363 s3://ncar-cesm-lens/ice_sh/daily/cesmLE-20C-hi... \n", - "364 s3://ncar-cesm-lens/ice_sh/daily/cesmLE-RCP85-... \n", - "\n", - "[365 rows x 9 columns]" - ] - }, - "execution_count": 14, - "metadata": {}, - "output_type": "execute_result" - } - ], + "outputs": [], "source": [ "df_enh = coll.df\n", "df_enh" @@ -1604,91 +338,9 @@ }, { "cell_type": "code", - "execution_count": 15, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Clearsky net longwave flux at surface\n", - "Clearsky net solar flux at surface\n", - "Convective precipitation rate (liq + ice)\n", - "Convective snow rate (water equivalent)\n", - "Dissolved Inorganic Carbon\n", - "Dissolved Organic Carbon\n", - "Dissolved Oxygen\n", - "Fraction of sfc area covered by sea-ice\n", - "Free-Surface Residual Heat Flux\n", - "Free-Surface Residual Salt Flux\n", - "Freshwater Flux\n", - "Geopotential Height (above sea level)\n", - "Geopotential Z at 500 mbar pressure surface\n", - "Heat Flux across top face\n", - "Heat Flux in grid-x direction\n", - "Heat Flux in grid-y direction\n", - "Horizontal total wind speed average at the surface\n", - "Internal Ocean Heat Flux Due to Ice Formation\n", - "Large-scale (stable) precipitation rate (liq + ice)\n", - "Large-scale (stable) snow rate (water equivalent)\n", - "Lowest model level zonal wind\n", - "Maximum (convective and large-scale) precipitation rate (liq+ice)\n", - "Maximum reference height temperature over output period\n", - "Meridional wind\n", - "Minimum reference height temperature over output period\n", - "Mixed-Layer Depth\n", - "Net longwave flux at surface\n", - "Net solar flux at surface\n", - "Net solar flux at top of atmosphere\n", - "Potential Density Ref to Surface\n", - "Potential Temperature\n", - "Reference height humidity\n", - "Reference height temperature\n", - "Salinity\n", - "Salt Flux across top face\n", - "Salt Flux in grid-x direction\n", - "Salt Flux in grid-y direction\n", - "Sea Surface Height\n", - "Sea level pressure\n", - "Solar Short-Wave Heat Flux\n", - "Solar Short-Wave Heat Flux in boundary layer\n", - "Solar Short-Wave Heat Flux in top layer\n", - "Specific Humidity at 850 mbar pressure surface\n", - "Specific humidity\n", - "Surface latent heat flux\n", - "Surface pressure\n", - "Surface sensible heat flux\n", - "Surface temperature (radiative)\n", - "Temperature\n", - "Total (convective and large-scale) precipitation rate (liq + ice)\n", - "Total (vertically integrated) precipitable water\n", - "Total Surface Heat Flux including short-wave\n", - "Upwelling longwave flux at top of model\n", - "Velocity in grid-x direction\n", - "Velocity in grid-y direction\n", - "Vertical Velocity\n", - "Virtual Salt Flux due to weak restoring\n", - "Virtual Salt Flux in FW Flux formulation\n", - "Wind stress (squared) in grid-x direction\n", - "Wind stress (squared) in grid-y direction\n", - "Wind stress in grid-x direction\n", - "Wind stress in grid-y direction\n", - "Zonal wind\n", - "atmospheric rain\n", - "atmospheric snow\n", - "fraction of ground covered by snow\n", - "grid cellmean ice thickness\n", - "grid cellmean ice thickness (daily)\n", - "grid cellmean ice thickness (monthly)\n", - "ice area, aggregate (daily)\n", - "ice area, aggregate (monthly)\n", - "snow depth (liquid water)\n", - "soil liquid water (vegetated landunits only)\n", - "soil liquid water + ice in top 10cm of soil (veg landunits only)\n", - "total liquid runoff (does not include QSNWCPICE)\n" - ] - } - ], + "outputs": [], "source": [ "nameList = coll.unique()['long_name']\n", "nameList.sort()\n", @@ -1718,99 +370,9 @@ }, { "cell_type": "code", - "execution_count": 16, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "data": { - "text/html": [ - "
\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
componentdimfrequencyexperimentstartendvariablelong_namepath
0ocn3Dmonthly20C1920-012005-12SALTSalinitys3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-SAL...
1ocn3DmonthlyRCP852006-012100-12SALTSalinitys3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-S...
2ocn3DmonthlyCTRL0400-012200-12SALTSalinitys3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-SA...
\n", - "
" - ], - "text/plain": [ - " component dim frequency experiment start end variable long_name \\\n", - "0 ocn 3D monthly 20C 1920-01 2005-12 SALT Salinity \n", - "1 ocn 3D monthly RCP85 2006-01 2100-12 SALT Salinity \n", - "2 ocn 3D monthly CTRL 0400-01 2200-12 SALT Salinity \n", - "\n", - " path \n", - "0 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-SAL... \n", - "1 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-S... \n", - "2 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-SA... " - ] - }, - "execution_count": 16, - "metadata": {}, - "output_type": "execute_result" - } - ], + "outputs": [], "source": [ "myName = 'Salinity'\n", "df = coll.search(long_name=myName).df\n", @@ -1826,209 +388,9 @@ }, { "cell_type": "code", - "execution_count": 17, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "data": { - "text/html": [ - "
\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
componentdimfrequencyexperimentstartendvariablelong_namepath
0atm3Dmonthly20C1920-012005-12QSpecific humiditys3://ncar-cesm-lens/atm/monthly/cesmLE-20C-Q.zarr
1atm3Dhourly6-1990-200520C1990-01-01T002005-12-31T18QSpecific humiditys3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm...
2atm3DmonthlyRCP852006-012100-12QSpecific humiditys3://ncar-cesm-lens/atm/monthly/cesmLE-RCP85-Q...
3atm3Dhourly6-2026-2035RCP852026-01-01T002035-12-31T18QSpecific humiditys3://ncar-cesm-lens/atm/hourly6-2026-2035/cesm...
4atm3Dhourly6-2071-2080RCP852071-01-01T002080-12-31T18QSpecific humiditys3://ncar-cesm-lens/atm/hourly6-2071-2080/cesm...
5atm3Dmonthly20C1920-012005-12TTemperatures3://ncar-cesm-lens/atm/monthly/cesmLE-20C-T.zarr
6atm3Dhourly6-1990-200520C1990-01-01T002005-12-31T18TTemperatures3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm...
7atm3DmonthlyRCP852006-012100-12TTemperatures3://ncar-cesm-lens/atm/monthly/cesmLE-RCP85-T...
8atm3Dhourly6-2026-2035RCP852026-01-01T002035-12-31T18TTemperatures3://ncar-cesm-lens/atm/hourly6-2026-2035/cesm...
9atm3Dhourly6-2071-2080RCP852071-01-01T002080-12-31T18TTemperatures3://ncar-cesm-lens/atm/hourly6-2071-2080/cesm...
\n", - "
" - ], - "text/plain": [ - " component dim frequency experiment start end \\\n", - "0 atm 3D monthly 20C 1920-01 2005-12 \n", - "1 atm 3D hourly6-1990-2005 20C 1990-01-01T00 2005-12-31T18 \n", - "2 atm 3D monthly RCP85 2006-01 2100-12 \n", - "3 atm 3D hourly6-2026-2035 RCP85 2026-01-01T00 2035-12-31T18 \n", - "4 atm 3D hourly6-2071-2080 RCP85 2071-01-01T00 2080-12-31T18 \n", - "5 atm 3D monthly 20C 1920-01 2005-12 \n", - "6 atm 3D hourly6-1990-2005 20C 1990-01-01T00 2005-12-31T18 \n", - "7 atm 3D monthly RCP85 2006-01 2100-12 \n", - "8 atm 3D hourly6-2026-2035 RCP85 2026-01-01T00 2035-12-31T18 \n", - "9 atm 3D hourly6-2071-2080 RCP85 2071-01-01T00 2080-12-31T18 \n", - "\n", - " variable long_name \\\n", - "0 Q Specific humidity \n", - "1 Q Specific humidity \n", - "2 Q Specific humidity \n", - "3 Q Specific humidity \n", - "4 Q Specific humidity \n", - "5 T Temperature \n", - "6 T Temperature \n", - "7 T Temperature \n", - "8 T Temperature \n", - "9 T Temperature \n", - "\n", - " path \n", - "0 s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-Q.zarr \n", - "1 s3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm... \n", - "2 s3://ncar-cesm-lens/atm/monthly/cesmLE-RCP85-Q... \n", - "3 s3://ncar-cesm-lens/atm/hourly6-2026-2035/cesm... \n", - "4 s3://ncar-cesm-lens/atm/hourly6-2071-2080/cesm... \n", - "5 s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-T.zarr \n", - "6 s3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm... \n", - "7 s3://ncar-cesm-lens/atm/monthly/cesmLE-RCP85-T... \n", - "8 s3://ncar-cesm-lens/atm/hourly6-2026-2035/cesm... \n", - "9 s3://ncar-cesm-lens/atm/hourly6-2071-2080/cesm... " - ] - }, - "execution_count": 17, - "metadata": {}, - "output_type": "execute_result" - } - ], + "outputs": [], "source": [ "df = coll.search(experiment=['20C','RCP85'], dim='3D', variable=['T','Q']).df\n", "df" @@ -2052,7 +414,7 @@ }, { "cell_type": "code", - "execution_count": 18, + "execution_count": null, "metadata": {}, "outputs": [], "source": [ @@ -2061,119 +423,9 @@ }, { "cell_type": "code", - "execution_count": 19, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "data": { - "text/html": [ - "
\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
componentdimfrequencyexperimentstartendvariablelong_namepath
0ocn2Dmonthly20C1920-012005-12TAUXWind stress in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU...
1ocn2Dmonthly20C1920-012005-12TAUX2Wind stress (squared) in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU...
2ocn2Dmonthly20C1920-012005-12TAUYWind stress in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU...
3ocn2Dmonthly20C1920-012005-12TAUY2Wind stress (squared) in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU...
\n", - "
" - ], - "text/plain": [ - " component dim frequency experiment start end variable \\\n", - "0 ocn 2D monthly 20C 1920-01 2005-12 TAUX \n", - "1 ocn 2D monthly 20C 1920-01 2005-12 TAUX2 \n", - "2 ocn 2D monthly 20C 1920-01 2005-12 TAUY \n", - "3 ocn 2D monthly 20C 1920-01 2005-12 TAUY2 \n", - "\n", - " long_name \\\n", - "0 Wind stress in grid-x direction \n", - "1 Wind stress (squared) in grid-x direction \n", - "2 Wind stress in grid-y direction \n", - "3 Wind stress (squared) in grid-y direction \n", - "\n", - " path \n", - "0 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU... \n", - "1 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU... \n", - "2 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU... \n", - "3 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU... " - ] - }, - "execution_count": 19, - "metadata": {}, - "output_type": "execute_result" - } - ], + "outputs": [], "source": [ "coll_subset.df" ] @@ -2187,7 +439,7 @@ }, { "cell_type": "code", - "execution_count": 21, + "execution_count": null, "metadata": {}, "outputs": [], "source": [ @@ -2196,209 +448,9 @@ }, { "cell_type": "code", - "execution_count": 22, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "data": { - "text/html": [ - "
\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
componentdimfrequencyexperimentstartendvariablelong_namepath
0atm3Dmonthly20C1920-012005-12UZonal winds3://ncar-cesm-lens/atm/monthly/cesmLE-20C-U.zarr
1atm3Dhourly6-1990-200520C1990-01-01T002005-12-31T18UZonal winds3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm...
2atm2Ddaily20C1920-01-012005-12-31UBOTLowest model level zonal winds3://ncar-cesm-lens/atm/daily/cesmLE-20C-UBOT....
3atm3Dmonthly20C1920-012005-12VMeridional winds3://ncar-cesm-lens/atm/monthly/cesmLE-20C-V.zarr
4atm3Dhourly6-1990-200520C1990-01-01T002005-12-31T18VMeridional winds3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm...
5atm2Ddaily20C1920-01-012005-12-31WSPDSRFAVHorizontal total wind speed average at the sur...s3://ncar-cesm-lens/atm/daily/cesmLE-20C-WSPDS...
6ocn2Dmonthly20C1920-012005-12TAUXWind stress in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU...
7ocn2Dmonthly20C1920-012005-12TAUX2Wind stress (squared) in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU...
8ocn2Dmonthly20C1920-012005-12TAUYWind stress in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU...
9ocn2Dmonthly20C1920-012005-12TAUY2Wind stress (squared) in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU...
\n", - "
" - ], - "text/plain": [ - " component dim frequency experiment start end \\\n", - "0 atm 3D monthly 20C 1920-01 2005-12 \n", - "1 atm 3D hourly6-1990-2005 20C 1990-01-01T00 2005-12-31T18 \n", - "2 atm 2D daily 20C 1920-01-01 2005-12-31 \n", - "3 atm 3D monthly 20C 1920-01 2005-12 \n", - "4 atm 3D hourly6-1990-2005 20C 1990-01-01T00 2005-12-31T18 \n", - "5 atm 2D daily 20C 1920-01-01 2005-12-31 \n", - "6 ocn 2D monthly 20C 1920-01 2005-12 \n", - "7 ocn 2D monthly 20C 1920-01 2005-12 \n", - "8 ocn 2D monthly 20C 1920-01 2005-12 \n", - "9 ocn 2D monthly 20C 1920-01 2005-12 \n", - "\n", - " variable long_name \\\n", - "0 U Zonal wind \n", - "1 U Zonal wind \n", - "2 UBOT Lowest model level zonal wind \n", - "3 V Meridional wind \n", - "4 V Meridional wind \n", - "5 WSPDSRFAV Horizontal total wind speed average at the sur... \n", - "6 TAUX Wind stress in grid-x direction \n", - "7 TAUX2 Wind stress (squared) in grid-x direction \n", - "8 TAUY Wind stress in grid-y direction \n", - "9 TAUY2 Wind stress (squared) in grid-y direction \n", - "\n", - " path \n", - "0 s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-U.zarr \n", - "1 s3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm... \n", - "2 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-UBOT.... \n", - "3 s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-V.zarr \n", - "4 s3://ncar-cesm-lens/atm/hourly6-1990-2005/cesm... \n", - "5 s3://ncar-cesm-lens/atm/daily/cesmLE-20C-WSPDS... \n", - "6 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU... \n", - "7 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU... \n", - "8 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU... \n", - "9 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TAU... " - ] - }, - "execution_count": 22, - "metadata": {}, - "output_type": "execute_result" - } - ], + "outputs": [], "source": [ "coll_subset.df" ] @@ -2419,734 +471,9 @@ }, { "cell_type": "code", - "execution_count": 23, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "data": { - "text/html": [ - "
\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
componentdimfrequencyexperimentstartendvariablelong_namepath
0ocn3Dmonthly20C1920-012005-12DICDissolved Inorganic Carbons3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-DIC...
1ocn3DmonthlyRCP852006-012100-12DICDissolved Inorganic Carbons3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-D...
2ocn3DmonthlyCTRL0400-012200-12DICDissolved Inorganic Carbons3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-DI...
3ocn3Dmonthly20C1920-012005-12DOCDissolved Organic Carbons3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-DOC...
4ocn3DmonthlyRCP852006-012100-12DOCDissolved Organic Carbons3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-D...
5ocn3DmonthlyCTRL0400-012200-12DOCDissolved Organic Carbons3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-DO...
6ocn3Dmonthly20C1920-012005-12O2Dissolved Oxygens3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-O2....
7ocn3DmonthlyRCP852006-012100-12O2Dissolved Oxygens3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-O...
8ocn3DmonthlyCTRL0400-012200-12O2Dissolved Oxygens3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-O2...
9ocn3Dmonthly20C1920-012005-12PDPotential Density Ref to Surfaces3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-PD....
10ocn3DmonthlyRCP852006-012100-12PDPotential Density Ref to Surfaces3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-P...
11ocn3DmonthlyCTRL0400-012200-12PDPotential Density Ref to Surfaces3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-PD...
12ocn3Dmonthly20C1920-012005-12SALTSalinitys3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-SAL...
13ocn3DmonthlyRCP852006-012100-12SALTSalinitys3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-S...
14ocn3DmonthlyCTRL0400-012200-12SALTSalinitys3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-SA...
15ocn3Dmonthly20C1920-012005-12TEMPPotential Temperatures3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TEM...
16ocn3DmonthlyRCP852006-012100-12TEMPPotential Temperatures3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-T...
17ocn3DmonthlyCTRL0400-012200-12TEMPPotential Temperatures3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-TE...
18ocn3Dmonthly20C1920-012005-12UESSalt Flux in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-UES...
19ocn3DmonthlyRCP852006-012100-12UESSalt Flux in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U...
20ocn3DmonthlyCTRL0400-012200-12UESSalt Flux in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-UE...
21ocn3Dmonthly20C1920-012005-12UETHeat Flux in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-UET...
22ocn3DmonthlyRCP852006-012100-12UETHeat Flux in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U...
23ocn3DmonthlyCTRL0400-012200-12UETHeat Flux in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-UE...
24ocn3Dmonthly20C1920-012005-12UVELVelocity in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-UVE...
25ocn3DmonthlyRCP852006-012100-12UVELVelocity in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U...
26ocn3DmonthlyCTRL0400-012200-12UVELVelocity in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-UV...
27ocn3Dmonthly20C1920-012005-12VNSSalt Flux in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-VNS...
28ocn3DmonthlyRCP852006-012100-12VNSSalt Flux in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V...
29ocn3DmonthlyCTRL0400-012200-12VNSSalt Flux in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-VN...
30ocn3Dmonthly20C1920-012005-12VNTHeat Flux in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-VNT...
31ocn3DmonthlyRCP852006-012100-12VNTHeat Flux in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V...
32ocn3DmonthlyCTRL0400-012200-12VNTHeat Flux in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-VN...
33ocn3Dmonthly20C1920-012005-12VVELVelocity in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-VVE...
34ocn3DmonthlyRCP852006-012100-12VVELVelocity in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V...
35ocn3DmonthlyCTRL0400-012200-12VVELVelocity in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-VV...
36ocn3Dmonthly20C1920-012005-12WTSSalt Flux across top faces3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-WTS...
37ocn3DmonthlyRCP852006-012100-12WTSSalt Flux across top faces3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W...
38ocn3DmonthlyCTRL0400-012200-12WTSSalt Flux across top faces3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-WT...
39ocn3Dmonthly20C1920-012005-12WTTHeat Flux across top faces3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-WTT...
40ocn3DmonthlyRCP852006-012100-12WTTHeat Flux across top faces3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W...
41ocn3DmonthlyCTRL0400-012200-12WTTHeat Flux across top faces3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-WT...
42ocn3Dmonthly20C1920-012005-12WVELVertical Velocitys3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-WVE...
43ocn3DmonthlyRCP852006-012100-12WVELVertical Velocitys3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W...
44ocn3DmonthlyCTRL0400-012200-12WVELVertical Velocitys3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-WV...
\n", - "
" - ], - "text/plain": [ - " component dim frequency experiment start end variable \\\n", - "0 ocn 3D monthly 20C 1920-01 2005-12 DIC \n", - "1 ocn 3D monthly RCP85 2006-01 2100-12 DIC \n", - "2 ocn 3D monthly CTRL 0400-01 2200-12 DIC \n", - "3 ocn 3D monthly 20C 1920-01 2005-12 DOC \n", - "4 ocn 3D monthly RCP85 2006-01 2100-12 DOC \n", - "5 ocn 3D monthly CTRL 0400-01 2200-12 DOC \n", - "6 ocn 3D monthly 20C 1920-01 2005-12 O2 \n", - "7 ocn 3D monthly RCP85 2006-01 2100-12 O2 \n", - "8 ocn 3D monthly CTRL 0400-01 2200-12 O2 \n", - "9 ocn 3D monthly 20C 1920-01 2005-12 PD \n", - "10 ocn 3D monthly RCP85 2006-01 2100-12 PD \n", - "11 ocn 3D monthly CTRL 0400-01 2200-12 PD \n", - "12 ocn 3D monthly 20C 1920-01 2005-12 SALT \n", - "13 ocn 3D monthly RCP85 2006-01 2100-12 SALT \n", - "14 ocn 3D monthly CTRL 0400-01 2200-12 SALT \n", - "15 ocn 3D monthly 20C 1920-01 2005-12 TEMP \n", - "16 ocn 3D monthly RCP85 2006-01 2100-12 TEMP \n", - "17 ocn 3D monthly CTRL 0400-01 2200-12 TEMP \n", - "18 ocn 3D monthly 20C 1920-01 2005-12 UES \n", - "19 ocn 3D monthly RCP85 2006-01 2100-12 UES \n", - "20 ocn 3D monthly CTRL 0400-01 2200-12 UES \n", - "21 ocn 3D monthly 20C 1920-01 2005-12 UET \n", - "22 ocn 3D monthly RCP85 2006-01 2100-12 UET \n", - "23 ocn 3D monthly CTRL 0400-01 2200-12 UET \n", - "24 ocn 3D monthly 20C 1920-01 2005-12 UVEL \n", - "25 ocn 3D monthly RCP85 2006-01 2100-12 UVEL \n", - "26 ocn 3D monthly CTRL 0400-01 2200-12 UVEL \n", - "27 ocn 3D monthly 20C 1920-01 2005-12 VNS \n", - "28 ocn 3D monthly RCP85 2006-01 2100-12 VNS \n", - "29 ocn 3D monthly CTRL 0400-01 2200-12 VNS \n", - "30 ocn 3D monthly 20C 1920-01 2005-12 VNT \n", - "31 ocn 3D monthly RCP85 2006-01 2100-12 VNT \n", - "32 ocn 3D monthly CTRL 0400-01 2200-12 VNT \n", - "33 ocn 3D monthly 20C 1920-01 2005-12 VVEL \n", - "34 ocn 3D monthly RCP85 2006-01 2100-12 VVEL \n", - "35 ocn 3D monthly CTRL 0400-01 2200-12 VVEL \n", - "36 ocn 3D monthly 20C 1920-01 2005-12 WTS \n", - "37 ocn 3D monthly RCP85 2006-01 2100-12 WTS \n", - "38 ocn 3D monthly CTRL 0400-01 2200-12 WTS \n", - "39 ocn 3D monthly 20C 1920-01 2005-12 WTT \n", - "40 ocn 3D monthly RCP85 2006-01 2100-12 WTT \n", - "41 ocn 3D monthly CTRL 0400-01 2200-12 WTT \n", - "42 ocn 3D monthly 20C 1920-01 2005-12 WVEL \n", - "43 ocn 3D monthly RCP85 2006-01 2100-12 WVEL \n", - "44 ocn 3D monthly CTRL 0400-01 2200-12 WVEL \n", - "\n", - " long_name \\\n", - "0 Dissolved Inorganic Carbon \n", - "1 Dissolved Inorganic Carbon \n", - "2 Dissolved Inorganic Carbon \n", - "3 Dissolved Organic Carbon \n", - "4 Dissolved Organic Carbon \n", - "5 Dissolved Organic Carbon \n", - "6 Dissolved Oxygen \n", - "7 Dissolved Oxygen \n", - "8 Dissolved Oxygen \n", - "9 Potential Density Ref to Surface \n", - "10 Potential Density Ref to Surface \n", - "11 Potential Density Ref to Surface \n", - "12 Salinity \n", - "13 Salinity \n", - "14 Salinity \n", - "15 Potential Temperature \n", - "16 Potential Temperature \n", - "17 Potential Temperature \n", - "18 Salt Flux in grid-x direction \n", - "19 Salt Flux in grid-x direction \n", - "20 Salt Flux in grid-x direction \n", - "21 Heat Flux in grid-x direction \n", - "22 Heat Flux in grid-x direction \n", - "23 Heat Flux in grid-x direction \n", - "24 Velocity in grid-x direction \n", - "25 Velocity in grid-x direction \n", - "26 Velocity in grid-x direction \n", - "27 Salt Flux in grid-y direction \n", - "28 Salt Flux in grid-y direction \n", - "29 Salt Flux in grid-y direction \n", - "30 Heat Flux in grid-y direction \n", - "31 Heat Flux in grid-y direction \n", - "32 Heat Flux in grid-y direction \n", - "33 Velocity in grid-y direction \n", - "34 Velocity in grid-y direction \n", - "35 Velocity in grid-y direction \n", - "36 Salt Flux across top face \n", - "37 Salt Flux across top face \n", - "38 Salt Flux across top face \n", - "39 Heat Flux across top face \n", - "40 Heat Flux across top face \n", - "41 Heat Flux across top face \n", - "42 Vertical Velocity \n", - "43 Vertical Velocity \n", - "44 Vertical Velocity \n", - "\n", - " path \n", - "0 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-DIC... \n", - "1 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-D... \n", - "2 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-DI... \n", - "3 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-DOC... \n", - "4 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-D... \n", - "5 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-DO... \n", - "6 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-O2.... \n", - "7 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-O... \n", - "8 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-O2... \n", - "9 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-PD.... \n", - "10 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-P... \n", - "11 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-PD... \n", - "12 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-SAL... \n", - "13 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-S... \n", - "14 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-SA... \n", - "15 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-TEM... \n", - "16 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-T... \n", - "17 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-TE... \n", - "18 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-UES... \n", - "19 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U... \n", - "20 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-UE... \n", - "21 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-UET... \n", - "22 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U... \n", - "23 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-UE... \n", - "24 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-UVE... \n", - "25 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U... \n", - "26 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-UV... \n", - "27 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-VNS... \n", - "28 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V... \n", - "29 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-VN... \n", - "30 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-VNT... \n", - "31 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V... \n", - "32 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-VN... \n", - "33 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-VVE... \n", - "34 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V... \n", - "35 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-VV... \n", - "36 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-WTS... \n", - "37 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... \n", - "38 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-WT... \n", - "39 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-WTT... \n", - "40 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... \n", - "41 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-WT... \n", - "42 s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-WVE... \n", - "43 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... \n", - "44 s3://ncar-cesm-lens/ocn/monthly/cesmLE-CTRL-WV... " - ] - }, - "execution_count": 23, - "metadata": {}, - "output_type": "execute_result" - } - ], + "outputs": [], "source": [ "df = coll.search(dim=\"3D\",component=\"ocn\").df\n", "df" @@ -3172,284 +499,9 @@ }, { "cell_type": "code", - "execution_count": 24, + "execution_count": null, "metadata": {}, - "outputs": [ - { - "data": { - "text/html": [ - "
\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
componentdimfrequencyexperimentstartendvariablelong_namepath
0ocn3DmonthlyRCP852006-012100-12DICDissolved Inorganic Carbons3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-D...
1ocn3DmonthlyRCP852006-012100-12DOCDissolved Organic Carbons3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-D...
2ocn3DmonthlyRCP852006-012100-12O2Dissolved Oxygens3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-O...
3ocn3DmonthlyRCP852006-012100-12PDPotential Density Ref to Surfaces3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-P...
4ocn3DmonthlyRCP852006-012100-12SALTSalinitys3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-S...
5ocn3DmonthlyRCP852006-012100-12TEMPPotential Temperatures3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-T...
6ocn3DmonthlyRCP852006-012100-12UESSalt Flux in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U...
7ocn3DmonthlyRCP852006-012100-12UETHeat Flux in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U...
8ocn3DmonthlyRCP852006-012100-12UVELVelocity in grid-x directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U...
9ocn3DmonthlyRCP852006-012100-12VNSSalt Flux in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V...
10ocn3DmonthlyRCP852006-012100-12VNTHeat Flux in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V...
11ocn3DmonthlyRCP852006-012100-12VVELVelocity in grid-y directions3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V...
12ocn3DmonthlyRCP852006-012100-12WTSSalt Flux across top faces3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W...
13ocn3DmonthlyRCP852006-012100-12WTTHeat Flux across top faces3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W...
14ocn3DmonthlyRCP852006-012100-12WVELVertical Velocitys3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W...
\n", - "
" - ], - "text/plain": [ - " component dim frequency experiment start end variable \\\n", - "0 ocn 3D monthly RCP85 2006-01 2100-12 DIC \n", - "1 ocn 3D monthly RCP85 2006-01 2100-12 DOC \n", - "2 ocn 3D monthly RCP85 2006-01 2100-12 O2 \n", - "3 ocn 3D monthly RCP85 2006-01 2100-12 PD \n", - "4 ocn 3D monthly RCP85 2006-01 2100-12 SALT \n", - "5 ocn 3D monthly RCP85 2006-01 2100-12 TEMP \n", - "6 ocn 3D monthly RCP85 2006-01 2100-12 UES \n", - "7 ocn 3D monthly RCP85 2006-01 2100-12 UET \n", - "8 ocn 3D monthly RCP85 2006-01 2100-12 UVEL \n", - "9 ocn 3D monthly RCP85 2006-01 2100-12 VNS \n", - "10 ocn 3D monthly RCP85 2006-01 2100-12 VNT \n", - "11 ocn 3D monthly RCP85 2006-01 2100-12 VVEL \n", - "12 ocn 3D monthly RCP85 2006-01 2100-12 WTS \n", - "13 ocn 3D monthly RCP85 2006-01 2100-12 WTT \n", - "14 ocn 3D monthly RCP85 2006-01 2100-12 WVEL \n", - "\n", - " long_name \\\n", - "0 Dissolved Inorganic Carbon \n", - "1 Dissolved Organic Carbon \n", - "2 Dissolved Oxygen \n", - "3 Potential Density Ref to Surface \n", - "4 Salinity \n", - "5 Potential Temperature \n", - "6 Salt Flux in grid-x direction \n", - "7 Heat Flux in grid-x direction \n", - "8 Velocity in grid-x direction \n", - "9 Salt Flux in grid-y direction \n", - "10 Heat Flux in grid-y direction \n", - "11 Velocity in grid-y direction \n", - "12 Salt Flux across top face \n", - "13 Heat Flux across top face \n", - "14 Vertical Velocity \n", - "\n", - " path \n", - "0 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-D... \n", - "1 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-D... \n", - "2 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-O... \n", - "3 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-P... \n", - "4 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-S... \n", - "5 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-T... \n", - "6 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U... \n", - "7 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U... \n", - "8 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-U... \n", - "9 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V... \n", - "10 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V... \n", - "11 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-V... \n", - "12 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... \n", - "13 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... \n", - "14 s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... " - ] - }, - "execution_count": 24, - "metadata": {}, - "output_type": "execute_result" - } - ], + "outputs": [], "source": [ "df = coll.search(dim=\"3D\",component=\"ocn\", end='2100-12').df\n", "df"