[REQUEST]: CMIP6-global-3D-dataset: #184
Comments
|
Hi @cbian-prog, that url is hard to parse for me. Could you try to follow these instructions to get a properly formated list? |
|
CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r5i1p1f1.Omon.vo.gn.v20210311', |
|
Hi Julius，
Thanks for the message. I have updated the format! Please download it as soon as possible, some necessary results should be submitted at end of this month.
Best,
Ce
From: Julius Busecke ***@***.***>
Date: Thursday, November 7, 2024 at 10:25 AM
To: leap-stc/cmip6-leap-feedstock ***@***.***>
Cc: cbian-prog ***@***.***>, Mention ***@***.***>
Subject: Re: [leap-stc/cmip6-leap-feedstock] [REQUEST]: CMIP6-global-3D-dataset: (Issue #184)
Hi @cbian-prog<https://github.com/cbian-prog>, that url is hard to parse for me. Could you try to follow these instructions<https://github.com/leap-stc/cmip6-leap-feedstock#how-can-i-request-new-data> to get a properly formated list?
—
Reply to this email directly, view it on GitHub<#184 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/BLXMIKRB4CXANSCCDP3A7ODZ7OBAFAVCNFSM6AAAAABRHPAL26VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINRSGUZDAOBUGI>.
You are receiving this because you were mentioned.Message ID: ***@***.***>
|
|
I am adding the requested datasets here. Please follow updates there and also you can periodically check progress like this: iids_requested = [
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r5i1p1f1.Omon.vo.gn.v20210311',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p4f1.Omon.vo.gr.v20230616',
'CMIP6.CMIP.NCAR.CESM2.historical.r8i1p1f1.Omon.wo.gn.v20190311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r13i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r20i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r5i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r3i1p1f1.Omon.wo.gn.v20191108',
'CMIP6.CMIP.NCAR.CESM2.historical.r6i1p1f1.Omon.wo.gn.v20190308',
'CMIP6.CMIP.CCCma.CanESM5.historical.r10i1p2f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r10i1p1f1.Omon.uo.gn.v20190313',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r2i1p1f1.Omon.dissicnat.gr.v20190920',
'CMIP6.CMIP.CCCma.CanESM5.historical.r11i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r3i1p1f1.Omon.wo.gr.v20200702',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r1i1p1f1.Omon.vo.gn.v20191120',
'CMIP6.CMIP.NCAR.CESM2.historical.r2i1p1f1.Omon.dissicnat.gr.v20190308',
'CMIP6.CMIP.CCCma.CanESM5.historical.r2i1p2f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r9i1p1f1.Omon.vo.gn.v20210909',
'CMIP6.CMIP.CCCma.CanESM5.historical.r20i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r3i1p2f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r10i1p1f1.Omon.dissicnat.gn.v20190313',
'CMIP6.CMIP.CCCma.CanESM5.historical.r1i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r3i1p1f1.Omon.vo.gn.v20210311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r14i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r10i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r1i1p1f1.Omon.uo.gn.v20190308',
'CMIP6.CMIP.CCCma.CanESM5.historical.r25i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r22i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r3i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r11i1p1f1.Omon.dissicnat.gr.v20190514',
'CMIP6.CMIP.CCCma.CanESM5.historical.r10i1p2f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r1i2p2f1.Omon.wo.gn.v20220915',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r1i1p1f1.Omon.wo.gr.v20191108',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r4i1p1f1.Omon.vo.gn.v20210311',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r1i2p2f1.Omon.vo.gn.v20220915',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r2i1p1f1.Omon.wo.gn.v20200218',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r1i1000p1f1.Omon.wo.gn.v20201029',
'CMIP6.CMIP.CCCma.CanESM5.historical.r14i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r3i1p1f1.Omon.vo.gn.v20190308',
'CMIP6.CMIP.NCAR.CESM2.historical.r5i1p1f1.Omon.dissicnat.gn.v20190308',
'CMIP6.CMIP.CCCma.CanESM5.historical.r9i1p2f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r15i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r10i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r2i1p1f1.Omon.uo.gn.v20190917',
'CMIP6.CMIP.CCCma.CanESM5.historical.r8i1p2f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p1f1.Omon.vo.gn.v20190815',
'CMIP6.CMIP.CCCma.CanESM5.historical.r12i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r4i1p2f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r3i1p1f1.Omon.wo.gn.v20210311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r6i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r17i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r1i1p1f1.Omon.uo.gn.v20210311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r23i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r3i1p1f1.Omon.dissicnat.gr.v20200702',
'CMIP6.CMIP.NCAR.CESM2-WACCM-FV2.historical.r1i1p1f1.Omon.uo.gn.v20191120',
'CMIP6.CMIP.CCCma.CanESM5.historical.r21i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r9i1p1f1.Omon.dissicnat.gn.v20190311',
'CMIP6.CMIP.NCAR.CESM2.historical.r8i1p1f1.Omon.dissicnat.gn.v20190311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r5i1p2f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r16i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r2i1p1f1.Omon.uo.gn.v20200218',
'CMIP6.CMIP.CCCma.CanESM5.historical.r25i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r6i1p1f1.Omon.uo.gn.v20190308',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r1i1p1f1.Omon.vo.gn.v20191108',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r3i1p1f1.Omon.vo.gn.v20200226',
'CMIP6.CMIP.NCAR.CESM2.historical.r5i1p1f1.Omon.dissicnat.gr.v20190308',
'CMIP6.CMIP.CCCma.CanESM5.historical.r11i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r4i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r2i1p1f1.Omon.vo.gn.v20200218',
'CMIP6.CMIP.CCCma.CanESM5.historical.r1i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r3i1p1f1.Omon.wo.gn.v20190308',
'CMIP6.CMIP.NCAR.CESM2.historical.r2i1p1f1.Omon.dissicnat.gn.v20190308',
'CMIP6.CMIP.NCAR.CESM2.historical.r4i1p1f1.Omon.wo.gn.v20190308',
'CMIP6.CMIP.CCCma.CanESM5.historical.r23i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r14i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r11i1p1f1.Omon.uo.gn.v20190514',
'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r3i1p1f1.Omon.dissicnat.gn.v20190808',
'CMIP6.CMIP.NCAR.CESM2.historical.r2i1p1f1.Omon.uo.gn.v20190308',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p1f1.Omon.wo.gr.v20191108',
'CMIP6.CMIP.CCCma.CanESM5.historical.r7i1p2f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r1i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r8i1p1f1.Omon.vo.gn.v20210909',
'CMIP6.CMIP.CCCma.CanESM5.historical.r12i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r1i1p1f1.Omon.dissicnat.gn.v20191120',
'CMIP6.CMIP.CCCma.CanESM5.historical.r10i1p2f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r4i1p1f1.Omon.dissicnat.gr.v20190308',
'CMIP6.CMIP.NCAR.CESM2.historical.r6i1p1f1.Omon.dissicnat.gr.v20190308',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r3i1p1f1.Omon.uo.gn.v20200702',
'CMIP6.CMIP.CCCma.CanESM5.historical.r5i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r9i1p1f1.Omon.dissicnat.gr.v20190311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r19i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r7i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r2i1p1f1.Omon.vo.gn.v20190920',
'CMIP6.CMIP.NCAR.CESM2.historical.r3i1p1f1.Omon.uo.gn.v20190308',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r3i1p1f1.Omon.vo.gn.v20190920',
'CMIP6.CMIP.NCAR.CESM2.historical.r5i1p1f1.Omon.wo.gn.v20190308',
'CMIP6.CMIP.NCAR.CESM2.historical.r9i1p1f1.Omon.vo.gn.v20190311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r2i1p2f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r7i1p2f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p4f1.Omon.dissicnat.gr.v20230616',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r1i1p1f1.Omon.dissicnat.gr.v20191120',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r1i2p1f1.Omon.wo.gn.v20210311',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r2i1p1f1.Omon.wo.gn.v20191108',
'CMIP6.CMIP.NCAR.CESM2-WACCM-FV2.historical.r2i1p1f1.Omon.dissicnat.gr.v20200226',
'CMIP6.CMIP.NCAR.CESM2.historical.r2i1p1f1.Omon.vo.gn.v20190308',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r2i1p1f1.Omon.uo.gn.v20210311',
'CMIP6.CMIP.NCAR.CESM2.historical.r10i1p1f1.Omon.wo.gn.v20190313',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r3i1p1f1.Omon.wo.gr.v20191108',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p4f1.Omon.uo.gr.v20230616',
'CMIP6.CMIP.CCCma.CanESM5.historical.r15i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r17i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r6i1p1f1.Omon.vo.gn.v20190308',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r3i1p1f1.Omon.dissicnat.gn.v20200226',
'CMIP6.CMIP.CCCma.CanESM5.historical.r23i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p1f1.Omon.vo.gr.v20190815',
'CMIP6.CMIP.NCAR.CESM2.historical.r8i1p1f1.Omon.uo.gn.v20190311',
'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r2i1p1f1.Omon.wo.gn.v20190917',
'CMIP6.CMIP.NCAR.CESM2.historical.r3i1p1f1.Omon.dissicnat.gn.v20190308',
'CMIP6.CMIP.NCAR.CESM2-WACCM-FV2.historical.r3i1p1f1.Omon.wo.gn.v20200226',
'CMIP6.CMIP.CCCma.CanESM5.historical.r25i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r4i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r2i1p1f1.Omon.vo.gn.v20210311',
'CMIP6.CMIP.NCAR.CESM2.historical.r11i1p1f1.Omon.wo.gn.v20190514',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r1i2p1f1.Omon.uo.gn.v20210311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r21i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r1i1p1f1.Omon.wo.gn.v20210311',
'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r1i1p1f1.Omon.dissicnat.gr.v20190808',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r1i2p1f1.Omon.vo.gn.v20210311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r9i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r2i1p1f1.Omon.uo.gn.v20190920',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r10i1p1f1.Omon.vo.gn.v20210909',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r2i1p1f1.Omon.wo.gr.v20200218',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r2i1p1f1.Omon.dissicnat.gn.v20200226',
'CMIP6.CMIP.NCAR.CESM2-WACCM-FV2.historical.r3i1p1f1.Omon.vo.gn.v20200226',
'CMIP6.CMIP.CCCma.CanESM5.historical.r2i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r2i1p1f1.Omon.wo.gn.v20200226',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r1i1p1f1.Omon.dissicnat.gr.v20191108',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r6i1p1f1.Omon.wo.gn.v20210909',
'CMIP6.CMIP.CCCma.CanESM5.historical.r24i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r9i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r10i1p1f1.Omon.wo.gn.v20210909',
'CMIP6.CMIP.NCAR.CESM2-WACCM-FV2.historical.r2i1p1f1.Omon.uo.gn.v20200226',
'CMIP6.CMIP.CCCma.CanESM5.historical.r8i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r8i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r1i1p1f1.Omon.vo.gr.v20191108',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r1i1p1f1.Omon.wo.gn.v20191120',
'CMIP6.CMIP.CCCma.CanESM5.historical.r15i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r5i1p1f1.Omon.uo.gn.v20210311',
'CMIP6.CMIP.NCAR.CESM2.historical.r11i1p1f1.Omon.dissicnat.gn.v20190514',
'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r1i1p1f1.Omon.vo.gn.v20190917',
'CMIP6.CMIP.NCAR.CESM2.historical.r7i1p1f1.Omon.wo.gn.v20190311',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r3i1p1f1.Omon.uo.gn.v20190920',
'CMIP6.CMIP.CCCma.CanESM5.historical.r8i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r2i1p2f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p1f1.Omon.uo.gr.v20190815',
'CMIP6.CMIP.CCCma.CanESM5.historical.r25i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r3i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-WACCM-FV2.historical.r1i1p1f1.Omon.dissicnat.gn.v20191120',
'CMIP6.CMIP.CCCma.CanESM5.historical.r1i1p2f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-WACCM-FV2.historical.r3i1p1f1.Omon.dissicnat.gr.v20200226',
'CMIP6.CMIP.CCCma.CanESM5.historical.r18i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r7i1p1f1.Omon.uo.gn.v20190311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r21i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r22i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r1i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r3i1p1f1.Omon.wo.gn.v20200702',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r6i1p1f1.Omon.vo.gn.v20210909',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r2i1p1f1.Omon.vo.gr.v20200218',
'CMIP6.CMIP.CCCma.CanESM5.historical.r7i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r3i1p2f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r1i1p2f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p4f1.Omon.uo.gn.v20230616',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r1i1p1f1.Omon.uo.gn.v20191108',
'CMIP6.CMIP.NCAR.CESM2-WACCM-FV2.historical.r2i1p1f1.Omon.vo.gn.v20200226',
'CMIP6.CMIP.CCCma.CanESM5.historical.r2i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r10i1p1f1.Omon.dissicnat.gr.v20190313',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p1f1.Omon.wo.gn.v20191108',
'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r2i1p1f1.Omon.dissicnat.gr.v20190808',
'CMIP6.CMIP.NCAR.CESM2.historical.r3i1p1f1.Omon.dissicnat.gr.v20190308',
'CMIP6.CMIP.CCCma.CanESM5.historical.r5i1p2f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-WACCM-FV2.historical.r3i1p1f1.Omon.dissicnat.gn.v20200226',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r3i1p1f1.Omon.vo.gn.v20200702',
'CMIP6.CMIP.CCCma.CanESM5.historical.r1i1p2f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r3i1p1f1.Omon.uo.gn.v20210311',
'CMIP6.CMIP.NCAR.CESM2.historical.r9i1p1f1.Omon.wo.gn.v20190311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r4i1p2f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r1i1p1f1.Omon.vo.gn.v20190308',
'CMIP6.CMIP.NCAR.CESM2.historical.r4i1p1f1.Omon.vo.gn.v20190308',
'CMIP6.CMIP.CCCma.CanESM5.historical.r18i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r2i1p1f1.Omon.vo.gr.v20190920',
'CMIP6.CMIP.CCCma.CanESM5.historical.r24i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r3i1p1f1.Omon.wo.gn.v20200226',
'CMIP6.CMIP.CCCma.CanESM5.historical.r21i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p4f1.Omon.wo.gr.v20230616',
'CMIP6.CMIP.CCCma.CanESM5.historical.r16i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r22i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r9i1p1f1.Omon.wo.gn.v20210909',
'CMIP6.CMIP.NCAR.CESM2.historical.r4i1p1f1.Omon.dissicnat.gn.v20190308',
'CMIP6.CMIP.CCCma.CanESM5.historical.r20i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r2i1p1f1.Omon.dissicnat.gn.v20190808',
'CMIP6.CMIP.CCCma.CanESM5.historical.r23i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r3i1p1f1.Omon.wo.gn.v20190917',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r5i1p1f1.Omon.wo.gn.v20210311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r3i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r3i1p2f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r10i1p2f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r3i1p1f1.Omon.uo.gr.v20190920',
'CMIP6.CMIP.CCCma.CanESM5.historical.r1i1p2f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r18i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r3i1p1f1.Omon.vo.gr.v20200702',
'CMIP6.CMIP.NCAR.CESM2.historical.r4i1p1f1.Omon.uo.gn.v20190308',
'CMIP6.CMIP.CCCma.CanESM5.historical.r9i1p2f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r1i1p1f1.Omon.wo.gn.v20190308',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r1i1000p1f1.Omon.vo.gn.v20201029',
'CMIP6.CMIP.CCCma.CanESM5.historical.r17i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r10i1p1f1.Omon.uo.gn.v20210909',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r1i1p1f1.Omon.uo.gr.v20191108',
'CMIP6.CMIP.CCCma.CanESM5.historical.r22i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r7i1p1f1.Omon.vo.gn.v20210909',
'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r1i1p1f1.Omon.dissicnat.gn.v20190808',
'CMIP6.CMIP.CCCma.CanESM5.historical.r6i1p2f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p4f1.Omon.vo.gn.v20230616',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r3i1p1f1.Omon.dissicnat.gr.v20200226',
'CMIP6.CMIP.CCCma.CanESM5.historical.r12i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r2i1p1f1.Omon.vo.gn.v20190917',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r4i1p1f1.Omon.uo.gn.v20210311',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r2i1p1f1.Omon.wo.gr.v20191108',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r3i1p1f1.Omon.dissicnat.gr.v20190920',
'CMIP6.CMIP.CCCma.CanESM5.historical.r7i1p2f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r2i1p1f1.Omon.dissicnat.gr.v20200226',
'CMIP6.CMIP.CCCma.CanESM5.historical.r4i1p2f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r7i1p1f1.Omon.dissicnat.gn.v20190311',
'CMIP6.CMIP.NCAR.CESM2-WACCM-FV2.historical.r1i1p1f1.Omon.wo.gn.v20191120',
'CMIP6.CMIP.CCCma.CanESM5.historical.r11i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r13i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r8i1p2f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r1i2p1f1.Omon.dissicnat.gn.v20210311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r11i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r10i1p1f1.Omon.vo.gn.v20190313',
'CMIP6.CMIP.CCCma.CanESM5.historical.r3i1p2f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r9i1p2f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r18i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r13i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r2i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r19i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r8i1p1f1.Omon.dissicnat.gr.v20190311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r6i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r2i1p1f1.Omon.wo.gn.v20190308',
'CMIP6.CMIP.CCCma.CanESM5.historical.r8i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r5i1p1f1.Omon.uo.gn.v20190308',
'CMIP6.CMIP.CCCma.CanESM5.historical.r7i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r5i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p1f1.Omon.uo.gn.v20190815',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r6i1p1f1.Omon.uo.gn.v20210909',
'CMIP6.CMIP.NCAR.CESM2-WACCM-FV2.historical.r1i1p1f1.Omon.dissicnat.gr.v20191120',
'CMIP6.CMIP.CCCma.CanESM5.historical.r5i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r6i1p2f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r6i1p1f1.Omon.dissicnat.gn.v20190308',
'CMIP6.CMIP.CCCma.CanESM5.historical.r9i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r15i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r6i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r2i1p1f1.Omon.uo.gn.v20200226',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r4i1p1f1.Omon.wo.gn.v20210311',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r2i1p1f1.Omon.uo.gr.v20200218',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r8i1p1f1.Omon.wo.gn.v20210909',
'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r3i1p1f1.Omon.uo.gn.v20190917',
'CMIP6.CMIP.CCCma.CanESM5.historical.r19i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r3i1p1f1.Omon.uo.gn.v20200226',
'CMIP6.CMIP.NCAR.CESM2.historical.r7i1p1f1.Omon.dissicnat.gr.v20190311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r4i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r2i1p2f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-WACCM-FV2.historical.r2i1p1f1.Omon.wo.gn.v20200226',
'CMIP6.CMIP.CCCma.CanESM5.historical.r6i1p2f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r7i1p1f1.Omon.wo.gn.v20210909',
'CMIP6.CMIP.NCAR.CESM2.historical.r5i1p1f1.Omon.vo.gn.v20190308',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r8i1p1f1.Omon.uo.gn.v20210909',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r1i1p1f1.Omon.vo.gn.v20210311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r7i1p2f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r5i1p2f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r2i1p1f1.Omon.vo.gn.v20200226',
'CMIP6.CMIP.NCAR.CESM2-WACCM-FV2.historical.r3i1p1f1.Omon.uo.gn.v20200226',
'CMIP6.CMIP.NCAR.CESM2.historical.r9i1p1f1.Omon.uo.gn.v20190311',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r1i1000p1f1.Omon.uo.gn.v20201029',
'CMIP6.CMIP.NCAR.CESM2.historical.r11i1p1f1.Omon.vo.gn.v20190514',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r3i1p1f1.Omon.uo.gr.v20200702',
'CMIP6.CMIP.CCCma.CanESM5.historical.r14i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-WACCM-FV2.historical.r1i1p1f1.Omon.vo.gn.v20191120',
'CMIP6.CMIP.NCAR.CESM2.historical.r1i1p1f1.Omon.dissicnat.gn.v20190308',
'CMIP6.CMIP.CCCma.CanESM5.historical.r10i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r3i1p1f1.Omon.dissicnat.gr.v20190808',
'CMIP6.CMIP.CCCma.CanESM5.historical.r4i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r1i1p1f1.Omon.uo.gn.v20191120',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r7i1p1f1.Omon.uo.gn.v20210909',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p4f1.Omon.wo.gn.v20230616',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r1i1p1f1.Omon.wo.gn.v20191108',
'CMIP6.CMIP.CCCma.CanESM5.historical.r6i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r1i1p1f1.Omon.wo.gn.v20190917',
'CMIP6.CMIP.CCCma.CanESM5.historical.r6i1p2f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r8i1p1f1.Omon.vo.gn.v20190311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r9i1p2f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r16i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r1i1p1f1.Omon.dissicnat.gr.v20190308',
'CMIP6.CMIP.CCCma.CanESM5.historical.r8i1p2f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r5i1p2f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r12i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-WACCM-FV2.historical.r2i1p1f1.Omon.dissicnat.gn.v20200226',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r2i1p1f1.Omon.wo.gn.v20210311',
'CMIP6.CMIP.CCCma.CanESM5.historical.r2i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-MM.historical.r2i1p1f1.Omon.dissicnat.gr.v20200218',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r2i1p1f1.Omon.uo.gr.v20190920',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r3i1p1f1.Omon.vo.gr.v20190920',
'CMIP6.CMIP.CCCma.CanESM5.historical.r13i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r17i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r24i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r10i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.NCC.NorESM2-LM.historical.r1i1p1f1.Omon.dissicnat.gr.v20190815',
'CMIP6.CMIP.CCCma.CanESM5.historical.r7i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r1i1p1f1.Omon.uo.gn.v20190917',
'CMIP6.CMIP.CCCma.CanESM5.historical.r4i1p2f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r24i1p1f1.Omon.wo.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2-FV2.historical.r1i2p2f1.Omon.uo.gn.v20220915',
'CMIP6.CMIP.NCAR.CESM2-WACCM.historical.r3i1p1f1.Omon.vo.gn.v20190917',
'CMIP6.CMIP.MRI.MRI-ESM2-0.historical.r9i1p1f1.Omon.uo.gn.v20210909',
'CMIP6.CMIP.CCCma.CanESM5.historical.r3i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r16i1p1f1.Omon.vo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r19i1p1f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r20i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r9i1p1f1.Omon.uo.gn.v20190429',
'CMIP6.CMIP.CCCma.CanESM5.historical.r8i1p2f1.Omon.dissicnat.gn.v20190429',
'CMIP6.CMIP.NCAR.CESM2.historical.r7i1p1f1.Omon.vo.gn.v20190311'
]
import intake
def zstore_to_iid(zstore: str):
# this is a bit whacky to account for the different way of storing old/new stores
iid = '.'.join(zstore.replace('gs://','').replace('.zarr','').replace('.','/').split('/')[-11:-1])
if not iid.startswith('CMIP6'):
iid = '.'.join(zstore.replace('gs://','').replace('.zarr','').replace('.','/').split('/')[-10:])
return iid
def search_iids(col_url:str):
col = intake.open_esm_datastore(col_url)
iids_all= [zstore_to_iid(z) for z in col.df['zstore'].tolist()]
return [iid for iid in iids_all if iid in iids_requested]
url_dict = {
'qc':"https://storage.googleapis.com/cmip6/cmip6-pgf-ingestion-test/catalog/catalog.json",
'non-qc':"https://storage.googleapis.com/cmip6/cmip6-pgf-ingestion-test/catalog/catalog_noqc.json",
'retracted':"https://storage.googleapis.com/cmip6/cmip6-pgf-ingestion-test/catalog/catalog_retracted.json"
}
iids_found = []
for catalog,url in url_dict.items():
iids = search_iids(url)
iids_found.extend(iids)
print(f"Found in {catalog=}: {iids=}\n")
missing_iids = list(set(iids_requested) - set(iids_found))
print(f"\n\nStill missing {len(missing_iids)} of {len(iids_requested)}: \n{missing_iids=}")
#Adopted from https://github.com/leap-stc/cmip6-leap-feedstock#i-filed-a-request-and-want-to-check-progress-how-do-i-do-that |
|
Definitely seeing a bunch of your requests in the queue. Will let this run overnight and well see! |
|
Things are still running but there are first successes here. When I ran the query above last I got over 200 iids missing. Now I get: |
|
Just checked again and now we got: 🤘 @cbian-prog can you check that you can work with the newly available data? I will run another round of ingestions soon. In general I am leaving this request open and will periodically resubmit the ingestion action, hoping that we pick up some of the datasets that might have been unavailable (this is a frequent issue with ESGF nodes). |
|
More progress: |
|
Hi Julius! I'm helping @cbian-prog with this since she's out on vacation, but she let me know she actually needs more variables, as well. In trying to get all the IDs, I got lots of "timed out" warnings, but in case this is enough, thought I'd send the code cell for the IDs. I'll try again to get the IDs themselves though! |
|
Merged #203 to add more variables and models. You can check the progress by running this on the leap hub: then in a python console/notebook (courtesy of @Timh37) #!/usr/bin/env python3
# -*- coding: utf-8 -*-
"""
Created on Tue Jan 7 16:00:35 2025
@author: timhermans
"""
from pangeo_forge_esgf.parsing import parse_instance_ids
import intake
def zstore_to_iid(zstore: str):
# this is a bit whacky to account for the different way of storing old/new stores
iid = '.'.join(zstore.replace('gs://','').replace('.zarr','').replace('.','/').split('/')[-11:-1])
if not iid.startswith('CMIP6'):
iid = '.'.join(zstore.replace('gs://','').replace('.zarr','').replace('.','/').split('/')[-10:])
return iid
def search_iids(col_url:str):
col = intake.open_esm_datastore(col_url)
iids_all= [zstore_to_iid(z) for z in col.df['zstore'].tolist()]
return [iid for iid in iids_all if iid in iids_requested]
#SSPs
parse_iids = [
"CMIP6.CMIP.*.[CESM2,CESM2-FV2,CESM2-WACCM,CESM2-WACCM-FV2,CanESM5,CanESM5-1,MRI-ESM2-0,NorESM2-LM,NorESM2-MM].[historical,ssp119,ssp245,ssp126,ssp585].*.Omon.[uo,vo,wo,dissicnat,dissic,thetao,so,tauuo,tauvo].*.*",]
iids_1 = []
for piid in parse_iids:
iids_1.extend(parse_instance_ids(piid))
#check against what's already available
iids_requested = iids_1
url_dict = {
'qc':"https://storage.googleapis.com/cmip6/cmip6-pgf-ingestion-test/catalog/catalog.json",
'non-qc':"https://storage.googleapis.com/cmip6/cmip6-pgf-ingestion-test/catalog/catalog_noqc.json",
'retracted':"https://storage.googleapis.com/cmip6/cmip6-pgf-ingestion-test/catalog/catalog_retracted.json"
}
iids_found = []
for catalog,url in url_dict.items():
iids = search_iids(url)
iids_found.extend(iids)
print(f"Found in {catalog=}: {iids=}\n")
missing_iids = list(set(iids_requested) - set(iids_found))
print(f"\n\nStill missing {len(missing_iids)} of {len(iids_requested)}: \n{missing_iids=}")Currently it shows Please check this again after this finishes. |
List of requested idds
Description
It would be greatly appreciated if the download could be completed by the end of this week. Thank you very much!
The text was updated successfully, but these errors were encountered: