New Dataset - Idealised ocean channel model with peninsulas

[RachelFurner]

Dataset Name

ocean channel model with peninsulas

Dataset URL

No response

Description

This file is output from a highly idealised run of MITgcm, using a channel model configuration with two land peninsulas and idealised forcing.
The configuration was used for a soon to be published paper.
While highly idealised, the configuration contains realistic ocean dynamics. As such, it provides a nice testbed for machine learning approaches, without the computational overhead of a full ocean-dataset.

Size

Single file, size 394GB

License

Creative Comms

Data Format

NetCDF

Data Format (other)

No response

Access protocol

FTP

Source File Organization

There is one very big file. This contains 50 years of data at 12 hourly outputting.
The grid is 240 by 105 by 38.
It could be ncks'ed it into temporal chunks if needed.
Variables contained are potential temperature, Sea surface height, zonal and meridional components of currents, Temperature forcing, and zonal wind stress (the highly idealised nature of the configuration means meridional wind stress is zero in all locations and at all times).

Example URLs

No response

Authorization

None

Transformation / Processing

The file should be useable as is.

Target Format

Zarr

Comments

No response

[norlandrhagen]

Hey there @RachelFurner, do you have a link to the NetCDF file?

[RachelFurner]

Hi Raphael, So sorry for the slow response. I don't have a link - I've not managed to find anywhere to store the data previously, so just have it on my old institution's hpc. I should be able to ftp it, or upload etc, if you have somewhere suitable. Thanks, Rachel

…

On Fri, 1 Nov 2024 at 21:31, Raphael Hagen ***@***.***> wrote: Hey there @RachelFurner <https://github.com/RachelFurner>, do you have a link to the NetCDF file? — Reply to this email directly, view it on GitHub <#169 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ALOCO6FOS2IZGZKVWBR2CMTZ6PXMXAVCNFSM6AAAAABRA7FDDOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINJSGYYTSNJXHA> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[norlandrhagen]

Hey Rachel,

No worries! Yeah, if you can transfer it to a leap bucket, that would be ideal.
There are some docs for using rclone with leap here. I can get you credentials for the source bucket when you're ready.

[RachelFurner]

Thanks, my data is currently one very large netcdf file. I note from the documentation you'd prefer it in zarr form (and appreciate why!), but I've not done this kind of conversion before. Is it ok to upload as a netcdf file anyway, or are you able to give me some instructions on converting to zarr?

[norlandrhagen]

We are happy to concert it to Zarr for you and add it to the LEAP catalog. If you are able to move the netcdf file to that OSN bucket or some other cloud storage we can take it from there.

Happy to chat on Zoom next week if That's helpful.

[RachelFurner]

Great, thanks, if you can give me credentials for the course bucket I'll have a go at uploading it. Thanks!

[RachelFurner]

Hi, just to prod on this. I believe I need some credentials so I can upload my dataset,
Thanks,
Rachel

[norlandrhagen]

Hey @RachelFurner! Thanks for the reminder and appologies for the delay. Any chance you have access to the LEAP or ESIP slack channels? If not, would you mind sending me an email at [email protected].

cc @jbusecke

[norlandrhagen]

Hi there @RachelFurner, just a quick ping in case my email got lost.

[norlandrhagen]

Update Feb 24th: @RachelFurner is working on transferring the files from an HPC to leap OSN inbox.