Publication to Envidat

The vision is that a dataset hosted on the meteoio webservice could be easily be pushed to Envidat for final publication. The workflow would be the following:

1. The data owner triggers an OnDemand run for the time period of interest;
2. Once the data has been generated and if necessary visually controlled, the data owner can click on a button "Publish to Envidat";
3. An Envidat dataset creation page opens up with the metadata fields pre-populated with the metadata that has been defined by the meteoio webservice;
4. The data owner can make some changes, either in meteoio and rerun again or in Envidat only;
5. When everything is OK, the data owner validates the publication.

This means that the meteoio webservice must provide Envidat with metadata, data and notify Envidat that there is a new dataset to create. A way to advise the data owners about which metadata fields they should consider providing would be beneficial. Some sort of metadata validator too!

In terms of metadata, here are the requirements:

• The metadata in ncml format is mapped to the Envidat metadata;
• The ncml file is sent to Envidat (directly through an API or written on Amazon S3 and the link is sent to Envidat?)
• In order to the DOI to be written within the data file, a doi reservation process must be in place: when controlling the metadata in Envidat, reserve the doi, copy it into the INI file in the meteoio webservice, rerun and update in Envidat
• the publisher will change from the meteoio webservice to the Envidat team when the final dataset is published by Envidat. This metadata should also be changed within the data file, dynamically overwriting the publisher fields...

In terms of data, here are the requirements:

• Make the data available in Envidat's S3 bucket (warn the data owners that these buckets are public)