Issue in some CNRM-CM5 files and implications for CMIP5 and CORDEX users
Problème dans certains fichiers de CNRM-CM5 et implications pour les utilisateurs CMIP5 et CORDEX




put data


Only data provider can upload netcdf files to the database.

  • using FTP, data providers upload their data to their own incoming path.
    incoming path is<institution>
    where "institution" is the short name of the data provider's institution
    There is no need to create sub-directories, but if they exists they will not harm since the automatic procedure will process any file in any sub-directory
  • Once a day each an automatic procedure "ingests" newly uploaded files.
    The procedure searches each data providers' incoming path for a file named PLEASEgo.txt.
    If the file is present, then the procedure does the following for each file *.nc present in data providers' incoming path:
    1. it verifies the .nc file is a netcdf file, otherways the file is rejected.
    2. it executes "ncdump -h" of the .nc file saving the output to a file named *.ncdump
    3. it verifies the .nc file has the global attribute "Conventions", otherways the file is rejected. If the value of "Conventions" is not "CF-1.6" it is set to "CF-1.6"
    4. it executes cfcheck of the .nc file saving the output to a file named *.cfcheck
    5. it splits filenames in tokens and checks their compliance to CORDEX standard, otherways the file is rejected.
    6. it checks validity of variable name (it is already known), otherways the file is rejected.
    7. it creates, if not already existing, the required MEDCORDEXPATH as defined here.
    8. it moves the files .nc .ncdump and .cfcheck into MEDCORDEXPATH
    9. it inserts/updates the file's record in the db that can be searched on the web.
    When all provider's files are processed a mail is sent to him/her with the log of what happened ingesting his/her data
  • files with errors are left in the incoming path, the database is left unchanged and a warning is sent to the data manager
  • data priveders can also ftp to to get data uploaded by any other institution
  • authorized users can ftp to to get data uploaded by any institution
put data