Large output files

[SarahAlidoost]

The model output has many files. See the list of output files below:

output files

aerodyn.csv
AR-SLu_2022-07-08-1312_STEMMUS_SCOPE.nc
BOC_irradiance.csv
ECdata.csv
fluorescence.csv
fluorescence_emitted_by_all_leaves.csv
fluorescence_emitted_by_all_photosystems.csv
fluorescence_hemis.csv
fluorescence_scattered.csv
fluorescence_shaded.csv
fluorescence_sunlit.csv
fluxes.csv
gap.csv
irradiance_spectra.csv
layer_A.csv
layer_aPAR_Cab.csv
layer_aPAR.csv
layer_fluorescence.csv
layer_H.csv
layer_lE.csv
layer_NPQ.csv
layer_Rn.csv
leaftemp.csv
output.mat
Parameters
radiation.csv
reflectance.csv
Sim_Temp.csv
Sim_Theta.csv
spectrum_hemis.csv
spectrum_obsdir_BlackBody.csv
spectrum_obsdir.csv
surftemp.csv
wlF.txt
wlS.txt

Some of them are larger than the rest i.e. BOC_irradiance.csv, irradiance_spectra.csv, output.mat reflectance.csv, spectrum_hemis.csv, spectrum_obsdir_BlackBody.csv, spectrum_obsdir.csv

For details, see two examples below.

size (in Mb) of output files at AR-SLu

2M   aerodyn.csv
  9M   AR-SLu_2022-07-08-1312_STEMMUS_SCOPE.nc
584M   BOC_irradiance.csv
  2M   ECdata.csv
 29M   fluorescence.csv
 29M   fluorescence_emitted_by_all_leaves.csv
 29M   fluorescence_emitted_by_all_photosystems.csv
 29M   fluorescence_hemis.csv
 29M   fluorescence_scattered.csv
 30M   fluorescence_shaded.csv
 29M   fluorescence_sunlit.csv
  5M   fluxes.csv
 40M   gap.csv
264M   irradiance_spectra.csv
 14M   layer_A.csv
  8M   layer_aPAR_Cab.csv
  8M   layer_aPAR.csv
  9M   layer_fluorescence.csv
 14M   layer_H.csv
 14M   layer_lE.csv
  9M   layer_NPQ.csv
 14M   layer_Rn.csv
 39M   leaftemp.csv
280M   output.mat
  1M   Parameters
  2M   radiation.csv
301M   reflectance.csv
 12M   Sim_Temp.csv
 12M   Sim_Theta.csv
293M   spectrum_hemis.csv
468M   spectrum_obsdir_BlackBody.csv
293M   spectrum_obsdir.csv
  2M   surftemp.csv
  1M   wlF.txt
  1M   wlS.txt

size (in Mb) of output files at US-GLE

  11M   aerodyn.csv
3642M   BOC_irradiance.csv
  11M   ECdata.csv
 169M   fluorescence.csv
 169M   fluorescence_emitted_by_all_leaves.csv
 169M   fluorescence_emitted_by_all_photosystems.csv
 169M   fluorescence_hemis.csv
 169M   fluorescence_scattered.csv
 169M   fluorescence_shaded.csv
 169M   fluorescence_sunlit.csv
  29M   fluxes.csv
 239M   gap.csv
1649M   irradiance_spectra.csv
  83M   layer_A.csv
  49M   layer_aPAR_Cab.csv
  49M   layer_aPAR.csv
  49M   layer_fluorescence.csv
  84M   layer_H.csv
  80M   layer_lE.csv
  49M   layer_NPQ.csv
  83M   layer_Rn.csv
 245M   leaftemp.csv
1590M   output.mat
   1M   Parameters
  12M   radiation.csv
1863M   reflectance.csv
  73M   Sim_Temp.csv
  71M   Sim_Theta.csv
1821M   spectrum_hemis.csv
2819M   spectrum_obsdir_BlackBody.csv
1821M   spectrum_obsdir.csv
  10M   surftemp.csv
  54M   US-GLE_2022-07-08-1312_STEMMUS_SCOPE.nc
   1M   wlF.txt
   1M   wlS.txt

@yijianzeng @Yunfei-Wang1993 @Crystal-szj @DanyangYu Is it possible to skip some of these output files or some of the variables inside these files?

Please note that the netcdf files are not very large. Therefore, this issue is only related to storing all output files and not to uploading the netcdf files to the model evaluation.

[bobzsu]

The model output has many files. See the list of output files below:

output files
Some of them are larger than the rest i.e. BOC_irradiance.csv, irradiance_spectra.csv, output.mat reflectance.csv, spectrum_hemis.csv, spectrum_obsdir_BlackBody.csv, spectrum_obsdir.csv

many of these files are not needed for the time being, for the model evaluation only the fluxes are taken up in the netcdf files. If the storage is a problem I suggest to comment out some of the outputs:

584M BOC_irradiance.csv
29M fluorescence_emitted_by_all_leaves.csv
29M fluorescence_emitted_by_all_photosystems.csv
29M fluorescence_hemis.csv
29M fluorescence_scattered.csv
30M fluorescence_shaded.csv
29M fluorescence_sunlit.csv
40M gap.csv
264M irradiance_spectra.csv
293M spectrum_hemis.csv
468M spectrum_obsdir_BlackBody.csv
293M spectrum_obsdir.csv

Yunfei: please check if all ouputs are in output.mat, if so, you do not need all the csv files. needed ones can be extracted later.

301M reflectance.csv maybe useful to compare with in-situ spectral measurements and after integration with in-band response functions to compare with broad band measurments.

[MostafaGomaa93]

The large output files are commented in this PR