Processing file error message
Hi @cmeikle ,
While running the c.process_data() function in the run_viirs.py script, several printed error messages appear indicating some files have not been processed correctly.
This was run inside a Jupyter notebook with the VIIRS parameter set to apply_qa=True. Start date was set to "202401010000" and end date to "202401040000". The error message is as follows:
Error processing file /home/tvintimi/esarchive/obs/nasa/viirs_noaa20_aerdb_l2/original_files/VIIRS/2024/003/AERDB_L2_VIIRS_NOAA20.A2024003.2354.002.2024004130809.nc: operands could not be broadcast together with shapes (156000,) (160800,) (156000,) Error processing file /home/tvintimi/esarchive/obs/nasa/viirs_noaa20_aerdb_l2/original_files/VIIRS/2024/004/AERDB_L2_VIIRS_NOAA20.A2024004.0000.002.2024004130809.nc: operands could not be broadcast together with shapes (0,) (161600,) (0,)
Error processing file /home/tvintimi/esarchive/obs/nasa/viirs_noaa20_aerdb_l2/original_files/VIIRS/2024/004/AERDB_L2_VIIRS_NOAA20.A2024004.0012.002.2024004130809.nc: operands could not be broadcast together with shapes (0,) (161600,) (0,) Error processing file /home/tvintimi/esarchive/obs/nasa/viirs_noaa20_aerdb_l2/original_files/VIIRS/2024/004/AERDB_L2_VIIRS_NOAA20.A2024004.0006.002.2024004130809.nc: operands could not be broadcast together with shapes (0,) (160800,) (0,)
The following files failed to process: ['/home/tvintimi/esarchive/obs/nasa/viirs_noaa20_aerdb_l2/original_files/VIIRS/2024/003/AERDB_L2_VIIRS_NOAA20.A2024003.2354.002.2024004130809.nc', '/home/tvintimi/esarchive/obs/nasa/viirs_noaa20_aerdb_l2/original_files/VIIRS/2024/004/AERDB_L2_VIIRS_NOAA20.A2024004.0000.002.2024004130809.nc', '/home/tvintimi/esarchive/obs/nasa/viirs_noaa20_aerdb_l2/original_files/VIIRS/2024/004/AERDB_L2_VIIRS_NOAA20.A2024004.0006.002.2024004130809.nc', '/home/tvintimi/esarchive/obs/nasa/viirs_noaa20_aerdb_l2/original_files/VIIRS/2024/004/AERDB_L2_VIIRS_NOAA20.A2024004.0012.002.2024004130809.nc']
Completed processing for month None.
Function process_data(<mapies.viirs.VIIRS object at 0x7e639de50cd0>,) {'monthly_avg': False, 'batch_size': 50} Took 138.6558 secondsNote that the script is able to continue and produce plots.