users should be notified of AS crashes
due to esarchive failures, AS frequently (maybe once a week) crashes and users are not made aware of this, loosing precious time while the experiment could be running.
unless users enable email alerts for COMPLETED jobs, there is no way a user can know that the experiment is not doing anything after an AS crash (without actively monitoring the experiment, which is not ideal).
Would it be possible to send email alerts when AS crashes due to such failures?
e.g. expid a3ba runnning AS 0.13
1105 of 1509 jobs remaining (23:05)
Job a3ba_ASThread_16165175265672_528_12 is QUEUING (Priority)
Job a3ba_18500101_fc1_43_POST is QUEUING
Traceback (most recent call last):
File "/shared/earth/software/Python/2.7.9-foss-2015a/lib/python2.7/logging/__init__.py", line 883, in emit
self.flush()
File "/shared/earth/software/Python/2.7.9-foss-2015a/lib/python2.7/logging/__init__.py", line 843, in flush
self.stream.flush()
IOError: [Errno 5] Input/output error
Logged from file log.py, line 225
1105 of 1509 jobs remaining (23:24)
[ERROR] Trace: No section: 'config'
[CRITICAL] Unhandled error: If you see this message, please report it in Autosubmit's GitLab project
You have new mail in /var/mail/etourign