Ingestor fails to save success/fail file if already exists.
Ingestor: When it tries to save the "ingestor success" file when it is already present there. (ingested before already), the commands crashes because it already exists. Here are the logs from one such event on reference platform.
Feb 2, 2021 @ 09:17:52.950 [2021-02-02 08:17:52,947][filedaemon] ERROR: Destination path '/var/ingestor/success/CDD_PDAS_20200925_090956239.xml' already exists
Feb 2, 2021 @ 09:17:52.950 Traceback (most recent call last):
Feb 2, 2021 @ 09:17:52.950 File "/filedaemon.py", line 101, in process_IN_CLOSE_WRITE
Feb 2, 2021 @ 09:17:52.950 save_mount_report(event.pathname, True)
Feb 2, 2021 @ 09:17:52.950 File "/ingestor/util.py", line 49, in save_mount_report
Feb 2, 2021 @ 09:17:52.950 shutil.move(data, save_dir)
Feb 2, 2021 @ 09:17:52.950 File "/usr/lib/python3.6/shutil.py", line 548, in move
Feb 2, 2021 @ 09:17:52.950 raise Error("Destination path '%s' already exists" % real_dst)
Feb 2, 2021 @ 09:17:52.950 shutil.Error: Destination path '/var/ingestor/success/CDD_PDAS_20200925_090956239.xml' already exists
Feb 2, 2021 @ 09:17:52.945 [2021-02-02 08:17:52,944][filedaemon] INFO: Parsing browse file: /mnt/data/CDD_PDAS_20200925_090956239.xml
Feb 2, 2021 @ 09:17:52.945 [2021-02-02 08:17:52,945][filedaemon] DEBUG: data26/0000120743/SP07_NAO_MS4__3_20180922T122315_20180922T122332_TOU_1234_aa94.DIMA.tar
Feb 2, 2021 @ 09:17:52.938 [2021-02-02 08:17:52,938][filedaemon] DEBUG: data26/0000120698/SP07_NAO_MS4__3_20190725T095121_20190725T095133_TOU_1234_d25e.DIMA.tar
Feb 2, 2021 @ 09:17:52.936 [2021-02-02 08:17:52,933][filedaemon] INFO: Parsing browse file: /mnt/data/CDD_PDAS_20200925_090742918.xml
It does not crash the whole ingestion, as this step happens after putting item to preprocess queue.
Solution: overwrite the file or fail silently.