Ingestor test should not use sleep
-
sleep 60
is non-deterministic and sometimes fails the CI pipeline when there is no change in code causing this failure -
it should wait for completion of preprocessing caused by ingestor by for example listening on redis set
preprocess-success_set
andpreprocess-failure_set
until product_path appears there (after clearing the set first) and this should have a reasonable timeout (a few minutes)