add full ingestor integration test
- initiated by fixes of values finally allowing full through-run of ingestor -> preprocessor -> registrar in CI
- update of SECRET values also took place, adding filters for
item.href
and adding second data configuration:swift-data-fullpipeline
- any path matching
OA/.*
usespvs_testing
bucket for registrar - any path not matching this pattern uses the newly created bucket with randomized name
- any path matching
- correctly cleanup bucket after ingestor full test now that it works
- pytest
test_registrar
andtest_renderer
now allows a custom CLI parameter--fullpipeline
which replaces the csv file used for checking the successful registration (should match what the ingestor pushes)