Testing using gitlab.ci
How is tested:
- gitlab.ci: split current build stage in build and deploy. Add testing stage in between
Preparations:
- Create a new bucket with
- Input data (copied from ONDA): for each mission a couple files
- Preprocessed data (copy from our internal buckets)
Setup:
- Override root bucket to
testing_<commit-hash>
- Pass this bucket name to configure.sh
What is tested:
-
ingestor:
- input: browse report put via sftp to pyinotify watched folder
- output: item gets parsed, put to preprocess queue, and is preprocessed
-
preprocessor:
- input: input data from our own static test data bucket
- output: preprocessed images stored on testing bucket
- tests:
-
existence of file -
structure of preprocessed image (format, size, overviews)
-
-
registrar/renderer/seeder/cache:
- input: preprocessed image on static test data bucket
- output: database models
- tests:
-
existence of DB models -
Testing renderer services -
OpenSearch -
WMS -
WCS -
DSEO
-
- Testing cache services
-
WMS
-
-
- redis flow - ingestor/sftp -> preprocessor -> registrar -> reporting/sftp
-
tpz accessibility item as input
Teardown:
-
Delete the bucket from the setup stage
Useful approach:
- re-run the gitlab.ci steps locally to avoid multiple pushing