Workflow automation
Requirements from agri:
- Trigger manually or via cron
- Access to secrets (DB credentials, API credentials)
- Temporary storage (up to a few dozen GBs)
- Persistent storage to save result files (few GBs)
- Access to result files/artifacts (maybe just result notebook)
- Access to error logs (e.g. via notebook)
- Reporting of status to slack?
- Run in own docker container?
- Runtime: a few hours
Requirements from VS:
- Nice to have: docker swarm support