Workflow automation

Requirements from agri:

• Trigger manually or via cron
• Access to secrets (DB credentials, API credentials)
• Temporary storage (up to a few dozen GBs)
• Persistent storage to save result files (few GBs)
• Access to result files/artifacts (maybe just result notebook)
• Access to error logs (e.g. via notebook)
• Reporting of status to slack?
• Run in own docker container?
• Runtime: a few hours

Requirements from VS:

• Nice to have: docker swarm support