Chapter 5 Automation

There are many ways to automate data infrastructures. Here, we use github actions, which seem like a natural choice given that the whole infrastructure is hosted on github. However, note that alternatives could be considered especially for group owning a dedicated server which they can administrate at will - this will likely be a more robust solution for achieving automation. In particular, it would make troubleshooting much easier, as github actions do not let the user directly interact with the server running the jobs.

In this chapter, we provide a few insights into how github actions have been implemented.