Skip to content

Further reading

The platform itself

ResourceCovers
DAReHub/DAReflowThe DARe prototype orchestration platform

This is the repository the Deployment Server pulls from, described in architecture. It is the primary reference for this chapter, and the only external source the handbook cites for it.

Technologies used

The platform is assembled from established open-source components. Their own documentation is the best reference for each:

TechnologyRole in the platformCovered on
Apache AirflowAuthoring, scheduling and monitoring workflows as DAGsAirflow
DockerContainerising model applicationsDocker
MinIOLocally hosted object storage, S3 compatibleData storage
PostgreSQLMetadata storageData storage
GitVersion control and lineageVersion control

Points to resolve in the source

Three items should be addressed before publication:

  • "Direct Acyclic Graphs" appears in this chapter, while the Introduction uses the standard term "directed acyclic graphs". The latter is correct and is used throughout these pages.
  • Encryption at rest and the external backup server appear only in the architecture diagram, not in the chapter text, despite being operationally significant.
  • Both figures are captioned "Figure X" in the source, with no numbering. They are numbered 3 and 4 here, continuing from the Introduction's figures.
ChapterRelevance
IMP componentsThe framework-level summary of the software platform
Transport modelMATSim, the model whose DAG illustrates this chapter
Hazard modelsCityCAT and the flood models the orchestrator also drives