Related packages¶
- Luigi focuses on managing large, complex graphs of commands, possibly distributed across multiple machines. From the developers: “Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.”
- Sacred focuses on configuration management and random number generator seed control. It’s more oriented towards writing scripts than writing APIs. From the developers: “Sacred is a tool to help you configure, organize, log and reproduce experiments.”
- GNU Make. Sometimes it’s best to just keep things simple : )