FEATURE: Multiple step in one repo
When designing a multi step package, it is quite overwhelming to have to deal with several repository for the same project, it would be nicer to have a repo that holds all steps and eventually provides a way to share resources between projects: the dockerfile for instance.
Dockerfile
get_data/
|__ drun.sh
|__ dexplore.sh
|__ requirements.txt
|__ products/
|__ parameters/
reduce_data/
|__ drun.sh
|__ dexplore.sh
|__ requirements.txt
|__ products/
|__ parameters/
analyse_data/
|__ drun.sh
|__ dexplore.sh
|__ requirements.txt
|__ products/
|__ parameters/
In such a situation one should be able to create three packages providing the proper parameters from a single repository:
kufair package create --dockerfile=Dockerfile --param-repo=get_data/parameters --param-mount=/home/user/parameters --product-mount=/home/user/products --explore=get_data/dexplore.sh --run=get_data/drun.sh
> generate the get_data package
kufair package create --dockerfile=Dockerfile --param-repo=get_data/parameters --param-mount=/home/user/parameters --product-mount=/home/user/products --explore=get_data/dexplore.sh --run=get_data/drun.sh
> generate the reduce_data package
kufair package create --dockerfile=Dockerfile --param-repo=get_data/parameters --param-mount=/home/user/parameters --product-mount=/home/user/products --explore=get_data/dexplore.sh --run=get_data/drun.sh
> generate the analyse_data package