Feature: add a reproducibility flag
We need two flags:
- Reproducibility: True
- Verified: True
The reproducibility flag is set if data were generated via package run
The Verified flag is set if the package was run twice and products deliver same hash
We could then add a command:
kufair package make_reproducible <pakage-name> --commit=abcdefghij
This will create a package based on the setup of the given package, but will change the commit to the given one.
It will automatically make a package run
and verify that the results are same as the given package.
If yes a new package will be generated and have Reproducibility flag set.
We will add an additional command:
kufair package verify_reproducibility <package-name>
This will run the package a second time and verify that the hash of the product is identical. If yes the resulting package will obtain the Verified flag set.