RFC 0003: Delegate execution to workflow engines; deprecate recipes - #63
Open
petebachant wants to merge 1 commit into
Open
RFC 0003: Delegate execution to workflow engines; deprecate recipes#63petebachant wants to merge 1 commit into
petebachant wants to merge 1 commit into
Conversation
Proposes that an ASTRA analysis name the workflow engine that builds it (Analysis.workflow_engine) and that each output name its rule within that engine's own workflow definition (Output.workflow_target), deprecating the Recipe surface — command, container, and resources — as a unit. The argument: a bare command describes neither its environment nor whether it needs to run. The second failure is not fixable by adding fields, since staleness is a property of a dependency graph rather than of a command string. Underneath both is a layering rule the spec had never stated — ASTRA declares desired state; a workflow engine implements it. Additive plus deprecation; nothing is removed and every existing document remains valid. Implementation follows on branch workflow-engine. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Resolves #62
There seems to be a bit too much workflow implementation detail leaking into the ASTRA spec, which actually hurts reproducibility. This is a way to make the boundary a little more solid and make the workflow engine a bit more modular.
If humans want to read the script that produces an output, for example, they can get there via the pipeline, rather than needing to use the recipe command. This makes the ASTRA spec a bit more high level and declarative.