Skip to content

ARGO-5351 Computation submit scripts that use the new config.yml#457

Merged
themiszamani merged 1 commit intoARGOeu:develfrom
kaggis:run-batch
Feb 6, 2026
Merged

ARGO-5351 Computation submit scripts that use the new config.yml#457
themiszamani merged 1 commit intoARGOeu:develfrom
kaggis:run-batch

Conversation

@kaggis
Copy link
Copy Markdown
Contributor

@kaggis kaggis commented Feb 5, 2026

Goal

Automation efforts introduced a new engine configuration file 🛠️ 📄 --> config.yml that replaces the old ini .conf files
We need to provide some cli script for submitting flink jobs such as computations, ingestion etc that use the new file format and require the least amount of arguments to work

Implementation

  • Extend config file with a new run section of configuration options such as flink_path, hdfs_path and jar paths for the flink jobs
  • Update the argo_config.py component to handle the new configuration options
  • Create a run_ingest python executable script
  • Create a run_batch python executable script
  • Remove .py extension for argo_automator to indicate an entrypoint python executable script (consistent with the other two)

@kaggis kaggis requested a review from themiszamani February 5, 2026 16:58
@kaggis kaggis force-pushed the run-batch branch 5 times, most recently from f555587 to 6a64a95 Compare February 5, 2026 17:20
@themiszamani themiszamani merged commit 2c31f22 into ARGOeu:devel Feb 6, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants