Skip to content

Add benchmark analysis with cost analysis#15

Merged
jathavaan merged 1 commit into
mainfrom
feature/benchmark-analysis-notebook
May 25, 2026
Merged

Add benchmark analysis with cost analysis#15
jathavaan merged 1 commit into
mainfrom
feature/benchmark-analysis-notebook

Conversation

@jathavaan

Copy link
Copy Markdown
Collaborator

Summary

  • Refactored benchmark analysis into separate RQ1 and RQ2 notebooks with full statistical tests, visualisations, and LaTeX table exports
  • Added infrastructure cost analysis (cost bars, cost breakdown by category, cost-vs-performance scatter) to both notebooks using the already-loaded but previously unused costs_df
  • New functions: enrich_costs(), build_cost_summary(), format_cost_table(), plot_cost_bars(), plot_cost_breakdown(), plot_cost_performance()

Test plan

  • Run rq1-analysis.ipynb end-to-end and verify cost figures generate
  • Run rq2-analysis.ipynb end-to-end and verify cost figures generate
  • Confirm rq1_cost_summary.tex and rq2_cost_summary.tex render correctly in LaTeX

🤖 Generated with Claude Code

Costs were loaded but never analysed. Added enrich_costs(),
build_cost_summary(), format_cost_table(), and three chart functions
(cost bars, cost breakdown, cost-vs-performance scatter). Both
rq1 and rq2 notebooks now include a Cost Analysis section with
figures and LaTeX table export.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Copilot AI review requested due to automatic review settings May 25, 2026 13:56
@jathavaan jathavaan merged commit 5a5036c into main May 25, 2026
1 check failed
@jathavaan jathavaan deleted the feature/benchmark-analysis-notebook branch May 25, 2026 13:56
@jathavaan jathavaan removed the request for review from Copilot May 25, 2026 14:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant