Skip to content

update workarenax.csv #383

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
chenemil merged 2 commits into from
Jan 26, 2026
+50 −0
Merged

update workarenax.csv #383

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
7f750f4
update workarenax.csv
chenemil Jan 21, 2026
d352f49
append hard tasks at end
chenemil Jan 26, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
50 changes: 50 additions & 0 deletions browsergym/experiments/src/browsergym/experiments/benchmark/metadata/workarenax.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -156,3 +156,53 @@ workarenax.erpnext.create_payment_entry_without_cost_center.154,workarenax,erpne
workarenax.erpnext.create_payment_entry_without_cost_center.155,workarenax,erpnext,create-payment-entry-without-cost-center,test
workarenax.erpnext.create_payment_entry_with_cost_center_cheque_date_reference.156,workarenax,erpnext,create-payment-entry-with-cost-center-cheque-date-reference,test
workarenax.erpnext.create_payment_entry_with_cost_center_cheque_date_reference.157,workarenax,erpnext,create-payment-entry-with-cost-center-cheque-date-reference,test
Copy link
Copy Markdown
Collaborator

@marquezo marquezo Jan 22, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would have thought you just appended new tasks to the end, but I see ids have changed: create-payment-entry-with-cost-center-cheque-date-reference used to be 156 and 157 but now they are 142 and 143. How come?

Copy link
Copy Markdown
Collaborator Author

@chenemil chenemil Jan 23, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ah i was grouping similar tasks together (so all the create_user tasks follow one another, etc.) but i can modify to just append if we need to maintain the same ids from previous runs

Copy link
Copy Markdown
Collaborator

@marquezo marquezo Jan 23, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that would be better, so every time we add new tasks, we are just adding. Otherwise, it may seem as we are replacing tasks

Copy link
Copy Markdown
Collaborator Author

@chenemil chenemil Jan 23, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

makes sense, i'll update the other PR with the jsonl so it also appends

workarenax.erpnext.create_user_group_with_new_users_HARD.158,workarenax,erpnext,create-user-group-with-new-users-HARD,test
workarenax.erpnext.create_user_group_with_new_users_HARD.159,workarenax,erpnext,create-user-group-with-new-users-HARD,test
workarenax.erpnext.create_user_group_with_new_users_HARD.160,workarenax,erpnext,create-user-group-with-new-users-HARD,test
workarenax.erpnext.create_user_with_email_account_dependency_HARD.161,workarenax,erpnext,create-user-with-email-account-dependency-HARD,test
workarenax.erpnext.create_user_with_email_account_dependency_HARD.162,workarenax,erpnext,create-user-with-email-account-dependency-HARD,test
workarenax.erpnext.create_user_with_email_account_dependency_HARD.163,workarenax,erpnext,create-user-with-email-account-dependency-HARD,test
workarenax.erpnext.create_customer_with_account_manager_group_tax_dependencies_HARD.164,workarenax,erpnext,create-customer-with-account-manager-group-tax-dependencies-HARD,test
workarenax.erpnext.create_customer_with_account_manager_group_tax_dependencies_HARD.165,workarenax,erpnext,create-customer-with-account-manager-group-tax-dependencies-HARD,test
workarenax.erpnext.create_customer_with_account_manager_group_tax_dependencies_HARD.166,workarenax,erpnext,create-customer-with-account-manager-group-tax-dependencies-HARD,test
workarenax.erpnext.create_customer_with_account_manager_role_profile_group_tax_dependencies_HARD.167,workarenax,erpnext,create-customer-with-account-manager-role-profile-group-tax-dependencies-HARD,test
workarenax.erpnext.create_customer_with_account_manager_role_profile_group_tax_dependencies_HARD.168,workarenax,erpnext,create-customer-with-account-manager-role-profile-group-tax-dependencies-HARD,test
workarenax.erpnext.create_customer_with_account_manager_role_profile_group_tax_dependencies_HARD.169,workarenax,erpnext,create-customer-with-account-manager-role-profile-group-tax-dependencies-HARD,test
workarenax.erpnext.create_sales_invoice_with_customer_item_account_dependencies_HARD.170,workarenax,erpnext,create-sales-invoice-with-customer-item-account-dependencies-HARD,test
workarenax.erpnext.create_sales_invoice_with_customer_item_account_dependencies_HARD.171,workarenax,erpnext,create-sales-invoice-with-customer-item-account-dependencies-HARD,test
workarenax.erpnext.create_sales_invoice_with_customer_item_account_dependencies_HARD.172,workarenax,erpnext,create-sales-invoice-with-customer-item-account-dependencies-HARD,test
workarenax.erpnext.create_sales_invoice_with_customer_item_territory_pricelist_account_dependencies_HARD.173,workarenax,erpnext,create-sales-invoice-with-customer-item-territory-pricelist-account-dependencies-HARD,test
workarenax.erpnext.create_sales_invoice_with_customer_item_territory_pricelist_account_dependencies_HARD.174,workarenax,erpnext,create-sales-invoice-with-customer-item-territory-pricelist-account-dependencies-HARD,test
workarenax.erpnext.create_sales_invoice_with_customer_item_territory_pricelist_account_dependencies_HARD.175,workarenax,erpnext,create-sales-invoice-with-customer-item-territory-pricelist-account-dependencies-HARD,test
workarenax.erpnext.create_employee_full_address_HARD.176,workarenax,erpnext,create-employee-full-address-HARD,test
workarenax.erpnext.create_employee_full_address_HARD.177,workarenax,erpnext,create-employee-full-address-HARD,test
workarenax.erpnext.create_employee_full_address_HARD.178,workarenax,erpnext,create-employee-full-address-HARD,test
workarenax.erpnext.create_employee_with_emergency_contact_HARD.179,workarenax,erpnext,create-employee-with-emergency-contact-HARD,test
workarenax.erpnext.create_employee_with_emergency_contact_HARD.180,workarenax,erpnext,create-employee-with-emergency-contact-HARD,test
workarenax.erpnext.create_employee_with_emergency_contact_HARD.181,workarenax,erpnext,create-employee-with-emergency-contact-HARD,test
workarenax.erpnext.create_journal_entry_with_account_dependency_HARD.182,workarenax,erpnext,create-journal-entry-with-account-dependency-HARD,test
workarenax.erpnext.create_journal_entry_with_account_dependency_HARD.183,workarenax,erpnext,create-journal-entry-with-account-dependency-HARD,test
workarenax.erpnext.create_payment_entry_with_customer_account_project_dependencies_HARD.184,workarenax,erpnext,create-payment-entry-with-customer-account-project-dependencies-HARD,test
workarenax.erpnext.create_payment_entry_with_customer_account_project_dependencies_HARD.185,workarenax,erpnext,create-payment-entry-with-customer-account-project-dependencies-HARD,test
workarenax.erpnext.create_payment_entry_with_customer_account_project_dependencies_HARD.186,workarenax,erpnext,create-payment-entry-with-customer-account-project-dependencies-HARD,test
workarenax.erpnext.create_payment_entry_with_mode_of_payment_account_supplier_cost_center_dependencies_HARD.187,workarenax,erpnext,create-payment-entry-with-mode-of-payment-account-supplier-cost-center-dependencies-HARD,test
workarenax.erpnext.create_payment_entry_with_mode_of_payment_account_supplier_cost_center_dependencies_HARD.188,workarenax,erpnext,create-payment-entry-with-mode-of-payment-account-supplier-cost-center-dependencies-HARD,test
workarenax.erpnext.create_payment_entry_with_mode_of_payment_account_supplier_cost_center_dependencies_HARD.189,workarenax,erpnext,create-payment-entry-with-mode-of-payment-account-supplier-cost-center-dependencies-HARD,test
workarenax.erpnext.create_project_with_customer_full_address_HARD.190,workarenax,erpnext,create-project-with-customer-full-address-HARD,test
workarenax.erpnext.create_project_with_customer_full_address_HARD.191,workarenax,erpnext,create-project-with-customer-full-address-HARD,test
workarenax.erpnext.create_project_with_customer_full_address_HARD.192,workarenax,erpnext,create-project-with-customer-full-address-HARD,test
workarenax.erpnext.create_project_with_type_dept_cost_center_dependencies_HARD.193,workarenax,erpnext,create-project-with-type-dept-cost-center-dependencies-HARD,test
workarenax.erpnext.create_project_with_type_dept_cost_center_dependencies_HARD.194,workarenax,erpnext,create-project-with-type-dept-cost-center-dependencies-HARD,test
workarenax.erpnext.create_project_with_type_dept_cost_center_dependencies_HARD.195,workarenax,erpnext,create-project-with-type-dept-cost-center-dependencies-HARD,test
workarenax.erpnext.create_project_with_type_dept_customer_cost_center_dependencies_HARD.196,workarenax,erpnext,create-project-with-type-dept-customer-cost-center-dependencies-HARD,test
workarenax.erpnext.create_project_with_type_dept_customer_cost_center_dependencies_HARD.197,workarenax,erpnext,create-project-with-type-dept-customer-cost-center-dependencies-HARD,test
workarenax.erpnext.create_project_with_type_dept_customer_cost_center_dependencies_HARD.198,workarenax,erpnext,create-project-with-type-dept-customer-cost-center-dependencies-HARD,test
workarenax.erpnext.create_project_with_type_dept_dependencies_HARD.199,workarenax,erpnext,create-project-with-type-dept-dependencies-HARD,test
workarenax.erpnext.create_project_with_type_dept_dependencies_HARD.200,workarenax,erpnext,create-project-with-type-dept-dependencies-HARD,test
workarenax.erpnext.create_project_with_type_dept_dependencies_HARD.201,workarenax,erpnext,create-project-with-type-dept-dependencies-HARD,test
workarenax.erpnext.create_task_with_project_type_dept_dependencies_HARD.202,workarenax,erpnext,create-task-with-project-type-dept-dependencies-HARD,test
workarenax.erpnext.create_task_with_project_type_dept_dependencies_HARD.203,workarenax,erpnext,create-task-with-project-type-dept-dependencies-HARD,test
workarenax.erpnext.create_task_with_project_type_dept_dependencies_HARD.204,workarenax,erpnext,create-task-with-project-type-dept-dependencies-HARD,test
workarenax.erpnext.create_task_with_project_type_parent_dept_dependencies_HARD.205,workarenax,erpnext,create-task-with-project-type-parent-dept-dependencies-HARD,test
workarenax.erpnext.create_task_with_project_type_parent_dept_dependencies_HARD.206,workarenax,erpnext,create-task-with-project-type-parent-dept-dependencies-HARD,test
workarenax.erpnext.create_task_with_project_type_parent_dept_dependencies_HARD.207,workarenax,erpnext,create-task-with-project-type-parent-dept-dependencies-HARD,test
Loading