feat: add resilient background job retry & monitoring (#130)#914
Open
tarai-dl wants to merge 2 commits intorohitdash08:mainfrom
Open
feat: add resilient background job retry & monitoring (#130)#914tarai-dl wants to merge 2 commits intorohitdash08:mainfrom
tarai-dl wants to merge 2 commits intorohitdash08:mainfrom
Conversation
Implement a production-ready background job system: - Redis-backed job queue with priority support - Exponential backoff retry (configurable max retries, default 5) - Dead-letter queue for permanently failed jobs - Job status tracking in PostgreSQL - Distributed locking to prevent duplicate execution - APScheduler integration for automatic job processing - REST API for job monitoring and management - Prometheus metrics integration - Tests for queue, worker, and retry logic Closes rohitdash08#130
- Enhanced API client with exponential backoff retry logic and jitter - Added useRetry hook for wrapping async functions with retry - Created JobMonitor dashboard component with live API metrics - Added jobs API for tracking background job delivery status - Integrated JobMonitor into the Reminders page - Added comprehensive tests for retry logic and job monitoring - Updated README with documentation Closes rohitdash08#130
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Implements resilient background job retry and monitoring as described in #130.
Changes
API Client (
app/src/api/client.ts)onApiMetric()listener for real-time monitoringuseRetry Hook (
app/src/hooks/useRetry.ts)onRetry,onFailure,onSuccessloading,error,attemptsstateJob Monitor (
app/src/components/jobs/JobMonitor.tsx)Job Tracking API (
app/src/api/jobs.ts)listJobs(),retryJob(),computeJobSummary()Tests
apiClient.test.ts— Tests for backoff computation and metric listenersuseRetry.test.ts— Tests for retry hook (success, retry, failure, reset)jobs.test.ts— Tests for job summary computationDocumentation
Acceptance Criteria
Closes #130