Implement DINO object detection architecture in Keras 3 - #358

Open

mohamedamrfaroukebrahim wants to merge 60 commits into

oarriaga:paz-jaxfrom

mohamedamrfaroukebrahim:paz-jax

Commits on Apr 28, 2026

Add transformer decoder head to create dino object detector with unit tests
mohamedamrfaroukebrahim
committed
fc4c378
Add utility functions for position encoding and proposal generation in transformer decoder
mohamedamrfaroukebrahim
committed
0cc567f
Implement Segmentation Head and MLP Block for Object Detection
mohamedamrfaroukebrahim
committed
1a1bf92
Add Keras implementation of projector layers and corresponding tests
mohamedamrfaroukebrahim
committed
90c90b2
Implement DINO (LW-DETR) object detection architecture in Keras 3
mohamedamrfaroukebrahim
committed
dcf61f9
Add README files for DINO object detection model components and utilities
mohamedamrfaroukebrahim
committed
198f58a
create new RFDETR (dino_v2_object_detector) from scratch to overcome the porting issues appeared before
mohamedamrfaroukebrahim
committed
fbc945b
change the dino_v2_object_detection path to be in paz\models\detection and delete the previous versions
mohamedamrfaroukebrahim
committed
0a6b1ce
Refactor parameter handling and logging in model utilities
mohamedamrfaroukebrahim
committed
d8ce651
Enhance TrainConfig with additional parameters and update weight loading logic in Model class
mohamedamrfaroukebrahim
committed
abe0820
Add training functionality and early stopping to RFDETR model
mohamedamrfaroukebrahim
committed
1cf7781
Add projector module imports to the backbone configuration
mohamedamrfaroukebrahim
committed
e2414d7
Rebuild detection head to support dynamic class updates in LWDETR model
mohamedamrfaroukebrahim
committed
cd88c45
Integrate JAX compatibility into training loop with two-phase strategy for loss computation
mohamedamrfaroukebrahim
committed
316a99a
Update ModelEma tests to assert model_weights by variable path
mohamedamrfaroukebrahim
committed
2a4fce2
Synchronize model_config after reinitializing detection head to ensure correct class count
mohamedamrfaroukebrahim
committed
3a099e6
Enhance weight comparison tests in LWDETR and add backbone parity check in RFDETR tests
mohamedamrfaroukebrahim
committed
70a6c4f
Enhance documentation and improve code clarity across various utility modules
mohamedamrfaroukebrahim
committed
e6b5e15
Remove unused debug scripts for RFDETR model inspection and shape tracing
mohamedamrfaroukebrahim
committed
30a743b
Refactor matcher utility functions and improve test coverage
mohamedamrfaroukebrahim
committed
3b4a2b0
Enhance documentation and code clarity across RFDETR backbone (DINOv2) modules
mohamedamrfaroukebrahim
committed
008a507
Refactor transformer weight transfer utilities for improved clarity and functionality
mohamedamrfaroukebrahim
committed
f6339c4
Refactor weight transfer utilities and tests for SegmentationHead
mohamedamrfaroukebrahim
committed
a9ccfa9
Refactor LWDETR and its tests with detailed docstrings
mohamedamrfaroukebrahim
committed
ea924c3
Refactor and enhance documentation across detection module
mohamedamrfaroukebrahim
committed
a46b577
Remove extensive docstrings from configuration, engine, and main modules for RF-DETR
mohamedamrfaroukebrahim
committed
afaa6ca
Add RFDETR Backbone (Dinov2) configuration json files
mohamedamrfaroukebrahim
committed
904cb5f
Add DeepFish dataset adapter for RFDETR training
mohamedamrfaroukebrahim
committed
8f4eba7
Add MetricsTracker class for tracking and visualizing training metrics
mohamedamrfaroukebrahim
committed
cc7ed70
Add distributed training utilities for JAX support
mohamedamrfaroukebrahim
committed
a0d8aa2
Add LoRA and DoRA implementation for Dense layers in Keras
mohamedamrfaroukebrahim
committed
b50a24f
Add CocoEvaluator class for COCO metrics computation and evaluation
mohamedamrfaroukebrahim
committed
bca2793
Add dropout and export functionality to LWDETR model
mohamedamrfaroukebrahim
committed
437a8d0
Refine loss function tests for LWDETR
mohamedamrfaroukebrahim
committed
02bf111
Add data augmentation transforms for object detection
mohamedamrfaroukebrahim
committed
2afa79a
add dropout and drop path scheduling, enhance training loop
mohamedamrfaroukebrahim
committed
2bbd024
Update parity test thresholds for improved precision and add COCO data loader checks
mohamedamrfaroukebrahim
committed
5eaa6d3
Set model training flag to True during eager forward pass in training loop
mohamedamrfaroukebrahim
committed
447ea76

Commits on May 6, 2026

Merge branch 'oarriaga:paz-jax' into paz-jax
mohamedamrfaroukebrahim
authored
7390450
training code and training experiments for testing the model behaviour in training

mohamedamrfaroukebrahim
and
Copilot
committed
5b6b5f6

Commits on May 10, 2026

Commits on May 12, 2026

Commits on May 13, 2026

get back to before refactoring
mohamedamrfaroukebrahim
committed
722486d

Commits on Jun 11, 2026

Commits on Jun 16, 2026

update dinov2 init file
mohamedamrfaroukebrahim
committed
9abc333

Commits on Jun 25, 2026

Commits on Jun 27, 2026

Merge branch 'oarriaga:paz-jax' into paz-jax
mohamedamrfaroukebrahim
authored
ae7a898

Commits on Jun 30, 2026

modify requested modification
mohamedamrfaroukebrahim
committed
dea767f

Commits on Aug 3, 2026

refactor the whole dino_v2_object_detection
mohamedamrfaroukebrahim
committed
c64750a

Commits on Aug 4, 2026