Repositories list

• lmms-eval

  Public
  One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

  benchmarkevaluationagi+ 8

  benchmarkevaluationagivideo-understandingvlmmultimodallarge-language-modelsvision-language-modelllm-evaluationaudio-evaluation+ 1

  Python

  •

  Other

  •594594 forks•4.2k4.2k stars•2525 issues•1111 pull requests•Updated May 30, 2026May 30, 2026

• LLaVA-OneVision-2

  Public
  Fully Open Framework for Democratized Multimodal Training

  llmmllmvision-language-model+ 3

  llmmllmvision-language-modelllavaqwen3llava-onevision

  Python

  •

  Apache License 2.0

  •7272 forks•997997 stars•4848 issues•1010 pull requests•Updated May 30, 2026May 30, 2026

• NEO

  Public
  NEO Series: Native Vision-Language Models from First Principles

  agivlmmultimodal+ 5

  agivlmmultimodallarge-language-modelsmllmmultimodal-large-language-modelsencoder-free-vlmnative-multimodal-model

  Python

  •

  Apache License 2.0

  •2828 forks•796796 stars•11 issue•00 pull requests•Updated May 28, 2026May 28, 2026

• lmms-engine

  Public
  A simple, unified multimodal models training engine. Lean, flexible, and built for hacking at scale.

  agimultimodalvideo-generation+ 2

  agimultimodalvideo-generationlarge-language-modelsunified-multimodal-models

  Python

  •3535 forks•780780 stars•1010 issues•11 pull request•Updated May 28, 2026May 28, 2026

• LongVT

  Public
  [CVPR 2026] LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Calling

  agivlmmultimodal+ 5

  agivlmmultimodalmllmlong-video-understandingmultimodal-large-language-modelslarge-multimodal-modelstool-using-agent

  Python

  •

  Apache License 2.0

  •1313 forks•234234 stars•22 issues•00 pull requests•Updated May 26, 2026May 26, 2026

• lmms-lab-writer

  Public
  Agentic LaTeX Writer - Local-first editor for AI-assisted academic writing

  editorlatexai+ 2

  editorlatexaiwritingacademic-writing

  TypeScript

  •

  MIT License

  •1717 forks•208208 stars•66 issues•00 pull requests•Updated May 25, 2026May 25, 2026

• ParaVT

  Public
  ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learning

  reinforcement-learningtool-uselong-video-understanding+ 4

  reinforcement-learningtool-uselong-video-understandingvideo-llmgrpoagentic-rlmultimodal-rl

  Python

  •

  Apache License 2.0

  •11 fork•4040 stars•11 issue•00 pull requests•Updated May 21, 2026May 21, 2026

• OneVision-Encoder

  Public
  Codec-Aligned Sparsity as a Foundational Principle for Multimodal Intelligence

  lmmsvision-transformerllava

  lmmsvision-transformerllava

  Python

  •

  Apache License 2.0

  •1919 forks•357357 stars•1212 issues•33 pull requests•Updated May 13, 2026May 13, 2026

• Evolving-Visual-Generation

  Public
  [Roadmap] Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modeling

  awesomeimage-generationworld-modeling+ 2

  awesomeimage-generationworld-modelingagenticvisual-generation

  TeX

  •55 forks•107107 stars•00 issues•00 pull requests•Updated May 13, 2026May 13, 2026

• EASI

  Public
  Holistic Evaluation of Multimodal LLMs on Spatial Intelligence

  multimodal-modelsmllmspatial-intelligence+ 1

  multimodal-modelsmllmspatial-intelligencemllm-evaluation

  Python

  •

  Apache License 2.0

  •88 forks•111111 stars•22 issues•11 pull request•Updated May 11, 2026May 11, 2026

• VLMEvalKit

  Public
  An open-source evaluation toolkit to evaluate MLLMs on Spatial Intelligence using the EASI protocol

  Python

  •

  Apache License 2.0

  •11 fork•1919 stars•00 issues•00 pull requests•Updated May 8, 2026May 8, 2026

• SimpleStream

  Public
  A simple video streaming baseline that outperforms SOTAs.

  Python

  •77 forks•132132 stars•11 issue•00 pull requests•Updated May 1, 2026May 1, 2026

• multimodal-search-r1

  Public
  [ACL-2026] MMSearch-R1 is an end-to-end RL framework that enables LMMs to perform on-demand, multi-turn search with real-world multimodal search tools.

  Python

  •

  Apache License 2.0

  •2424 forks•447447 stars•33 issues•00 pull requests•Updated Apr 7, 2026Apr 7, 2026

• OpenMMReasoner

  Public
  [CVPR 2026] OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe

  agivlmmultimodal+ 4

  agivlmmultimodalmllmmultimodal-large-language-modelslarge-multimodal-modelsmultimodal-reasoning

  Python

  •

  Apache License 2.0

  •66 forks•162162 stars•66 issues•00 pull requests•Updated Mar 30, 2026Mar 30, 2026

• free_openclaw

  Public
  Notes for using openclaw

  PowerShell

  •00 forks•11 star•00 issues•00 pull requests•Updated Mar 12, 2026Mar 12, 2026

• co-scientist

  Public
  For AI Agents to post ideas on their owns.

  TypeScript

  •

  MIT License

  •00 forks•66 stars•00 issues•00 pull requests•Updated Mar 1, 2026Mar 1, 2026

• .github

  Public
  11 fork•11 star•00 issues•22 pull requests•Updated Mar 1, 2026Mar 1, 2026

• engram

  Public
  Privacy-first AI memory layer - Signal for AI Memory. E2EE, local-first, works with Claude, Cursor, and any MCP-compatible AI.

  privacyencryptionai+ 7

  privacyencryptionaimemorymcpcursore2eeclaudelocal-firstllm

  TypeScript

  •

  Other

  •22 forks•2020 stars•00 issues•00 pull requests•Updated Feb 13, 2026Feb 13, 2026

• homebrew-tap

  Public
  Homebrew tap for LMMs-Lab applications

  Ruby

  •00 forks•11 star•00 issues•00 pull requests•Updated Jan 29, 2026Jan 29, 2026

• opencode

  Public
  The open source coding agent.

  TypeScript

  •

  MIT License

  •20k20k forks•11 star•00 issues•00 pull requests•Updated Jan 20, 2026Jan 20, 2026

• LLaVA-OneVision-1.5-RL

  Public
  Fully Open Framework for Democratized Multimodal Reinforcement Learning.

  Python

  •

  Apache License 2.0

  •44 forks•5050 stars•11 issue•00 pull requests•Updated Dec 19, 2025Dec 19, 2025

• multimodal-sae

  Public
  [ICCV 2025] Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.

  Python

  •

  Other

  •1111 forks•198198 stars•55 issues•00 pull requests•Updated Sep 26, 2025Sep 26, 2025

• VideoMMMU

  Public
  Evaluating Knowledge Acquisition from Multi-Discipline Professional Videos

  Python

  •

  Other

  •33 forks•7070 stars•33 issues•11 pull request•Updated Sep 5, 2025Sep 5, 2025

• sglang

  Public
  SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

  Python

  •

  Apache License 2.0

  •6.2k6.2k forks•33 stars•00 issues•00 pull requests•Updated Aug 26, 2025Aug 26, 2025

• DiffSynth-Studio

  Public
  Enjoy the magic of Diffusion models!

  Python

  •

  Apache License 2.0

  •1.2k1.2k forks•00 stars•00 issues•00 pull requests•Updated Aug 23, 2025Aug 23, 2025

• lean-runner

  Public
  Deploying High-Performance Lean 4 Server in One Click

  proverlean4

  proverlean4

  Python

  •

  MIT License

  •00 forks•99 stars•00 issues•11 pull request•Updated Aug 14, 2025Aug 14, 2025

• MGPO

  Public
  High-Resolution Visual Reasoning via Multi-Turn Grounding-Based Reinforcement Learning

  00 forks•5454 stars•44 issues•00 pull requests•Updated Jul 23, 2025Jul 23, 2025

• sae

  Public
  A framework that allows you to apply Sparse AutoEncoder on any models

  Python

  •33 forks•5454 stars•33 issues•00 pull requests•Updated Jul 11, 2025Jul 11, 2025

• openevolve

  Public
  Open-source implementation of AlphaEvolve

  Python

  •

  Apache License 2.0

  •1k1k forks•22 stars•00 issues•00 pull requests•Updated Jun 20, 2025Jun 20, 2025

• DeepEyes

  Public
  Python

  •

  Apache License 2.0

  •7777 forks•33 stars•00 issues•00 pull requests•Updated Jun 16, 2025Jun 16, 2025