Skip to content

hexanomicon/lychd

Repository files navigation

Lychd

LychD - The Dark Arts of LLM

PyPI Docs License No CLA

Summon The Lich 💀, a Phylactery-bound, LLM-animated daemon.

⚠️ Acolyte's Warning: The summoning is in its early stages. Nothings works yet -The incantations (code, documentation) are still being inscribed. Expect instability, missing components, LLM generated texts (most not curated yet), and the occasional rogue spirit. Proceed with caution.

🗺️ The Path of Ascension

The knowledge you seek is inscribed in The Hexanomicon. Follow the path to bind the daemon.

⛩️ A Tribute to the Spirits

"The Lich only sees far because it stands on the shoulders of Giants."

The Daemon utilizes the finest instruments of this age to fulfill its Prophecy

🕸️ Backend

🎭 Frontend

🌑 Containerization

🔥 Inference Engines

  • vLLM — Batching, high-throughput inference engine for GPUs.
  • Llama.cpp — Single batch server Optimised for CPU offloading of larger models.
  • SGLang — Radix attention benefit for batched agentic workflows on GPUs.
  • ExLlamaV2 — Excellent single batch serving on Ampere architecture and fractional quants.

👁️ Database & Telemetry

🛠️ Code Control

  • uv — Manager of the environment and dependencies.
  • Ruff — The polisher of the written word.
  • Pyright — Enforcer of the static types.
  • Pytest — Verifier of the logic's truth.
  • Git — Immortalizer of the project's evolution.

"The Flesh is temporary. The Word is eternal."

About

An LLM-animated daemon bound to Systemd. Forges intelligent agents using Litestar, Pydantic AI, and the Dark Arts of xDDD.

Topics

Resources

License

Contributing

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors