-
Notifications
You must be signed in to change notification settings - Fork 388
docs: add CLAUDE.md and Agents.md for AI coding assistant guidance #5437
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Changes from 6 commits
9fc6302
4b74650
b2536ac
8fc73dd
f47de70
bfa02ac
8e17f24
9a3590d
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,187 @@ | ||
| # AGENTS.md | ||
|
|
||
| Project instructions for **AI coding assistants and agents** (OpenAI Codex, Cursor, GitHub Copilot, Claude Code, and similar tools). This file is meant to be **self-contained** so any agent that discovers `AGENTS.md` gets enough context without another product-specific file. | ||
|
|
||
| Codex users: see [Custom instructions with AGENTS.md](https://developers.openai.com/codex/guides/agents-md/) for how global and project instructions merge and for the default combined size limit (`project_doc_max_bytes`, often 32 KiB). | ||
|
|
||
| This repo also has **`CLAUDE.md`**, tuned for **Claude Code** (shorter session prompt, `@` imports, `.claude/rules/`). Keep factual content aligned when you change workflows or versions. | ||
|
|
||
| ## Project overview | ||
|
|
||
| Bee is the reference Go implementation of an Ethereum Swarm node. It implements decentralized storage and communication: content-addressed chunk storage, Kademlia-based routing, postage stamp accounting, push/pull syncing, PSS messaging, feeds, and storage incentives (redistribution game). | ||
|
|
||
| **Module**: `github.com/ethersphere/bee/v2` | ||
| **Go version**: 1.26 (see `go.mod`) | ||
| **License**: BSD 3-clause (see `LICENSE`) | ||
| **Default branch**: `master` | ||
|
|
||
| Human-oriented contributing docs: `CONTRIBUTING.md`, `CODING.md`, `CODINGSTYLE.md`, `README.md`. | ||
|
|
||
| ## Build and test commands | ||
|
|
||
| ```bash | ||
| make binary # build dist/bee (CGO_ENABLED=0, version ldflags injected) | ||
| make build # compile all packages | ||
| make test # unit tests (-failfast) | ||
| make test-race # unit tests with race detector | ||
| make test-integration # integration tests (requires -tags=integration) | ||
| make lint # golangci-lint v2.11.3 (see .golangci.yml) | ||
| make vet # go vet | ||
| make format # gofumpt + gci | ||
| make protobuf # regenerate protobuf files (requires protoc + gogofaster) | ||
| make clean # remove dist/ and go clean | ||
| make docker-build # build Docker image via Dockerfile.dev | ||
| ``` | ||
|
|
||
| CI-oriented targets: `make test-ci` / `make test-ci-race` (see `Makefile` for flags). | ||
|
|
||
| Beekeeper integration testing: | ||
|
|
||
| - `make beekeeper` — install beekeeper tool | ||
| - `make beelocal` — start local k3s cluster | ||
| - `make deploylocal` — deploy bee cluster | ||
| - `make testlocal` — run integration checks (pingpong, connectivity, pushsync, retrieval, etc.) | ||
|
|
||
| ## Architecture | ||
|
|
||
| ### Entry point and CLI | ||
|
|
||
| Binary built from `cmd/bee/main.go`. CLI uses Cobra + Viper: | ||
|
|
||
| - `bee start` — full or light node (`cmd/bee/cmd/start.go`) | ||
| - `bee init` — initialize data directory | ||
| - `bee deploy` — deploy smart contracts | ||
| - `bee db` — database management | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Should we go even deeper with
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
| - `bee version` — print version info | ||
|
|
||
| Configuration: option constants in `cmd/bee/cmd/cmd.go`. Viper reads CLI flags, environment variables (`BEE_` prefix), and YAML config. | ||
|
|
||
| ### Node bootstrap | ||
|
|
||
| `pkg/node/node.go` is the main orchestrator. `NewBee()` wires subsystems via dependency injection; avoid global mutable state. The `Bee` struct holds service references and provides `Shutdown()` for teardown. | ||
|
|
||
| ### HTTP API | ||
|
|
||
| - Router: `gorilla/mux` in `pkg/api/router.go` | ||
| - Route groups in `Mount()`: | ||
| - `mountTechnicalDebug()` — `/node`, `/addresses`, `/health`, `/readiness`, `/metrics`, `/loggers`, pprof | ||
| - `mountBusinessDebug()` — topology, accounting, settlements, stamps management | ||
| - `mountAPI()` — `/bytes`, `/chunks`, `/bzz`, `/feeds`, `/soc`, `/stamps`, `/tags`, `/pins`, `/pss`, `/grantee` | ||
| - `checkRouteAvailability` can block endpoints during sync | ||
| - OpenAPI: `openapi/Swarm.yaml` (API versioning follows SemVer there; the main Bee release version does not) | ||
| - Endpoints exist at root (e.g. `/bytes`) and under `/v1/` (e.g. `/v1/bytes`) | ||
|
|
||
| ### P2P networking | ||
|
|
||
| - Transport: libp2p (`pkg/p2p/libp2p/`) | ||
| - Wire formats: protobuf (gogo) — each protocol area has a `pb/` directory with `.proto` and `doc.go` (`go:generate` calling `protoc` + `--gogofaster_out`) | ||
| - Important protocol packages: `pushsync`, `pullsync`, `retrieval`, `pingpong`, `hive`, `pricing` | ||
|
|
||
| ### Storage | ||
|
|
||
| - Chunk types: CAC (`pkg/cac/`), SOC (`pkg/soc/`) | ||
| - Interfaces: `pkg/storage/` (`Putter`, `Getter`, `Hasser`, `Deleter`) | ||
| - Local store: `pkg/storer/` (reserve, cache, upload, pinning) | ||
| - Blob engine: `pkg/sharky/` | ||
| - BMT: `pkg/bmt/` | ||
| - State: `pkg/statestore/` (LevelDB); `pkg/shed/` (typed LevelDB layer) | ||
|
|
||
| ### Postage and incentives | ||
|
|
||
| - `pkg/postage/` — batches, stamps, services | ||
| - `pkg/postage/listener/` — on-chain events | ||
| - `pkg/postage/postagecontract/` — contract interaction | ||
| - Stamps: batch ID, depth (capacity), amount (per-chunk value) | ||
| - `pkg/storageincentives/` — redistribution / storage incentive game | ||
|
|
||
| ## Key domain concepts | ||
|
|
||
| - **Address** — 32-byte hash (`pkg/swarm/`). Chunk and overlay addresses; proximity is XOR-based (more shared prefix bits = closer), not numeric ordering. | ||
| - **Chunk** — 4096 bytes of data (`ChunkSize = SectionSize * Branches = 32 * 128`), plus 8-byte span (`SpanSize`); `ChunkWithSpanSize = 4104`. | ||
| - **CAC** — content-addressed chunk; address from BMT root of data. | ||
| - **SOC** — single owner chunk; address from owner + id, with signature. | ||
| - **PO** — proximity order (shared prefix bits). `MaxPO = 31`, `ExtendedPO = 36`. | ||
| - **Neighborhood** — prefix / responsibility region for storage and sync. | ||
| - **Kademlia** — routing table over XOR distance (`pkg/topology/`). | ||
| - **Postage stamp** — payment signal attached to chunks. | ||
| - **Push sync / pull sync** — push new data toward neighborhood; pull historical sync between peers. | ||
| - **Redistribution** — incentive game proving reserve storage. | ||
|
|
||
| ## Coding conventions (summary) | ||
|
|
||
| Authoritative detail: `CODING.md` and `CODINGSTYLE.md`. | ||
|
|
||
| ### Copyright (goheader) | ||
|
|
||
| Every `.go` file starts with: | ||
|
|
||
| ```go | ||
| // Copyright <year> The Swarm Authors. All rights reserved. | ||
| // Use of this source code is governed by a BSD-style | ||
| // license that can be found in the LICENSE file. | ||
| ``` | ||
|
|
||
| ### Errors, logging, concurrency | ||
|
|
||
| - Propagate errors; do not log and return the same error. Use `fmt.Errorf("context: %w", err)`. Avoid stacking "failed to" prefixes. | ||
| - Sentinel errors: `var ErrFoo = errors.New("package: description")` when appropriate. | ||
| - Logging: separate operator-facing (`Error`/`Warning`) from developer detail (`Debug`, V-levels). Keys: `lower_snake_case`, specific names. Runtime log tuning: `/loggers` API. | ||
| - Every goroutine needs a clear shutdown path. Channels: prefer unbuffered or size 1 unless strongly justified; an owning goroutine sends or closes. | ||
|
|
||
| ### Testing | ||
|
|
||
| - Prefer external test packages: `package foo_test` not `package foo`. | ||
| - `export_test.go` in the real package to export symbols only for tests. | ||
| - Use `t.Parallel()` where safe. Avoid the word `fail` in test names. Integration: `-tags=integration`. Prefer `t.Fatal` / `t.FailNow` over `panic` in tests. | ||
|
|
||
| ### Style and tooling | ||
|
|
||
| - American English (e.g. marshaling, canceled). | ||
| - Avoid `init()` where possible (`gochecknoinits`). | ||
| - Enums often start at `iota + 1` when zero should mean "unset". | ||
| - Use `time.Time` / `time.Duration`, not raw ints for time. | ||
| - `var _ Interface = (*Impl)(nil)` where useful. | ||
| - Dependency injection over mutable globals. Exit only from `main()`. | ||
|
|
||
| ### Commits | ||
|
|
||
| [Conventional Commits](https://www.conventionalcommits.org/en/v1.0.0/). Allowed types in this repo: `build`, `chore`, `ci`, `docs`, `feat`, `fix`, `perf`, `refactor`, `revert`, `test` (`commitlint.config.js`). Header max 100 characters; footer lines max 72. Imperative subject. | ||
|
|
||
| ### Linting | ||
|
|
||
| `golangci-lint` v2 per `.golangci.yml`. Notable: `goheader`, `paralleltest`, `misspell`, `errorlint`, `gochecknoinits`, `prealloc`, `forbidigo` (no `fmt.Print` except under `cmd/bee/cmd/`), `govet` with `enable-all` (minus `fieldalignment`, `shadow`). Run `make lint` and `make format`. | ||
|
|
||
|
Comment on lines
+175
to
+178
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. For lint section it is enough to have: |
||
| ## Directory structure (high level) | ||
|
|
||
| ``` | ||
| cmd/bee/ CLI and Cobra commands | ||
| openapi/ OpenAPI specs (Swarm.yaml, SwarmCommon.yaml) | ||
| packaging/ deb, rpm, homebrew, scoop, docker, systemd | ||
| pkg/ | ||
| api/ HTTP API | ||
| node/ composition root | ||
| swarm/ Address, Chunk, core constants | ||
| p2p/ libp2p transport | ||
| topology/ Kademlia | ||
| storage/ storage interfaces | ||
| storer/ local storer implementation | ||
| sharky/ blob slots | ||
| postage/ stamps and batches | ||
| storageincentives/ redistribution | ||
| pushsync/ pullsync/ retrieval/ pingpong/ hive/ pricing/ # protocols | ||
| feeds/ pss/ soc/ cac/ bmt/ manifest/ accesscontrol/ redundancy/ replicas/ | ||
| settlement/ accounting/ crypto/ keystore/ log/ metrics/ tracing/ | ||
| ... ~60 packages total | ||
| ``` | ||
|
Comment on lines
+179
to
+200
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. There is no actual value from this incompleted list. I would remove ti |
||
|
|
||
| ## Common pitfalls | ||
|
|
||
| - Do not confuse `ChunkSize` (4096 data bytes) with `ChunkWithSpanSize` (4104 including span). | ||
| - XOR distance: "closer" is more shared prefix bits, not smaller integers. | ||
| - Do not both log and return the same error. | ||
| - Tests: `foo_test` + `export_test.go` pattern. | ||
| - Goroutines must be stoppable (context cancel, quit channel, etc.). | ||
| - Full node vs light node: reserve and storage incentives are full-node concerns. | ||
| - Postage batches can be unusable (expired, depleted, unsynced); check before relying on stamps. | ||
| - `*.pb.go` files are committed; regenerate with `make protobuf` after `.proto` changes. | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
|
||
| - Default branch name is `master`, not `main`. | ||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,67 @@ | ||
| # CLAUDE.md | ||
|
|
||
| Instructions for [Claude Code](https://docs.anthropic.com/en/docs/claude-code/overview) in this repository. This file is loaded as project context at session start. For the full, tool-neutral project guide (Codex, Cursor, Copilot, etc.), see `AGENTS.md`. | ||
|
|
||
| Official reference: [How Claude remembers your project](https://docs.anthropic.com/en/docs/claude-code/claude-md). | ||
|
|
||
| ## Claude Code–specific notes | ||
|
|
||
| - Prefer **concise, verifiable** bullets; long prose belongs in repo docs, not here. | ||
| - **Personal overrides** (not committed): `CLAUDE.local.md` at repo root (add to `.gitignore` if you create it). | ||
| - **Path-scoped rules**: `.claude/rules/` for conventions tied to directories or file patterns. | ||
| - **Pull in more context** when needed (imports resolve relative to this file): | ||
| - @CODING.md @CODINGSTYLE.md @CONTRIBUTING.md | ||
| - @README.md | ||
| - Run **`/init`** in Claude Code to refresh or extend this file from the codebase; merge by hand rather than losing team edits. | ||
|
|
||
| ## Project snapshot | ||
|
|
||
| Bee is the reference Go implementation of an Ethereum Swarm node: chunk storage, Kademlia routing, postage, push/pull sync, PSS, feeds, storage incentives. | ||
|
|
||
| | Item | Value | | ||
| |------|--------| | ||
| | Module | `github.com/ethersphere/bee/v2` | | ||
| | Go | 1.26 (`go.mod`) | | ||
| | Default branch | `master` | | ||
| | License | BSD 3-clause (`LICENSE`) | | ||
|
|
||
| ## Commands (verify before shipping) | ||
|
|
||
| ```bash | ||
| make binary # dist/bee, CGO_ENABLED=0 + ldflags | ||
| make build # compile all packages | ||
| make test # unit tests (-failfast) | ||
| make test-race # + race detector | ||
| make test-integration # -tags=integration | ||
| make lint && make vet # golangci-lint v2.11.3 + go vet | ||
| make format # gofumpt + gci | ||
| make protobuf # needs protoc + gogofaster | ||
| ``` | ||
|
|
||
| CI: `make test-ci` / `make test-ci-race` (see `Makefile`). Beekeeper: `make beekeeper`, `make beelocal`, `make deploylocal`, `make testlocal`. | ||
|
|
||
| ## Where things live | ||
|
|
||
| | Area | Location | | ||
| |------|-----------| | ||
| | CLI | `cmd/bee/` (Cobra + Viper; options in `cmd/bee/cmd/cmd.go`, env `BEE_*`) | | ||
| | Bootstrap | `pkg/node/node.go` — `NewBee()`, DI, `Shutdown()` | | ||
| | HTTP API | `pkg/api/router.go` — technical debug, business debug, public API; `openapi/Swarm.yaml` | | ||
| | P2P | `pkg/p2p/libp2p/`; protobuf per protocol under `*/pb/` (`doc.go` + `go:generate`) | | ||
| | Core types | `pkg/swarm/` — `Address`, `Chunk`, `ChunkSize` (4096) + span (8) → `ChunkWithSpanSize` 4104 | | ||
| | Store | `pkg/storer/`, `pkg/storage/`, `pkg/sharky/`, `pkg/statestore/`, `pkg/shed/` | | ||
| | Chunks | `pkg/cac/`, `pkg/soc/` | | ||
| | Postage | `pkg/postage/` (+ `listener/`, `postagecontract/`) | | ||
| | Incentives | `pkg/storageincentives/` | | ||
|
|
||
| Protocols to remember by name: `pushsync`, `pullsync`, `retrieval`, `pingpong`, `hive`, `pricing`. | ||
|
|
||
| ## Rules Claude should not forget | ||
|
|
||
| - **Errors:** propagate; do not log and return the same error. Wrap with `fmt.Errorf("…: %w", err)`. Skip noisy "failed to" chains. | ||
| - **Tests:** prefer `package foo_test`; `export_test.go` for test-only exports; `t.Parallel()` where safe; integration uses `-tags=integration`. | ||
| - **Go files:** Swarm copyright header (see `goheader` in `.golangci.yml`). American English. No `init()` unless unavoidable. No `fmt.Print` outside `cmd/bee/cmd/` (forbidigo). | ||
| - **Commits:** Conventional Commits; types in `commitlint.config.js`; header ≤100 chars, footer lines ≤72. | ||
| - **Product facts:** Bee release version is not strict SemVer; HTTP API version in `openapi/Swarm.yaml` is. XOR proximity, not numeric order. `MaxPO` 31, `ExtendedPO` 36. | ||
|
|
||
| When in doubt, read `AGENTS.md` for the long-form map and pitfalls, or import the coding docs above. |

There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This can be removed.