Skip to content

docs: explain Insider Voice, current Cat UI, and agent capabilities - #9

Draft
enyst wants to merge 4 commits into
mainfrom
gpt/insider-voice-live-record
Draft

enyst wants to merge 4 commits into
mainfrom
gpt/insider-voice-live-record

Conversation

@enyst

@enyst enyst commented Sep 19, 2026

Copy link
Copy Markdown
Owner

Insider Cat uses one saved OpenHands agent behind text and Voice. Document the current Cat interface, direct realtime handoff, normal tools and enabled skills, and how the agent queries its own backend through the terminal.

  • Show the current source-derived Cat artwork and poses, integrated Talk controls, and compact companion away from Projects.
  • Explain realtime Voice → conversation-bound handoff → saved OpenHands tool loop → saved result → speech, including why the SDK’s stateless /ask_agent endpoint is not the task executor.
  • Correct the bespoke inventory-tool prerequisite. The normal terminal, openhands-api skill, and actual backend URL/authentication context already support backend queries. Prefer the count endpoint; paginate listings; only inspect persistence when its ownership and format are known.
  • Record real September 20 Voice verification: the same saved Cat invoked the API skill, discovered OpenAPI, executed a terminal count, saved the answer, and returned matching speech. An independent count agreed. The repair preserved its existing history and identity. A separate temporary profile launch verified new-Cat tools, eleven default skills, project discovery, and runtime references without starting an agent turn.
  • Preserve earlier relay experiments as dated history. Physical iPad audio, progress acknowledgments, and worker mutation flows remain separate checks.

Rebased onto main 30205f5; current notes contain no private conversation IDs, credentials, or machine paths. The drawings are source-derived artwork, not claimed screenshots.

Validation: four HTML pages and 100 local links/anchors; metadata, unique IDs, privacy scan, and diff checks. Companion App tests: 129 passing. Canvas runtime-proxy tests: 88 passing plus typecheck and focused lint. Live tests used real providers with generated speech; they do not establish physical microphone/speaker behavior or the API-key Voice transport.

Related: enyst/insider#2 · OpenHands/OpenHands#17558 · OpenHands/software-agent-sdk#5180

@coderabbitai

coderabbitai Bot commented Sep 19, 2026

Copy link
Copy Markdown

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

  • Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

enyst and others added 3 commits September 20, 2026 00:52
Keep the source investigation, fixture tests, and three real saved voice exchanges dated separately. Link the App and upstream Agent Server drafts, document the tested authentication setup, and retain the remaining iPad and delegation limitations.

Co-authored-by: openhands <openhands@all-hands.dev>
Co-authored-by: openhands <openhands@all-hands.dev>
Document the current interface, direct handoff to saved OpenHands, verified workspace-tool execution, and the separate backend coordination tools still needed. Preserve the earlier relay experiments as dated history.
@enyst
enyst force-pushed the gpt/insider-voice-live-record branch from f7a3bab to 2042cea Compare September 19, 2026 23:06
@enyst enyst changed the title docs: record Insider Codex Voice implementation and live checks docs: explain Insider Voice, current Cat UI, and agent capabilities Sep 19, 2026
Correct the bespoke-tool prerequisite, explain default tools and skills with owning-backend context, and record real Voice API counting plus new-profile launch validation.

Co-authored-by: openhands <openhands@all-hands.dev>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant