feat(live): add hands-free Codex voice calls for OMP panes - #164
Closed
Ad3Digital wants to merge 2 commits into
Closed
feat(live): add hands-free Codex voice calls for OMP panes#164Ad3Digital wants to merge 2 commits into
Ad3Digital wants to merge 2 commits into
Conversation
Owner
|
Sorry this doesnt fit what i want to focus on right now. Feel free to chime in on the discussion around STT to explain exactly how you're using this feature and why it should be included. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add opt-in, hands-free Codex Live calls to local Oh My Pi (OMP) panes in Herdr. The phone carries the microphone and speaker while requests execute in the existing OMP session, so the operator can keep working away from the desk. This is bidirectional realtime audio, not speech-to-text pasted into the composer.
Trying it
Requires a local Herdr pane, OMP with a working Codex OAuth account and Live access, and a secure browser context. Tested with OMP 18.1.10 and Bun 1.4.0.
omp --extension /absolute/path/to/collie/omp/extension.ts/live-mobilein OMP reports companion readiness.For an existing community Windows installation,
contrib/windows/install-omp-live.ps1performs the reversible cutover;-Action Restorerestores the original service. No private configuration, account tokens, machine URLs, recordings, or generated build artifacts are included in this PR.Verification
On the published branch in an isolated native Linux filesystem under WSL, using Bun 1.4.0:
collie-ctl.test.shandcheck-tag.test.sh: pass.Known upstream test failure:
scripts/collie-cli.test.shfails its empty external-call-log assertion with twotailscale status --jsoncalls. The identical failure was reproduced independently on unmodified upstreamba39c05c6350a52bcb0a88f118cd0680ff85a1c5(1.5.1), using the same environment and Bun installation. This unrelated suite was not changed, so the combined root test command is not claimed green.Deployment smoke test on Windows 10 before rebasing onto 1.5.1: real Portuguese test audio over the installed HTTPS front door reached Codex Live, delegated a file write to OMP, and received spoken confirmation. WebRTC audio traffic, mute/unmute, track disposal on end, cancellation during pending microphone acquisition, stale-session/auth/origin refusals, and restore/reinstall were exercised. The operator subsequently confirmed the feature works in their own setup. The rebase preserved the Live implementation and resolved only the upstream test-command split.
Scope and caveats
Base branch
main.Checks
Suggested changelog: Add optional Codex Live voice calls for local OMP panes, with mobile audio controls and a reversible Windows installer.