Made an app to vibe code with Switch controllers + voice in Claude Code and other agents

It can just control your Mac so is compatible with any coding agent. You can remap keys as needed.

Tech stack used to build it:

• Claude Code with Opus 4.5

• Swift 5.9 with AppKit (no SwiftUI)

• Programmatic UI (no storyboards)

• XcodeGen for project configuration (project.yml)

• JoyConSwift (vendored) for Joy-Con HID communication

• Speech framework for voice dictation

• CGEvent for mouse/keyboard simulation
  

Some big insights during process:

• xcodegen is a must, working with Xcode projects not convenient

• the coolest apps cannot really work with AppStore sandbox

• Claude not that great at Mac app design - need to give more examples and instructions than for web

• you should vendor all critical dependencies so that Claude Code can be debugging and fixing them as well