Oreja de Van Gogh

Product Introduction

1. Definition: Oreja de Van Gogh is a lightweight, open-source macOS menu bar utility (GPL-3.0 licensed) designed to manage audio interference between AI voice assistants and media playback. It functions as an intelligent audio ducking and pause automation tool specifically for the macOS ecosystem.
2. Core Value Proposition: It solves the problem of overlapping audio streams by automatically pausing or lowering the volume of Apple Music when the ChatGPT desktop application (or a selected browser) outputs speech, then seamlessly restoring playback. Its core value lies in providing an uninterrupted, context-aware listening experience for users who interact with AI voice features while consuming media.

Main Features

1. Intelligent Audio Activity Detection: Oreja does not perform speech recognition or recording. Instead, it uses macOS's audio process tap to monitor the real-time output level of a user-selected source application (e.g., ChatGPT app). It detects the characteristic amplitude modulation of human-like speech to differentiate it from system sounds or notification chimes, triggering its automation only for genuine AI replies.
2. Dual-Action Music Management: Users can configure the app's behavior in two distinct modes. Pause Mode completely halts Apple Music playback during AI speech. Lower-Volume Mode (audio ducking) reduces Apple Music to a user-defined volume level (e.g., 12%) instead of pausing, allowing background ambiance to continue.
3. Context-Aware Resume Logic: The app implements a sophisticated resume protocol. After the AI stops speaking, it initiates a configurable "conversation hold" (default 12 seconds) to prevent music from restarting during the user's response. Following this, a "quiet interval" (default 800ms, adjustable up to 3s) ensures the reply is truly complete before restoring Apple Music to its original volume and precise playback position.

Problems Solved

1. Pain Point: Manual audio management fatigue. Users of voice-based AI assistants must constantly pause and play their music or media during conversations, creating a disruptive and frustrating workflow that breaks immersion and productivity.
2. Target Audience: This includes power users, developers, researchers, students, and professionals who frequently use ChatGPT's voice features for brainstorming, learning, or content creation while listening to music, podcasts, or ambient sounds on Apple Music on their Mac.
3. Use Cases: Essential for scenarios like dictating code or documents to AI while listening to focus music, having extended conversational language practice with an AI tutor, or using AI for interactive storytelling or game mastering without constant manual audio intervention.

Unique Advantages

1. Strengths & Limitations (Pros & Cons):

   • Pros:
     • Unparalleled Privacy: Processes only audio levels in RAM for milliseconds; no recording, transcription, network calls, or analytics.
     • System-Native & Lightweight: Runs as a minimal menu bar app with negligible resource usage, leveraging macOS-native automation (AppleScript) for control.
     • User Sovereignty: User-initiated playback controls (pause/play) always override Oreja's automation, preventing frustrating lock-in.
     • Open Source & Transparent: GPL-3.0 license allows for security audit, customization, and community trust.
   • Cons:
     • Platform & Player Lock-in: Currently exclusive to macOS 14.2+ and only supports Apple Music. Does not work with Spotify, YouTube, or other media players.
     • Setup Friction: Requires enabling Accessibility permissions for automation and may trigger Gatekeeper warnings as it is ad-hoc signed but not Apple-notarized.
     • Source App Limitations: Using a browser as the audio source can capture sounds from all tabs, leading to false triggers from web notifications.

2. Key Alternatives & Differentiation:

   • Manual Control: The standard alternative is manually pausing/playing Apple Music. Oreja automates this completely, eliminating the workflow interruption.
   • System-Wide Audio Ducking (e.g., for Calls): macOS has built-in ducking for communication apps like Zoom, but it cannot be targeted to specific apps like ChatGPT and offers no pause/resume-position functionality. Oreja provides precise, app-specific control with intelligent timing.
   • Generic Macro Tools (e.g., Keyboard Maestro): While powerful, they require complex user-setup to detect audio states and control Apple Music. Oreja is a pre-configured, dedicated solution focused solely on this use case with built-in audio intelligence.

Frequently Asked Questions (FAQ)

1. Does Oreja de Van Gogh record or send my conversations to the cloud? No. Oreja is a privacy-first, local-only application. It analyzes only the instantaneous output volume level of the target app to determine if "speech" is occurring. No audio samples are saved to disk, no speech-to-text is performed, and the app contains no networking code, ensuring all data stays on your Mac.

2. Why does Oreja only work with Apple Music and not Spotify or other players? The initial release (v0.2.1) uses macOS AppleScript automation, which provides native and reliable control over Apple Music. Support for other media players requires developing integrations with their respective APIs or accessibility controls, which is noted as a planned future enhancement.

3. What happens if I pause the music myself while Oreja is running? Your manual control takes priority. If you pause Apple Music yourself, Oreja will not resume it automatically. If you resume music while ChatGPT is still speaking, Oreja will release its control and wait for the next silent-to-speaking transition before acting again, ensuring the user is always in ultimate command.

4. Can Oreja differentiate between ChatGPT's voice and other system sounds? Yes, within limits. Its algorithm is tuned to detect the continuous, modulated waveform of speech. Short, steady tones (like most alerts) are typically ignored. However, melodic ringtones or complex sounds from a browser tab (if selected as the source) may cause false triggers. For the cleanest operation, using the dedicated ChatGPT desktop app is recommended.

5. Is Oreja de Van Gogh safe to install on my Mac? The application is ad-hoc signed by the developer but is not notarized by Apple. This means macOS Gatekeeper may show a warning upon first installation, requiring you to explicitly allow it in System Settings > Privacy & Security. Its open-source nature allows technical users to audit the code, and its lack of network permissions or persistent data access minimizes security risk.