ScreenTranslate

Product Introduction

1. Definition: ScreenTranslate is a native macOS utility (technical category: OCR-powered translation software) that performs real-time optical character recognition (OCR) and machine translation directly on uncopyable text within images, videos, locked PDFs, or any on-screen content.
2. Core Value Proposition: It eliminates disruptive copy-paste workflows by enabling instant, privacy-focused translations via a single drag gesture—addressing critical gaps in multilingual productivity tools for macOS users.

Main Features

1. Drag-to-Translate: Uses Apple Vision framework for OCR to detect text within user-drawn screen rectangles, then processes translations via Apple’s on-device Translation engine. Output displays in <1 second via contextual popups.
2. Offline Operation: Leverages downloadable language packs (18 languages supported) for translation without internet after setup. Powered entirely by Apple’s on-device processing stack (Core ML).
3. Privacy-First Architecture: Zero data transmission; all OCR, text extraction, and translation occur locally on macOS. No tracking, servers, or cloud dependencies.
4. Translation History: Automatically logs all translations in a searchable menu bar database, enabling reuse without re-scanning.
5. Menu Bar Optimization: Runs as a lightweight background process (<50MB RAM) with persistent menu bar access for quick shortcuts and settings.

Problems Solved

1. Pain Point: Translating non-selectable text (e.g., video subtitles, image-based PDFs, UI elements) without manual screenshot/copy-paste loops.
2. Target Audience:
   • Multilingual researchers analyzing foreign-language academic PDFs.
   • Localization teams verifying UI text in software demos.
   • International business professionals reviewing locked financial documents.
3. Use Cases:
   • Translating Korean subtitles in a training video during playback.
   • Extracting Japanese text from infographics without manual typing.
   • Verifying Chinese contract terms in password-protected PDFs.

Unique Advantages

1. Differentiation: Unlike browser-based tools (e.g., Google Translate), ScreenTranslate requires no app switching, handles non-copyable text natively, and operates offline—uniquely solving macOS-specific workflow breaks.
2. Key Innovation: Seamless integration of Apple Vision OCR + Apple Translation APIs into a single drag gesture—a first for offline, on-screen translation utilities on macOS.

Frequently Asked Questions (FAQ)

1. Does ScreenTranslate work without internet? Yes, after downloading language packs, all OCR and translation processes occur offline via Apple’s on-device engines.
2. Is my data secure with ScreenTranslate? Absolutely. Zero text or screenshots leave your Mac; processing is 100% local with no tracking or data collection.
3. What macOS versions are supported? Requires macOS 15 Sequoia or later, compatible with both Apple Silicon and Intel-based Macs.
4. How many languages does ScreenTranslate support? 18 languages including auto-detect for Korean, English, Japanese, Chinese, Spanish, French, and German.
5. Can I reuse past translations? Yes, all translations are saved in a searchable history panel accessible from the menu bar.