Skip to main content

Controller Control

OVR Overlay Translator fully supports VR controller operation, allowing you to complete all operations without removing your headset.

Basic Operations​

OperationFunction
Bring controller close to earDisplay translation screenshot frame (translation mode must be enabled)
Long press trigger for about 1 secondToggle translation mode (OCR image translation) on/off
Pull triggerTrigger OCR recognition and translation
Double-press triggerSwitch between OCR image translation / voice translation modes
Short press trigger in voice modePause / resume speech recognition
Long press trigger for about 1 second in voice modeTurn voice translation on/off
Press A / X button when near ear in voice modeQuickly toggle microphone channel
Flick left or right joystickClear current translation result
Hold grip button (when screenshot frame is displayed)Adjust screenshot frame size (need to enable this feature in overlay settings)
Press grip button when operating controller is close to the other wristPlace translation result on wrist persistent display

Detailed Instructions​

Turning On/Off Translation Mode​

Long press the trigger for about 1 second to toggle the OCR image translation mode switch state.

  • When enabled, you can perform OCR recognition and translation
  • When disabled, the software stops triggering translation and screenshot frame adjustment

Switching Translation Mode​

Double-press the trigger to switch between OCR image translation and voice translation modes. The software remembers the last mode you used.

Triggering OCR Translation​

Bring any controller close to your head near your ear, when a green rectangle appears, aim the frame at the target text and pull the trigger to translate.

  • The controller needs to be close to the ear position to trigger the screenshot frame display
  • After triggering the screenshot frame, you need to manually pull the trigger to translate

Voice Translation Operation​

After switching to voice translation mode:

  • Short press the trigger: Pause / resume speech recognition (no need to reload the model when resuming)
  • Long press the trigger for about 1 second: Turn voice translation on/off
  • Press the A / X button when near your ear: Quickly toggle the microphone channel on/off (A button on the right controller / X button on the left controller; the corresponding controller must be close to your head)
  • Flick the joystick: Clear the current voice translation result

Voice translation automatically captures speaker audio (translated into your native language, as real-time subtitles) and microphone audio (translated into the target language). For detailed instructions, see Voice Translation.

Both-Hands On/Off Translation​

If "Both-Hands Toggle Translation" is enabled in Preferences, you need to place both hands next to your ears and long press the trigger of both simultaneously to turn translation on/off, which prevents accidental operation while holding the controller in one hand.

Clearing Translation Results​

Flick the left or right joystick to clear the currently displayed translation result.

Adjusting Screenshot Frame​

After enabling the "Controller Adjust Screenshot Frame" feature:

  1. Hold the grip button while the screenshot frame is displayed
  2. Move the controller position to adjust the screenshot frame size
  3. Moving the controller position upward will increase the screenshot frame height
  4. Moving the controller position downward will decrease the screenshot frame height
  5. Moving the controller position to the left will decrease the screenshot frame width
  6. Moving the controller position to the right will increase the screenshot frame width
  7. Release the grip button to complete adjustment

Grip Pressure Threshold: Controls the grip force required to trigger adjustment, smaller values are easier to trigger (only for Index controllers).

Wrist Display Feature​

When you have a translation result, you can pin it to your wrist:

  1. Bring the operating controller close to the other wrist (distance less than 0.3 meters).
  2. Press the grip button on the operating controller, at this point the translation result image will shrink and follow the operating controller into preview mode.
  3. Move the operating controller to adjust the display position on the wrist, and you can use the joystick to push up and down to scale.
  4. Press the trigger button to complete binding. For detailed operation and deletion instructions, please see: Wrist Display Feature

Dashboard Settings​

In addition to controller operation, you can also make detailed settings through the SteamVR Dashboard:

  1. Press the system button to open the SteamVR Dashboard
  2. Find the OVR Overlay Translator icon
  3. Click to enter the settings interface

In the Dashboard, you can configure all software options without using a keyboard.

Settings Panel Navigation​

The settings panel includes the following tabs:

TabFunction
PreferencesFeature switches, program startup settings, UI scaling and theme, wrist persistent display switch
Voice TranslationVoice translation switch, microphone / speaker devices and volume thresholds, translation result display and Chatbox
OCR Image TranslationRecognition / translation languages, translation overlay style, screenshot frame, image enhancement, text block merging
Translation EngineText / voice translation engines, ASR settings, TTS settings, service and credential configuration
OverlayStatus text settings, wrist control panel
Advanced SettingsGPU acceleration, controller buttons and trigger positions, debug mode
LanguageInterface display language selection (requires restart to take effect)
HelpQuick usage instructions, onboarding entry
AboutSoftware version, update check, local models and open source acknowledgments