Live lip-sync measurement

Is your audio out of sync?
Know to the millisecond.

SyncOrSwim detects flashes and beeps to measure live audio/video sync in real time. Connect via RTMP, SRT, NDI, RTSP and more. No test pattern? Clap on camera for manual frame-by-frame analysis, or use Lighthouse, our own sync reference: a calibrated phone or a ready-made test video, to within 1 ms. Any other source is read to within one video frame.

Live offset
−20.0 ms
AUDIO EARLY
Any encoderSRTRTMPNDIRTSPAny recordingLighthouse
Guided tour

See it in action.

Real screens and real footage from the app, running against a live test stream. Click a step or just watch.

SyncOrSwim
Proprietary to SyncOrSwim

Lighthouse

Your own sync reference. Lighthouse is SyncOrSwim's own sync-test system: a precise clock and a beep, locked together, that SyncOrSwim reads straight out of your stream. The strip format, the way it is read and the phone calibration are our own and are built into the app. It comes two ways, and both use the same reader.

Phone LinkOpen a page on any phone and it becomes the test source. Calibrate the phone once and the offset is read to within 1 ms (shown to 0.1 ms).
Test VideosThe same picture and beep rendered into files, in sync by construction. Play them through your chain to see what it adds.

Phone Link, in three steps

  1. Scan the QR code in the app's Lighthouse tab to open the Phone Link page on your phone.
  2. Start the pattern and turn the phone sideways. Set the screen to full brightness.
  3. Point your camera at it. SyncOrSwim finds the strip anywhere in the picture and outlines it in blue, and a Lighthouse flag appears in the Live offset window as soon as it is reading.

Works on iPhone and Android. The phone can measure its own speaker delay, and the app shows when a phone has been checked against a reference.

How it worksTwo clocks, one offset. The frame rate stops mattering. 4 steps

A flash can only land on a whole frame, so a flash-based reading moves in steps of one frame. Lighthouse puts a clock in the picture instead, and measures the gap between that clock and the stream's own timeline.

1A clock you can film

The strip is a binary clock. It starts with a fixed marker that SyncOrSwim can pick out anywhere in the picture, then 12 data bits that count in 4 ms steps and wrap every 16 seconds, then 5 check bits. The bits are Gray coded, so a frame caught mid-change is out by one step at most (4 ms), never by a wild value, and the check bits throw away anything that has been misread.

2Every frame is a measurement

Each decoded frame carries two times: where it sits on the stream's timeline, and the phone's clock time written on it. The difference between them is how far apart the two clocks are, offset = frame time − phone time. A 25, 30, 50 or 60 fps source simply gives you that many readings a second.

3The median settles below a frame

Every frame was captured at a different point against the phone's 4 ms ticks, so the rounding in each reading falls both ways. Taking the median over the last second or so converges on the true offset to a fraction of a frame. The frame rate changes how quickly it settles, not what it settles on.

4A virtual flash for the beep

The page plays its beep so the sound leaves the speaker just as its clock passes a whole second. SyncOrSwim works out where that second landed on the stream's timeline (phone time plus the measured offset) and treats it as a flash that never needed a flash, then pairs it with the beep it hears exactly as it would a real one.

What is left. Two things: the phone's own screen and speaker delay (typically 10 to 40 ms between phones), and the camera's exposure. Calibrating the phone lines up its screen and speaker. Measure phone offset checks it once against a reference, and from then on the phone brings its beep forward by however much its speaker trails its screen, so sound and picture leave the phone together. The clock and the median take the frame rate out of the picture.

Two ways to run it

Desktop app or Cloud.

Run SyncOrSwim on your own PC, or log in to SyncOrSwim Cloud and use it from any browser. Same measurements either way.

☁

SyncOrSwim Cloud

The hosted version on our server. Log in from any browser, point your stream at your own address and read the offset live. Nothing to install.

Log in to SyncOrSwim Cloud →
🖥

Desktop app

Install SyncOrSwim on your own computer and keep everything on your own network. Updates install over the top and keep your settings.

See the downloads ↓
Contact us

Questions, feedback or a hand getting set up?

Send a message and it lands straight in our inbox. We'll reply by e-mail.