Audio Video Sync Dock 0.1.1

[norihiro]

norihiro submitted a new resource:

Audio Video Sync Dock - Measuring latency between audio and video using a special pattern video

Introduction
Using a special pattern video, this plugin helps you measure the latency between audio and video.

If the latency is large, viewers will notice the lips is not synchronized to what they hear, and feel uncomfortable.

View attachment 108774

Demonstration
You can find a demonstration video on YouTube.

Usage

Please follow steps...

Read more about this resource...

 

[Alexander Royero]

Hola

 

[Moulaythami]

Works great!
Just tested the result on my video editing software and it works for fixing delay between picture and sound.
Very clever idea thank you @norihiro

 

[myekstarcy]

no detailed instruction of installation.only usage video. I checked all the zip file,there is no .exe. Kindly help me out

 

[norihiro]

no detailed instruction of installation.only usage video. I checked all the zip file,there is no .exe. Kindly help me out

Please have a look at this page for installation procedure.
https://github.com/norihiro/obs-color-monitor/wiki/Install-Windows

 

[CrazyThunderbird]

I honestly have to say: This should be hard implemented in OBS.
One of the most usefull plugins out there.

You can sync everything with it.
I had to sync my Monitor to my audio and my Camera.
I use a few VST plugins, VM Potato, Matrix Coconut and 2 vst hosts for splitting audio. VOD and livestrip.

It's really handy to sync everything up i had to go -110ms on the monitor to audio and +228ms on camera to mic.

 

[attaboyBrad]

I can't seem to get the dock to show anything. Have any troubleshooting suggestions? I'm playing the correct video format on iPhone 16 Pro, I tried a couple of different mics and appear to have a healthy signal level in all of them, and I turned off all the filters on my camera (ZV-E10 via Camlink 4K), and nothing happens after I hit "start" in the dock and then play the video.

On MacOS running up-to-date Sequoia and OBS 31.0.1.

 

[norihiro]

I can't seem to get the dock to show anything. Have any troubleshooting suggestions? I'm playing the correct video format on iPhone 16 Pro, I tried a couple of different mics and appear to have a healthy signal level in all of them, and I turned off all the filters on my camera (ZV-E10 via Camlink 4K), and nothing happens after I hit "start" in the dock and then play the video.

On MacOS running up-to-date Sequoia and OBS 31.0.1.

I'm sorry for the trouble. If both "Video Index" and "Audio Frequency" are not shown, probably, the QR code is not correctly detected by the plugin.
Could you possibly provide either or both of these information to debug further?

• What is your video format setting?
• If you are using Studio Mode, does the camera feed go to the Program?
• A video recording the sync pattern and audio. (I don't need to have the screen capture but the video and audio from your camera and mic.)
• Log file while using the plugin.

 

[attaboyBrad]

I figured it out! My video was mirrored.

I'm so glad I figured this out before posting everything, because *of course* it can't recognize the QR code when it's been flipped horizontally! I'd have felt rather foolish.

That said, mirrored camera sources might be common enough to be worth accounting for in your plugin, assuming that's possible--maybe have it look for different orientations and mirrors of your current QR code? No idea how hard that might be to implement.

Your plugin is now the godsend I hoped it would be: I've spent SO much time trying to record different videos with different audio offsets and different AV sync apps, and every time I change things I eventually have to do it again.

Just sponsored you on Github, and I'm sure I'll do so again the next time my videos get out of sync. GREAT WORK and THANK YOU!

 

[GuiDaFunkyMan]

Hi norihiro,

Hi, I have an issue. Every time I launch a test with the plug-in, my audio and video indexes miss over 50%. As a result, my latency can't stay stable and has huge peaks so I can't determine a reliable average. Would you have any solution?

Note that I use:

• A Razer Kiyo pro webcam (60fps mode).
• An Elgato Wave 3 mic with Wave Link plug-ins.
• A Samsung tablet that shows the QR code.

My latest log file: https://obsproject.com/logs/GPBK2TRth0FJyNyE

 

[norihiro]

norihiro updated Audio Video Sync Dock with a new update entry:

Audio Video Sync Dock 0.1.1

This is an experimental release of Audio Video Sync Dock plugin for OBS Studio.

Changes in 0.1.1

• Added ability to detect flipped QR code
• Increased font size of the latency.
• Added a label to display audio is lagged or early, and also errors.

Limitation

• Not all packages/binaries are tested.
  • Windows: 0.1.0 was tested with OBS Studio 31.0.0-beta2 and 30.2.2.
  • macOS (Intel): 0.1.0 was tested with OBS...

Read the rest of this update entry...

 

[GuiDaFunkyMan]

norihiro updated Audio Video Sync Dock with a new update entry:

Audio Video Sync Dock 0.1.1



Read the rest of this update entry...

Unfortunately, the update doesn't change anything except that there are fewer missed video indexes. Nevertheless, I still can't get a reliable average.

 

[norihiro]

Hi norihiro,

Hi, I have an issue. Every time I launch a test with the plug-in, my audio and video indexes miss over 50%. As a result, my latency can't stay stable and has huge peaks so I can't determine a reliable average. Would you have any solution?

Note that I use:

• A Razer Kiyo pro webcam (60fps mode).
• An Elgato Wave 3 mic with Wave Link plug-ins.
• A Samsung tablet that shows the QR code.

My latest log file: https://obsproject.com/logs/GPBK2TRth0FJyNyE

Thank you for providing your log file. I think you need to increase the detection ratio of the sync patterns, especially the video (QR code).
I'd like to share some ideas to increase the detection ratio.
Video (90% or above would be better):

• Would you ensure your camera is properly focused on the QR code? Depending on the focus range of your camera, it may be necessary to mvoe the QR code further away from the camera.
• If you tiled multiple camera sources and/or images, I recommend to have another scene that has camera input only so that the QR code is big enough. Copy your camera source, create a new scene, "Paste (Reference)" to the new scene, and fit the source to the canvas.

Audio (~50% would be acceptable):

• Try to move your microphone close to the speaker. Probably, around 20cm (7.5inches) or less will be better.
• If you have effects such as noise reduction, gate, equalizer, or reverb, temporarily disable these effects.

I'm sorry for my late reply. I was thinking how I can reply and took time.

 

[GuiDaFunkyMan]

Thank you for providing your log file. I think you need to increase the detection ratio of the sync patterns, especially the video (QR code).
I'd like to share some ideas to increase the detection ratio.
Video (90% or above would be better):

• Would you ensure your camera is properly focused on the QR code? Depending on the focus range of your camera, it may be necessary to mvoe the QR code further away from the camera.
• If you tiled multiple camera sources and/or images, I recommend to have another scene that has camera input only so that the QR code is big enough. Copy your camera source, create a new scene, "Paste (Reference)" to the new scene, and fit the source to the canvas.

Audio (~50% would be acceptable):

• Try to move your microphone close to the speaker. Probably, around 20cm (7.5inches) or less will be better.
• If you have effects such as noise reduction, gate, equalizer, or reverb, temporarily disable these effects.

I'm sorry for my late reply. I was thinking how I can reply and took time.

Thanks for your support. Nevertheless, although I can get a stable video index, my audio misses are still enormous. I don't know why. Yet, I disabled all the VST plug-ins and moved my mic as close to the speaker as possible.

Here's my latest log file: https://obsproject.com/logs/wHjgJOrYjOZUBwr7

I also recorded my latest test on OBS:

 

[norihiro]

Thanks for your support. Nevertheless, although I can get a stable video index, my audio misses are still enormous. I don't know why. Yet, I disabled all the VST plug-ins and moved my mic as close to the speaker as possible.

Here's my latest log file: https://obsproject.com/logs/wHjgJOrYjOZUBwr7

I also recorded my latest test on OBS:

Thank you for providing your video. I can reproduce the issue.
It looks the difficulty is that the audio is echoing in your room so that it is difficult to decode the embedded index number in each click sound.
Would you try to reduce the echo in your room? Probably, open your door and/or windows might reduce the echo.
In the mean time, I will create different sync pattern so that might be stronger to the echo.

 

[GuiDaFunkyMan]

Thank you for providing your video. I can reproduce the issue.
It looks the difficulty is that the audio is echoing in your room so that it is difficult to decode the embedded index number in each click sound.
Would you try to reduce the echo in your room? Probably, open your door and/or windows might reduce the echo.
In the mean time, I will create different sync pattern so that might be stronger to the echo.

Unfortunately, I can't reduce the echo in my room. It doesn't matter because I found another way to properly sync my mic and webcam. Thanks again for your support.