I am using Individual recording.in Openvidu PRO, Session total duration is approx 10 minutes. The first Stream which is for 3:25 minutes is fine and after that Broadcaster Refreshed the page and a new recording streams was generated.
On the second STREAM which got generated after the Page Refreshed in not in Sync. We are facing AV syncing issue in this Stream
Can you please let me know the possible reason and fixes around that?
Faced AV lag issue again, but it’s a little bit strange.
When i run the video in chrome the AV lag is significant but when i play the same video in Mozilla the lag is marginal.
I also noticed for some Recording - In the beginning everything sounds fine, but slowly the audio goes faster than the video.
P.S - There was no lag in AV during live session @ load of Media server was below 15%.
@pabloFuente @cruizba any suggestion what can be the reason behind this.
Are you saying that if you play the recorded files in Chrome you see lag but if you play the recorded file in Firefox you don’t see lag?
Or are you saying that using Chrome for video call produces lag in recordings and using Firefox for video call don’t?
What type of recording are you using? INDIVIDUAL or COMPOSED?
Can you reproduce the issue? Can you share the files with us to analyse them?
Regards
@micael.gallego , Please find my inputs
I have shared one recording file with you, you can check the same. For example if you
@micael.gallego any update on this recording desync issue.
Hello @micael.gallego , any clue why AV lag found while playing it in Chrome.
Hi,
would you please be able to provide:
For the KMS log file, please first enable advanced recorder logging. To do that, follow these steps:
/opt/kms/.env file with these 2 lines:KMS_DEBUG_LEVEL=3,Kurento*:4,kms*:4,sdp*:4,webrtc*:4,*rtpendpoint:4,rtp*handler:4,rtpsynchronizer:4,agnosticbin:4,basemediamuxer:5,KurentoRecorderEndpointImpl:4,recorderendpoint:5,qtmux:5,curl*:5
GST_DEBUG=3,Kurento*:4,kms*:4,sdp*:4,webrtc*:4,*rtpendpoint:4,rtp*handler:4,rtpsynchronizer:4,agnosticbin:4,basemediamuxer:5,KurentoRecorderEndpointImpl:4,recorderendpoint:5,qtmux:5,curl*:5
Restart each of the Media Nodes: run /opt/kms/media_node restart.
Restart your main OpenVidu Server Pro Node: run /opt/openvidu/openvidu restart.
Having this, I’ll be able to inspect the details and have more information about the sync issue.
Thanks
Also if you’re able to know (from application logs or any other means) what is the exact browser that was used as source for this recorder, it would also help. Browser name (Chrome, Firefox, Safari, etc) and version number.
A sample recording that shows this A/V out of sync issue (I’ve now received it already) - Have shared 2 recording files with you. If not received please let me know.
A KMS log file that corresponds to the creation of one of these faulty recordings.
All media nodes are added on the fly (auto scale mode) hence KMS log won’t be available from there, Please let me know is there any other options available.
Browser name (Chrome, Firefox, Safari, etc) and version number.
@j1elo, Source of Recording Browser was Chrome and Version 85 (Windows).
@j1elo, I get below error/warning messages from Chrome which has sync problem. It shows below message on chrome://media-internals Please see the attached screen shots for 3 different recordings which has AV syncing issue. Please see if this can help to understand the behaviour.
Recording File -1
Recording File 2
Recording File 3
Thanks, I still have to inspect the provided sample videos (I got the email now) and will let you know when I know something.
@j1elo ok, Meanwhile just one more reference.
It seems there is some problem with MediaRecorder while recording in the Chrome. I’m guessing that the problem is MediaRecorder creating audio streams with overlaps.
Please see the Chrome bug which they have fixed. May be need to upgrade the latest Chrome version in Openvidu Recording Container.
https://chromium-review.googlesource.com/c/chromium/src/+/2346292
INDIVIDUAL recording does not use the recording conainer. INDIVIDUAL recording is performed directly by Kurento Media Server dumping stream data into disk.
Ok, You mean no MediaRecorder is involved for Individual Recording, It will directly write the incoming stream into disk.
Hello @j1elo Could you please let me know the root cause of this AV lag ?
The A/V sync issues in Chrome were caused by the sensitivity that Chrome player has to timestamp issues. Other players such Firefox are able to play the files correctly because it basically ignores the timestamp in the file.
The issue is caused by gaps in the recorded timestamps. For example, say that frames 4 and 5 are missing, the recorded file is like this:
1, 2, 3, 6, 7, 8, …
With frames 4 and 5 missing, Firefox assumes that between 3 and 6 there is a gap, and ignores the 6, 7, 8… bug Chrome doesn’t, so it accelerates the audio to accommodate the timestamps, and that’s why the audio comes ahead of the video.
We’ve improved this in Kurento Media Server, hoping it is a good enough solution: when there is a gap in timestamps, the next frames have their timestamp rewritten, so there are no gaps. Thus 6 would become 4, 7 would be 5, etc, and the recorded file would look like
1, 2, 3, 4, 5, 6, …
thus now Chrome plays the file correctly. This fix is already available in latest nightly builds of KMS, and will be released with 6.15.0 as soon as testing shows that there are no regressions or issues. And I believe it will be part of the next OpenVidu release too.
@j1elo great Thanks for the update. Next OV version will save our effort to recompile the recording stream to eliminate the AV syncing issue.
