Capture a video frame while it is streaming in the server or UI for real-time image processing

How to perform real-time image processing on video frames? Is there a way to do this in openvidu in real time? Where can I find the video frame?

It’d be great if someone can clarify this

If you want to access frames in the server you have to implement a custom Kurento Module (in C++):

https://doc-kurento.readthedocs.io/en/stable/user/writing_modules.html

Then you have to create a custom Kurento Docker image with the module installed:

https://doc-kurento.readthedocs.io/en/stable/user/writing_modules.html#installing-in-docker

Finally you have to configure the session to use the module created:

https://docs.openvidu.io/en/2.19.0/advanced-features/filters/

If you want to capture images in the browser you can follow this path:

Regards