[jira] [Commented] (OPENMEETINGS-2782) Add blur background filter options on video sharing - AI-ML

2024-01-31 Thread Sebastian Wagner (Jira)


[ 
https://issues.apache.org/jira/browse/OPENMEETINGS-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812959#comment-17812959
 ] 

Sebastian Wagner commented on OPENMEETINGS-2782:


Maybe, I'm not sure. 

Does this method provide different levels of blur and also ability to set a 
custom background image?

Is this relying on server side rendering/CPU power or is it completely client 
side?

Does it just detect faces or the entire body, whats the actual algorithm to 
detect face/body ?

Maybe something the student/project can include in some investigation when 
doing this project and compare this with tensorflow.

> Add blur background filter options on video sharing - AI-ML
> ---
>
> Key: OPENMEETINGS-2782
> URL: https://issues.apache.org/jira/browse/OPENMEETINGS-2782
> Project: Openmeetings
>  Issue Type: New Feature
>  Components: Audio/Video
>Reporter: Sebastian Wagner
>Priority: Major
>  Labels: gsoc, gsoc2024, mentor
>
> OpenMeetings uses webRTC and HTML5 video to share audio video. Purely browser 
> based.
> One feature missing is the ability to blur your webcam's camera background.
> There are multiple ways to achieve it, Google Meet seems to use: 
> [https://www.tensorflow.org/] 
> Tensorflow are AI/ML models, they provide precompiled models into JS, for 
> detection of face/body it seems: 
> [https://github.com/tensorflow/tfjs-models/tree/master/body-segmentation] is 
> the best model.
> Since Chrome 14 there is also a Background Blur API (relying on operating 
> system APIs): [https://developer.chrome.com/blog/background-blur] - but that 
> doesn't seem to be widely or reliable supported by operating systems yet.
> The project would be about adding the background blur into a simple demo and 
> then integrate into the OpenMeetings project. Additionally other types of 
> backgrounds can be added.
> Tensorflow TFJS is under the Apache 2.0 License (See 
> [LICENSE|https://github.com/tensorflow/tfjs-models/blob/master/LICENSE]) and 
> should be possible to redistribute with Apache OpenMeetings.
> Other live demos and examples:
> https://blog.francium.tech/edit-live-video-background-with-webrtc-and-tensorflow-js-c67f92307ac5
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OPENMEETINGS-2782) Add blur background filter options on video sharing - AI-ML

2024-01-31 Thread Maxim Solodovnik (Jira)


[ 
https://issues.apache.org/jira/browse/OPENMEETINGS-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812596#comment-17812596
 ] 

Maxim Solodovnik commented on OPENMEETINGS-2782:


Hello [~sebawagner]

maybe something like this: 
https://doc-kurento.readthedocs.io/en/latest/_static/client-jsdoc/node_modules_kurento-client-filters_lib_FaceOverlayFilter.js.html?highlight=filter
 can be used?


> Add blur background filter options on video sharing - AI-ML
> ---
>
> Key: OPENMEETINGS-2782
> URL: https://issues.apache.org/jira/browse/OPENMEETINGS-2782
> Project: Openmeetings
>  Issue Type: New Feature
>  Components: Audio/Video
>Reporter: Sebastian Wagner
>Priority: Major
>  Labels: gsoc, gsoc2024, mentor
>
> OpenMeetings uses webRTC and HTML5 video to share audio video. Purely browser 
> based.
> One feature missing is the ability to blur your webcam's camera background.
> There are multiple ways to achieve it, Google Meet seems to use: 
> [https://www.tensorflow.org/] 
> Tensorflow are AI/ML models, they provide precompiled models into JS, for 
> detection of face/body it seems: 
> [https://github.com/tensorflow/tfjs-models/tree/master/body-segmentation] is 
> the best model.
> Since Chrome 14 there is also a Background Blur API (relying on operating 
> system APIs): [https://developer.chrome.com/blog/background-blur] - but that 
> doesn't seem to be widely or reliable supported by operating systems yet.
> The project would be about adding the background blur into a simple demo and 
> then integrate into the OpenMeetings project. Additionally other types of 
> backgrounds can be added.
> Tensorflow TFJS is under the Apache 2.0 License (See 
> [LICENSE|https://github.com/tensorflow/tfjs-models/blob/master/LICENSE]) and 
> should be possible to redistribute with Apache OpenMeetings.
> Other live demos and examples:
> https://blog.francium.tech/edit-live-video-background-with-webrtc-and-tensorflow-js-c67f92307ac5
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)