[
https://issues.apache.org/jira/browse/OPENMEETINGS-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Wagner updated OPENMEETINGS-2782:
-------------------------------------------
Description:
OpenMeetings uses webRTC and HTML5 video to share audio video. Purely browser
based.
One feature missing is the ability to blur your webcam's camera background.
There are multiple ways to achieve it, Google Meet seems to use:
[https://www.tensorflow.org/]
Tensorflow are AI/ML models, they provide precompiled models into JS, for
detection of face/body it seems:
[https://github.com/tensorflow/tfjs-models/tree/master/body-segmentation] is
the best model.
Since Chrome 14 there is also a Background Blur API (relying on operating
system APIs): [https://developer.chrome.com/blog/background-blur] - but that
doesn't seem to be widely or reliable supported by operating systems yet.
The project would be about adding the background blur into a simple demo and
then integrate into the OpenMeetings project. Additionally other types of
backgrounds can be added.
Tensorflow TFJS is under the Apache 2.0 License (See
[LICENSE|https://github.com/tensorflow/tfjs-models/blob/master/LICENSE]) and
should be possible to redistribute with Apache OpenMeetings.
Other live demos and examples:
https://blog.francium.tech/edit-live-video-background-with-webrtc-and-tensorflow-js-c67f92307ac5
was:
OpenMeetings uses webRTC and HTML5 video to share audio video. Purely browser
based.
One feature missing is the ability to blur your webcam's camera background.
There are multiple ways to achieve it, Google Meet seems to use:
[https://www.tensorflow.org/]
Tensorflow are AI/ML models, they provide precompiled models into JS, for
detection of face/body it seems:
[https://github.com/tensorflow/tfjs-models/tree/master/body-segmentation] is
the best model.
Since Chrome 14 there is also a Background Blur API (relying on operating
system APIs): [https://developer.chrome.com/blog/background-blur] - but that
doesn't seem to be widely or reliable supported by operating systems yet.
The project would be about adding the background blur into a simple demo and
then integrate into the OpenMeetings project. Additionally other types of
backgrounds can be added
> Add blur background filter options on video sharing - AI-ML
> -----------------------------------------------------------
>
> Key: OPENMEETINGS-2782
> URL: https://issues.apache.org/jira/browse/OPENMEETINGS-2782
> Project: Openmeetings
> Issue Type: New Feature
> Components: Audio/Video
> Reporter: Sebastian Wagner
> Priority: Major
> Labels: gsoc, gsoc2024, mentor
>
> OpenMeetings uses webRTC and HTML5 video to share audio video. Purely browser
> based.
> One feature missing is the ability to blur your webcam's camera background.
> There are multiple ways to achieve it, Google Meet seems to use:
> [https://www.tensorflow.org/]
> Tensorflow are AI/ML models, they provide precompiled models into JS, for
> detection of face/body it seems:
> [https://github.com/tensorflow/tfjs-models/tree/master/body-segmentation] is
> the best model.
> Since Chrome 14 there is also a Background Blur API (relying on operating
> system APIs): [https://developer.chrome.com/blog/background-blur] - but that
> doesn't seem to be widely or reliable supported by operating systems yet.
> The project would be about adding the background blur into a simple demo and
> then integrate into the OpenMeetings project. Additionally other types of
> backgrounds can be added.
> Tensorflow TFJS is under the Apache 2.0 License (See
> [LICENSE|https://github.com/tensorflow/tfjs-models/blob/master/LICENSE]) and
> should be possible to redistribute with Apache OpenMeetings.
> Other live demos and examples:
> https://blog.francium.tech/edit-live-video-background-with-webrtc-and-tensorflow-js-c67f92307ac5
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
