Re: [osg-users] sign language avatar with osg

[Trajce Nikolov NICK]

Thanks Richard, Jan,

indeed, there is a lot of research to be done for this. I have done some
consultancy in of the the CS UNI in Macedonia with teachers who tried this
in the past so there are already some insights. I would see the first
simple app on mobile device, something like an app that will teach the sign
alphabet only ... For real translator it will take some time. And thanks
again Richard, I will ping you for sure on this...

Cheers and thanks
Nick

On Mon, Mar 12, 2018 at 12:32 PM, Richard Kennaway 
wrote:

> On Sun, March 11, 2018 8:18 pm, Trajce Nikolov NICK wrote:
> > Hello Community,
> >
> >
> > I carry this idea with me from my UNI days (which is about 20 years ago)
> > and since recent it was just an idea. Over time it was even close to get
> > some funding but it did not happen.
> >
> > The idea is to have virtual 3D avatar that can "speak" the sign language
> > based on text or voice input. The recent technology from Google made the
> > realization of  the language translation doable.
> >
> > So I am here to ask you if someone might be interested in actually make
> > this happen. I personally work with an artist (friend of mine, decades of
> > friendship, also worked together on various projects). And we want to do
> > this opensource, based on OSG.
> >
> > All suggestions, brainstorms, hints, anything, are highly welcome!
>
> I did some work on signing avatars 10 to 20 years ago, in an academic
> context. In fact, several of the first page of hits for the Google search
> that Jan Ciger posted refer to that project (Virtual Humans at UEA).
>
> My own role in that was to create software to turn signing transcriptions
> written in an avatar-independent notation into animation data for driving
> any humanoid avatar, in real time. Feel free to email me for more
> information if this sounds relevant to what you have in mind. My
> publications on this can be found through ResearchGate or Google Scholar.
> As Jan says, there has been a large amount of work on this, by other
> groups as well, although it seems to me that none of it has really taken
> off. Perhaps because it is a very niche application. The demand would be
> primarily from the pre-lingually deaf, i.e., those for whom signing is
> their first language. With all respect to that population, it is a very
> small one.
>
> Personally, I would be more interested in extending my work to do
> procedural animation of more general sorts of movement, but I've haven't
> done anything substantial on that.
>
> --
> Richard Kennaway
> John Innes Centre and University of East Anglia
> Norwich, U.K.
>
> ___
> osg-users mailing list
> osg-users@lists.openscenegraph.org
> http://lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph.org
>



-- 
trajce nikolov nick
___
osg-users mailing list
osg-users@lists.openscenegraph.org
http://lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph.org

Re: [osg-users] sign language avatar with osg

[Richard Kennaway]

On Sun, March 11, 2018 8:18 pm, Trajce Nikolov NICK wrote:
> Hello Community,
>
>
> I carry this idea with me from my UNI days (which is about 20 years ago)
> and since recent it was just an idea. Over time it was even close to get
> some funding but it did not happen.
>
> The idea is to have virtual 3D avatar that can "speak" the sign language
> based on text or voice input. The recent technology from Google made the
> realization of  the language translation doable.
>
> So I am here to ask you if someone might be interested in actually make
> this happen. I personally work with an artist (friend of mine, decades of
> friendship, also worked together on various projects). And we want to do
> this opensource, based on OSG.
>
> All suggestions, brainstorms, hints, anything, are highly welcome!

I did some work on signing avatars 10 to 20 years ago, in an academic
context. In fact, several of the first page of hits for the Google search
that Jan Ciger posted refer to that project (Virtual Humans at UEA).

My own role in that was to create software to turn signing transcriptions
written in an avatar-independent notation into animation data for driving
any humanoid avatar, in real time. Feel free to email me for more
information if this sounds relevant to what you have in mind. My
publications on this can be found through ResearchGate or Google Scholar.
As Jan says, there has been a large amount of work on this, by other
groups as well, although it seems to me that none of it has really taken
off. Perhaps because it is a very niche application. The demand would be
primarily from the pre-lingually deaf, i.e., those for whom signing is
their first language. With all respect to that population, it is a very
small one.

Personally, I would be more interested in extending my work to do
procedural animation of more general sorts of movement, but I've haven't
done anything substantial on that.

--
Richard Kennaway
John Innes Centre and University of East Anglia
Norwich, U.K.

___
osg-users mailing list
osg-users@lists.openscenegraph.org
http://lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph.org

Re: [osg-users] sign language avatar with osg

[Jan Ciger]

On Sun, Mar 11, 2018 at 9:18 PM, Trajce Nikolov NICK <
trajce.nikolov.n...@gmail.com> wrote:

> Hello Community,
>
> I carry this idea with me from my UNI days (which is about 20 years ago)
> and since recent it was just an idea. Over time it was even close to get
> some funding but it did not happen.
>
> The idea is to have virtual 3D avatar that can "speak" the sign language
> based on text or voice input. The recent technology from Google made the
> realization of  the language translation doable.
>
> So I am here to ask you if someone might be interested in actually make
> this happen. I personally work with an artist (friend of mine, decades of
> friendship, also worked together on various projects). And we want to do
> this opensource, based on OSG.
>
> All suggestions, brainstorms, hints, anything, are highly welcome!
>
> Cheers,
> Nick
>
> --
> trajce nikolov nick
>
> ___
> osg-users mailing list
> osg-users@lists.openscenegraph.org
> http://lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph.org
>
>

Hello,

Before you commit significant time into this, do some state of the art
research. This topic has been done quite a few times before, including
attempts at the automatic translation:
https://www.google.fr/search?q=sign+language+virtual+human

If your goal is to bring a product to the market, there is a lot of
material there to get you started. If it is for research purposes, then you
are going to have tough time bringing some new ideas there.

Regards,

Jan
___
osg-users mailing list
osg-users@lists.openscenegraph.org
http://lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph.org