On Tue, Jan 5, 2016 at 10:46 AM, Kearwood "Kip" Gilbert < kgilb...@mozilla.com> wrote:
> In WebVR, we often present UI as a Head's Up Display (HUD) that floats > in front of the user. Additionally, we often wish to show 2d graphics, > video, and CSS animations as a texture in 3d scenes. Creating these > textures is something that CSS and HTML are great at. > > Unfortunately, I am not aware of an easy and efficient way to capture an > animated of an interactive HTML Element and bring it into the WebGL > context. A "moz-element" -like API would be useful here. > > Perhaps we could solve this by implementing and extending the proposed > WEBGL_dynamic_texture extension: > > > https://www.khronos.org/registry/webgl/extensions/proposals/WEBGL_dynamic_texture/ This proposal seems unnecessarily complex. Is there a way for me to send feedback? Essentially, we would extend the same API but allow the WDTStream > interface to apply to more HTML elements, not just HTMLCanvasElement, > HTMLImageElement, or HTMLVideoElement. > > We would also need to implement WEBGL_security_sensitive_resources to > enforce the security model: > > > https://www.khronos.org/registry/webgl/extensions/WEBGL_security_sensitive_resources/ I wish I'd known about this proposal earlier! This looks pretty good, though I'd always thought this would be too complicated to spec and implement to be practical. Glad to be wrong! Although I think we should get as much feedback as possible on this in case of hidden gotchas. Does this sound like a good idea? I feel that this is something that > all WebGL developers would want, as it would make building front-ends > for games much easier. > Yes, I think together these would be very useful. If others feel the same, I would also like to follow up with a proposal > to make the captured HTML elements interactive through use of an > explicit "pick buffer" added to canvases. > How would that work? Being able to synthesize mouse (touch?) events in HTML elements would add another set of issues. I assume the idea of mixing CSS 3D-transformed elements into a WebGL scene has been rejected for some reason? Rob -- lbir ye,ea yer.tnietoehr rdn rdsme,anea lurpr edna e hnysnenh hhe uresyf toD selthor stor edna siewaoeodm or v sstvr esBa kbvted,t rdsme,aoreseoouoto o l euetiuruewFa kbn e hnystoivateweh uresyf tulsa rehr rdm or rnea lurpr .a war hsrer holsa rodvted,t nenh hneireseoouot.tniesiewaoeivatewt sstvr esn _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
