Re: [elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[Zachary Kessin]

I had a use in my old job where I had to upload a CSV file to a server for
parsing etc. Pretty simple really, I used some package someone did with
some native code.

Zach
ᐧ

On Fri, May 5, 2017 at 11:13 PM, Kasey Speakman 
wrote:

> *Uploading files to AWS S3*
>
> That's my only use case so far for binary-type APIs of JS. I first call my
> own API to get a signed upload link, then PUT a file at that link. My
> simple way to upload files using Elm's Http module can be found here
> .
>
> I'm also delivering streaming media to the browser, but I'm doing that
> through existing JS libraries in an iframe.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Elm Discuss" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to elm-discuss+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>



-- 
Zach Kessin
Teaching Web Developers to test code to find more bugs in less time
Skype: zachkessin
+972 54 234 3956 / +44 203 734 9790 / +1 617 778 7213

-- 
You received this message because you are subscribed to the Google Groups "Elm 
Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elm-discuss+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[Kasey Speakman]

*Uploading files to AWS S3*

That's my only use case so far for binary-type APIs of JS. I first call my 
own API to get a signed upload link, then PUT a file at that link. My 
simple way to upload files using Elm's Http module can be found here 
.

I'm also delivering streaming media to the browser, but I'm doing that 
through existing JS libraries in an iframe.

-- 
You received this message because you are subscribed to the Google Groups "Elm 
Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elm-discuss+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[art yerkes]

Clients usually don't need to validate tokens.  I'm doing something a
little special.  Still, it's a pain.

On Sun, Apr 9, 2017 at 8:55 AM, 'Rupert Smith' via Elm Discuss <
elm-discuss@googlegroups.com> wrote:

> On Sunday, April 9, 2017 at 2:59:26 PM UTC+1, art yerkes wrote:
>>
>> Since this thread has risen from the grave completely, handling JWT
>> validation is kind of gross in elm.
>>
>> https://gist.github.com/prozacchiwawa/d51b4e49e59a2aa0d3a28b328f62627d
>>
>> Note that this requires a version of billstclair's sha256 that disables
>> internal utf-8 handling (if there's demand, I'll submit a PR).
>>
>
> Just looking back at what I did for JWT tokens. Realised that all I had
> done was to decode the token (using truqu/elm-base64) and had not validated
> its MAC on the client. Not sure I need to validate on the client though -
> authentication/authorization is checked on all incoming server calls and
> all I need from the token is the user id, and their permission scopes.
>
> +1 for ArrayBuffers for Sha256 and all other encrypted binary data formats
> that we might have to deal with.
>
> --
> You received this message because you are subscribed to a topic in the
> Google Groups "Elm Discuss" group.
> To unsubscribe from this topic, visit https://groups.google.com/d/
> topic/elm-discuss/u_ui3PlDwLc/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to
> elm-discuss+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups "Elm 
Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elm-discuss+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

['Rupert Smith' via Elm Discuss]

On Sunday, April 9, 2017 at 2:59:26 PM UTC+1, art yerkes wrote:
>
> Since this thread has risen from the grave completely, handling JWT 
> validation is kind of gross in elm.
>
> https://gist.github.com/prozacchiwawa/d51b4e49e59a2aa0d3a28b328f62627d
>
> Note that this requires a version of billstclair's sha256 that disables 
> internal utf-8 handling (if there's demand, I'll submit a PR).
>

Just looking back at what I did for JWT tokens. Realised that all I had 
done was to decode the token (using truqu/elm-base64) and had not validated 
its MAC on the client. Not sure I need to validate on the client though - 
authentication/authorization is checked on all incoming server calls and 
all I need from the token is the user id, and their permission scopes.

+1 for ArrayBuffers for Sha256 and all other encrypted binary data formats 
that we might have to deal with.

-- 
You received this message because you are subscribed to the Google Groups "Elm 
Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elm-discuss+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[art yerkes]

Since this thread has risen from the grave completely, handling JWT 
validation is kind of gross in elm.

https://gist.github.com/prozacchiwawa/d51b4e49e59a2aa0d3a28b328f62627d

Note that this requires a version of billstclair's sha256 that disables 
internal utf-8 handling (if there's demand, I'll submit a PR).

-- 
You received this message because you are subscribed to the Google Groups "Elm 
Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elm-discuss+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[Will Clardy]

I have a small hobby project  that uses 
File and TypedArray to read and parse NES rom 
 files, display their CHR data, 
and print interesting information from the iNES headers. I'd love to 
rewrite what I have in Elm and expand the project to include a pixel editor 
for the CHR data.

-- 
You received this message because you are subscribed to the Google Groups "Elm 
Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elm-discuss+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[Wojtek Piekutowski]

It would be awesome to be able to do directly in Elm:
- consume/emit msgpack
- use File* APIs
- direct upload to S3

On Thursday, 28 July 2016 23:17:51 UTC+2, Daniel Bachler wrote:
>
> I'd love to see support for the File and ArrayBuffer Apis, and maybe 
> TypedArrays/DataViews as well. IMHO they are an important piece of the Web 
> Platform that is still missing in Elm.
>
> Evan suggested collecting concrete use cases to guide the design. I would 
> like this thread to be the starting point of this effort. I would like to 
> ask anyone who would also like this feature or who has substantial 
> experience using either Api to add use cases or comment here so that we can 
> try to define the user story for both apis. From there, we could decide 
> what we would like to see supported and what, if anything, we don't need 
> for now and suggest Elm Apis.
>
> I have two stories from a side project of mine. It is a slideshow editor 
> that allows the user to select photos and audio files from the local 
> system, uploads them to a web service, let's the user arrange and 
> manipulate photos and music and then share the result with others. For 
> this, I have two immediate use cases plus some more ideas:
>
> *Upload local files as binary blob to AWS S3*
>
> In my current, (hacky) version, I use the FileReader api (via simonH1000's 
> filereader library) to read the content of a file into an ArrayBuffer, 
> (represented as Json.Value in Elm) then use a modified version of elm-http 
> to upload the content of the ArrayBuffer to an S3 storage bucket.
>
> *Download mp3 files, decode them and play them back via the AudioApi*
>
> Currently I do this with my modified http library to download the mp3 file 
> into an arraybuffer, then pass the resulting arraybuffer through a port to 
> some native javascript that then uses the Audio Api to decode the mp3 file 
> into a playable audiobuffer.
>
> *Parsing or otherwise processing local text files. *
>
> For another project I would be interested in reading and parsing 
> Swagger/OpenAPI definition files and then providing a UI to compare rest 
> apis. Since the processing will be done on simple Strings, this would only 
> require FileReader support (specifically the readAsText method). This would 
> already work with the FileReader library as is (though that one is not 
> available on package.elm-lang.org because it contains native code and is 
> not whitelisted).
>
> *TypedArrays and DataViews*
>
> I haven't worked with these yet, but I can anticipate some cases that 
> would be interesting:
>
> *Parsing/manipulating of binary data via the ArrayBuffer api.*
>
> One case I personally would like to do with this, is to parse the Exif 
> header of the jpeg files the user loaded from the local file system. My 
> slideshow could then display metadata information without roundtripping to 
> the server.
>
> *Create geometry for WebGL in the form of Vertex Buffers*
>
> *Generating sound/music by writing raw audio samples*
>
> These could then be played back via the Web audio apis.
>
>
> Please add your own ideas to this thread. Once we have compiled a list of 
> use cases, we can look at the JS Apis available under the Web Platform for 
> Files, ArrayBuffers, Typed Arrays etc. and think how these could be exposed 
> to Elm. 
>

-- 
You received this message because you are subscribed to the Google Groups "Elm 
Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elm-discuss+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[Simon]

My company uses websockets for mobile apps and thus wants to save on 
bandwidth. As a result all websocket traffic is encoded using msgpack, but 
the current library cannot handle that - presumably because of Elm's lack 
of underlying support for binary data.


On Thursday, 28 July 2016 23:17:51 UTC+2, Daniel Bachler wrote:
>
> I'd love to see support for the File and ArrayBuffer Apis, and maybe 
> TypedArrays/DataViews as well. IMHO they are an important piece of the Web 
> Platform that is still missing in Elm.
>
> Evan suggested collecting concrete use cases to guide the design. I would 
> like this thread to be the starting point of this effort. I would like to 
> ask anyone who would also like this feature or who has substantial 
> experience using either Api to add use cases or comment here so that we can 
> try to define the user story for both apis. From there, we could decide 
> what we would like to see supported and what, if anything, we don't need 
> for now and suggest Elm Apis.
>
> I have two stories from a side project of mine. It is a slideshow editor 
> that allows the user to select photos and audio files from the local 
> system, uploads them to a web service, let's the user arrange and 
> manipulate photos and music and then share the result with others. For 
> this, I have two immediate use cases plus some more ideas:
>
> *Upload local files as binary blob to AWS S3*
>
> In my current, (hacky) version, I use the FileReader api (via simonH1000's 
> filereader library) to read the content of a file into an ArrayBuffer, 
> (represented as Json.Value in Elm) then use a modified version of elm-http 
> to upload the content of the ArrayBuffer to an S3 storage bucket.
>
> *Download mp3 files, decode them and play them back via the AudioApi*
>
> Currently I do this with my modified http library to download the mp3 file 
> into an arraybuffer, then pass the resulting arraybuffer through a port to 
> some native javascript that then uses the Audio Api to decode the mp3 file 
> into a playable audiobuffer.
>
> *Parsing or otherwise processing local text files. *
>
> For another project I would be interested in reading and parsing 
> Swagger/OpenAPI definition files and then providing a UI to compare rest 
> apis. Since the processing will be done on simple Strings, this would only 
> require FileReader support (specifically the readAsText method). This would 
> already work with the FileReader library as is (though that one is not 
> available on package.elm-lang.org because it contains native code and is 
> not whitelisted).
>
> *TypedArrays and DataViews*
>
> I haven't worked with these yet, but I can anticipate some cases that 
> would be interesting:
>
> *Parsing/manipulating of binary data via the ArrayBuffer api.*
>
> One case I personally would like to do with this, is to parse the Exif 
> header of the jpeg files the user loaded from the local file system. My 
> slideshow could then display metadata information without roundtripping to 
> the server.
>
> *Create geometry for WebGL in the form of Vertex Buffers*
>
> *Generating sound/music by writing raw audio samples*
>
> These could then be played back via the Web audio apis.
>
>
> Please add your own ideas to this thread. Once we have compiled a list of 
> use cases, we can look at the JS Apis available under the Web Platform for 
> Files, ArrayBuffers, Typed Arrays etc. and think how these could be exposed 
> to Elm. 
>

-- 
You received this message because you are subscribed to the Google Groups "Elm 
Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elm-discuss+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[Zachary Kessin]

I have an app I am working on that has to upload a file to a server for
server side processing

Zach
ᐧ

On Wed, Jan 11, 2017 at 10:49 AM, Simon  wrote:

> Hi all,
> thought it might be worth updating this thread on my progress with S3,
> which I have now solved by adding one small hack to the Filereader
>  library (github only because
> of the native code). I have documented this at
> https://simonh1000.github.io/2016/12/elm-s3-uploads/
>
> Meanwhile, I have a new use to register. I was looking at MessagePack
>  and noted that Elm is not included in the long list
> of supported languages. I suspect that it currently could not be because of
> the lack of ArrayBuffer support?
>
> Simon
>
>
> On Wednesday, 24 August 2016 18:06:40 UTC+2, Erik Lott wrote:
>>
>> Our primary application allows photographers to upload hundreds/thousands
>> of images for portfolio display. image delivery, etc. I guess you could say
>> that our app is generally driven by image uploads. I would love to see this
>> functionality provided by Elm, rather than having to use ports...
>>
>> On Thursday, July 28, 2016 at 5:17:51 PM UTC-4, Daniel Bachler wrote:
>>>
>>> I'd love to see support for the File and ArrayBuffer Apis, and maybe
>>> TypedArrays/DataViews as well. IMHO they are an important piece of the Web
>>> Platform that is still missing in Elm.
>>>
>>> Evan suggested collecting concrete use cases to guide the design. I
>>> would like this thread to be the starting point of this effort. I would
>>> like to ask anyone who would also like this feature or who has substantial
>>> experience using either Api to add use cases or comment here so that we can
>>> try to define the user story for both apis. From there, we could decide
>>> what we would like to see supported and what, if anything, we don't need
>>> for now and suggest Elm Apis.
>>>
>>> I have two stories from a side project of mine. It is a slideshow editor
>>> that allows the user to select photos and audio files from the local
>>> system, uploads them to a web service, let's the user arrange and
>>> manipulate photos and music and then share the result with others. For
>>> this, I have two immediate use cases plus some more ideas:
>>>
>>> *Upload local files as binary blob to AWS S3*
>>>
>>> In my current, (hacky) version, I use the FileReader api (via
>>> simonH1000's filereader library) to read the content of a file into an
>>> ArrayBuffer, (represented as Json.Value in Elm) then use a modified version
>>> of elm-http to upload the content of the ArrayBuffer to an S3 storage
>>> bucket.
>>>
>>> *Download mp3 files, decode them and play them back via the AudioApi*
>>>
>>> Currently I do this with my modified http library to download the mp3
>>> file into an arraybuffer, then pass the resulting arraybuffer through a
>>> port to some native javascript that then uses the Audio Api to decode the
>>> mp3 file into a playable audiobuffer.
>>>
>>> *Parsing or otherwise processing local text files. *
>>>
>>> For another project I would be interested in reading and parsing
>>> Swagger/OpenAPI definition files and then providing a UI to compare rest
>>> apis. Since the processing will be done on simple Strings, this would only
>>> require FileReader support (specifically the readAsText method). This would
>>> already work with the FileReader library as is (though that one is not
>>> available on package.elm-lang.org because it contains native code and
>>> is not whitelisted).
>>>
>>> *TypedArrays and DataViews*
>>>
>>> I haven't worked with these yet, but I can anticipate some cases that
>>> would be interesting:
>>>
>>> *Parsing/manipulating of binary data via the ArrayBuffer api.*
>>>
>>> One case I personally would like to do with this, is to parse the Exif
>>> header of the jpeg files the user loaded from the local file system. My
>>> slideshow could then display metadata information without roundtripping to
>>> the server.
>>>
>>> *Create geometry for WebGL in the form of Vertex Buffers*
>>>
>>> *Generating sound/music by writing raw audio samples*
>>>
>>> These could then be played back via the Web audio apis.
>>>
>>>
>>> Please add your own ideas to this thread. Once we have compiled a list
>>> of use cases, we can look at the JS Apis available under the Web Platform
>>> for Files, ArrayBuffers, Typed Arrays etc. and think how these could be
>>> exposed to Elm.
>>>
>> --
> You received this message because you are subscribed to the Google Groups
> "Elm Discuss" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to elm-discuss+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>



-- 
Zach Kessin
SquareTarget 
Twitter: @zkessin 
Skype: zachkessin

-- 
You received this message because you are subscribed to the Google Groups "Elm 

[elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[Simon]

Hi all,
thought it might be worth updating this thread on my progress with S3, 
which I have now solved by adding one small hack to the Filereader 
 library (github only because of 
the native code). I have documented this at 
https://simonh1000.github.io/2016/12/elm-s3-uploads/ 

Meanwhile, I have a new use to register. I was looking at MessagePack 
 and noted that Elm is not included in the long list 
of supported languages. I suspect that it currently could not be because of 
the lack of ArrayBuffer support?

Simon


On Wednesday, 24 August 2016 18:06:40 UTC+2, Erik Lott wrote:
>
> Our primary application allows photographers to upload hundreds/thousands 
> of images for portfolio display. image delivery, etc. I guess you could say 
> that our app is generally driven by image uploads. I would love to see this 
> functionality provided by Elm, rather than having to use ports...
>
> On Thursday, July 28, 2016 at 5:17:51 PM UTC-4, Daniel Bachler wrote:
>>
>> I'd love to see support for the File and ArrayBuffer Apis, and maybe 
>> TypedArrays/DataViews as well. IMHO they are an important piece of the Web 
>> Platform that is still missing in Elm.
>>
>> Evan suggested collecting concrete use cases to guide the design. I would 
>> like this thread to be the starting point of this effort. I would like to 
>> ask anyone who would also like this feature or who has substantial 
>> experience using either Api to add use cases or comment here so that we can 
>> try to define the user story for both apis. From there, we could decide 
>> what we would like to see supported and what, if anything, we don't need 
>> for now and suggest Elm Apis.
>>
>> I have two stories from a side project of mine. It is a slideshow editor 
>> that allows the user to select photos and audio files from the local 
>> system, uploads them to a web service, let's the user arrange and 
>> manipulate photos and music and then share the result with others. For 
>> this, I have two immediate use cases plus some more ideas:
>>
>> *Upload local files as binary blob to AWS S3*
>>
>> In my current, (hacky) version, I use the FileReader api (via 
>> simonH1000's filereader library) to read the content of a file into an 
>> ArrayBuffer, (represented as Json.Value in Elm) then use a modified version 
>> of elm-http to upload the content of the ArrayBuffer to an S3 storage 
>> bucket.
>>
>> *Download mp3 files, decode them and play them back via the AudioApi*
>>
>> Currently I do this with my modified http library to download the mp3 
>> file into an arraybuffer, then pass the resulting arraybuffer through a 
>> port to some native javascript that then uses the Audio Api to decode the 
>> mp3 file into a playable audiobuffer.
>>
>> *Parsing or otherwise processing local text files. *
>>
>> For another project I would be interested in reading and parsing 
>> Swagger/OpenAPI definition files and then providing a UI to compare rest 
>> apis. Since the processing will be done on simple Strings, this would only 
>> require FileReader support (specifically the readAsText method). This would 
>> already work with the FileReader library as is (though that one is not 
>> available on package.elm-lang.org because it contains native code and is 
>> not whitelisted).
>>
>> *TypedArrays and DataViews*
>>
>> I haven't worked with these yet, but I can anticipate some cases that 
>> would be interesting:
>>
>> *Parsing/manipulating of binary data via the ArrayBuffer api.*
>>
>> One case I personally would like to do with this, is to parse the Exif 
>> header of the jpeg files the user loaded from the local file system. My 
>> slideshow could then display metadata information without roundtripping to 
>> the server.
>>
>> *Create geometry for WebGL in the form of Vertex Buffers*
>>
>> *Generating sound/music by writing raw audio samples*
>>
>> These could then be played back via the Web audio apis.
>>
>>
>> Please add your own ideas to this thread. Once we have compiled a list of 
>> use cases, we can look at the JS Apis available under the Web Platform for 
>> Files, ArrayBuffers, Typed Arrays etc. and think how these could be exposed 
>> to Elm. 
>>
>

-- 
You received this message because you are subscribed to the Google Groups "Elm 
Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elm-discuss+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[Erik Lott]

Our primary application allows photographers to upload hundreds/thousands 
of images for portfolio display. image delivery, etc. I guess you could say 
that our app is generally driven by image uploads. I would love to see this 
functionality provided by Elm, rather than having to use ports...

On Thursday, July 28, 2016 at 5:17:51 PM UTC-4, Daniel Bachler wrote:
>
> I'd love to see support for the File and ArrayBuffer Apis, and maybe 
> TypedArrays/DataViews as well. IMHO they are an important piece of the Web 
> Platform that is still missing in Elm.
>
> Evan suggested collecting concrete use cases to guide the design. I would 
> like this thread to be the starting point of this effort. I would like to 
> ask anyone who would also like this feature or who has substantial 
> experience using either Api to add use cases or comment here so that we can 
> try to define the user story for both apis. From there, we could decide 
> what we would like to see supported and what, if anything, we don't need 
> for now and suggest Elm Apis.
>
> I have two stories from a side project of mine. It is a slideshow editor 
> that allows the user to select photos and audio files from the local 
> system, uploads them to a web service, let's the user arrange and 
> manipulate photos and music and then share the result with others. For 
> this, I have two immediate use cases plus some more ideas:
>
> *Upload local files as binary blob to AWS S3*
>
> In my current, (hacky) version, I use the FileReader api (via simonH1000's 
> filereader library) to read the content of a file into an ArrayBuffer, 
> (represented as Json.Value in Elm) then use a modified version of elm-http 
> to upload the content of the ArrayBuffer to an S3 storage bucket.
>
> *Download mp3 files, decode them and play them back via the AudioApi*
>
> Currently I do this with my modified http library to download the mp3 file 
> into an arraybuffer, then pass the resulting arraybuffer through a port to 
> some native javascript that then uses the Audio Api to decode the mp3 file 
> into a playable audiobuffer.
>
> *Parsing or otherwise processing local text files. *
>
> For another project I would be interested in reading and parsing 
> Swagger/OpenAPI definition files and then providing a UI to compare rest 
> apis. Since the processing will be done on simple Strings, this would only 
> require FileReader support (specifically the readAsText method). This would 
> already work with the FileReader library as is (though that one is not 
> available on package.elm-lang.org because it contains native code and is 
> not whitelisted).
>
> *TypedArrays and DataViews*
>
> I haven't worked with these yet, but I can anticipate some cases that 
> would be interesting:
>
> *Parsing/manipulating of binary data via the ArrayBuffer api.*
>
> One case I personally would like to do with this, is to parse the Exif 
> header of the jpeg files the user loaded from the local file system. My 
> slideshow could then display metadata information without roundtripping to 
> the server.
>
> *Create geometry for WebGL in the form of Vertex Buffers*
>
> *Generating sound/music by writing raw audio samples*
>
> These could then be played back via the Web audio apis.
>
>
> Please add your own ideas to this thread. Once we have compiled a list of 
> use cases, we can look at the JS Apis available under the Web Platform for 
> Files, ArrayBuffers, Typed Arrays etc. and think how these could be exposed 
> to Elm. 
>

-- 
You received this message because you are subscribed to the Google Groups "Elm 
Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elm-discuss+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[Daniel Bachler]

Thank you Simon for the example, this is great! I created a new thread 
<`https://groups.google.com/forum/#!topic/elm-discuss/fVFXqEHpxAQ> to 
collect design ideas. Could you create a gist and post the link there?

On Wednesday, August 10, 2016 at 6:24:49 PM UTC+2, Simon wrote:
>
> I think this is the sort of code I would like to be able to write to do 
> signed S3 uploads
>
>
> FileReader API
>
> readFile : FileRef -> Task Error Blob
>
> and in the Http library
>
> blobData : Blob -> Http.Data
>
> such that
>
> get ("signature" := string) "/get_signature"
> `Task.andThen`
> \sig -> 
> readFile ref
> `Task.andThen`
> \content ->
> let 
> body = 
> multipart 
> [ ("signature", stringData signature)
> , ("file", blobData content)
> ]
> in
> Http.send defaultSettings
> { verb = "POST"
> , headers = [("Origin", origin)]
> , url = "http://bucket-name.s3.amazonaws.com/;
> , body = body
> }
> |> Http.fromJson ("ETag" := string)
>
> On Saturday, 30 July 2016 21:06:55 UTC+2, Jan Weitz wrote:
>
> I would like Binary decoders/encoders as John Watson  mentioned, as well.
>>
>>
>> - Encoding/Decoding MQTT messages (which itself might contain Protobuf 
>> messages) [
>> http://docs.oasis-open.org/mqtt/mqtt/v3.1.1/os/mqtt-v3.1.1-os.html#_Toc398718013
>> ]
>> - Encoding/Decoding Protobuf3 binary messages [
>> https://developers.google.com/protocol-buffers/docs/encoding]
>>
>> Inspirations for native interfaces (for web or server-side) might be:
>>
>> - https://github.com/dcodeIO/bytebuffer.js [Native/bytebuffer.js and 
>> ByteBuffer.elm]
>> - https://github.com/dcodeIO/long.js
>> - (https://github.com/dcodeIO/ProtoBuf.js) [Should be regular elm code]
>> - (https://github.com/google/protobuf/tree/master/js/binary) [Should be 
>> regular elm code]
>>
>>
>>
>> On Thursday, July 28, 2016 at 11:17:51 PM UTC+2, Daniel Bachler wrote:
>>>
>>> I'd love to see support for the File and ArrayBuffer Apis, and maybe 
>>> TypedArrays/DataViews as well. IMHO they are an important piece of the Web 
>>> Platform that is still missing in Elm.
>>>
>>> Evan suggested collecting concrete use cases to guide the design. I 
>>> would like this thread to be the starting point of this effort. I would 
>>> like to ask anyone who would also like this feature or who has substantial 
>>> experience using either Api to add use cases or comment here so that we can 
>>> try to define the user story for both apis. From there, we could decide 
>>> what we would like to see supported and what, if anything, we don't need 
>>> for now and suggest Elm Apis.
>>>
>>> I have two stories from a side project of mine. It is a slideshow editor 
>>> that allows the user to select photos and audio files from the local 
>>> system, uploads them to a web service, let's the user arrange and 
>>> manipulate photos and music and then share the result with others. For 
>>> this, I have two immediate use cases plus some more ideas:
>>>
>>> *Upload local files as binary blob to AWS S3*
>>>
>>> In my current, (hacky) version, I use the FileReader api (via 
>>> simonH1000's filereader library) to read the content of a file into an 
>>> ArrayBuffer, (represented as Json.Value in Elm) then use a modified version 
>>> of elm-http to upload the content of the ArrayBuffer to an S3 storage 
>>> bucket.
>>>
>>> *Download mp3 files, decode them and play them back via the AudioApi*
>>>
>>> Currently I do this with my modified http library to download the mp3 
>>> file into an arraybuffer, then pass the resulting arraybuffer through a 
>>> port to some native javascript that then uses the Audio Api to decode the 
>>> mp3 file into a playable audiobuffer.
>>>
>>> *Parsing or otherwise processing local text files. *
>>>
>>> For another project I would be interested in reading and parsing 
>>> Swagger/OpenAPI definition files and then providing a UI to compare rest 
>>> apis. Since the processing will be done on simple Strings, this would only 
>>> require FileReader support (specifically the readAsText method). This would 
>>> already work with the FileReader library as is (though that one is not 
>>> available on package.elm-lang.org because it contains native code and 
>>> is not whitelisted).
>>>
>>> *TypedArrays and DataViews*
>>>
>>> I haven't worked with these yet, but I can anticipate some cases that 
>>> would be interesting:
>>>
>>> *Parsing/manipulating of binary data via the ArrayBuffer api.*
>>>
>>> One case I personally would like to do with this, is to parse the Exif 
>>> header of the jpeg files the user loaded from the local file system. My 
>>> slideshow could then display metadata information without roundtripping to 
>>> the server.
>>>
>>> *Create 

[elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[Simon]

I think this is the sort of code I would like to be able to write to do 
signed S3 uploads


FileReader API

readFile : FileRef -> Task Error Blob

and in the Http library

blobData : Blob -> Http.Data

such that

get ("signature" := string) "/get_signature"
`Task.andThen`
\sig -> 
readFile ref
`Task.andThen`
\content ->
let 
body = 
multipart 
[ ("signature", stringData signature)
, ("file", blobData content)
]
in
Http.send defaultSettings
{ verb = "POST"
, headers = [("Origin", origin)]
, url = "http://bucket-name.s3.amazonaws.com/;
, body = body
}
|> Http.fromJson ("ETag" := string)

On Saturday, 30 July 2016 21:06:55 UTC+2, Jan Weitz wrote:

I would like Binary decoders/encoders as John Watson  mentioned, as well.
>
>
> - Encoding/Decoding MQTT messages (which itself might contain Protobuf 
> messages) [
> http://docs.oasis-open.org/mqtt/mqtt/v3.1.1/os/mqtt-v3.1.1-os.html#_Toc398718013
> ]
> - Encoding/Decoding Protobuf3 binary messages [
> https://developers.google.com/protocol-buffers/docs/encoding]
>
> Inspirations for native interfaces (for web or server-side) might be:
>
> - https://github.com/dcodeIO/bytebuffer.js [Native/bytebuffer.js and 
> ByteBuffer.elm]
> - https://github.com/dcodeIO/long.js
> - (https://github.com/dcodeIO/ProtoBuf.js) [Should be regular elm code]
> - (https://github.com/google/protobuf/tree/master/js/binary) [Should be 
> regular elm code]
>
>
>
> On Thursday, July 28, 2016 at 11:17:51 PM UTC+2, Daniel Bachler wrote:
>>
>> I'd love to see support for the File and ArrayBuffer Apis, and maybe 
>> TypedArrays/DataViews as well. IMHO they are an important piece of the Web 
>> Platform that is still missing in Elm.
>>
>> Evan suggested collecting concrete use cases to guide the design. I would 
>> like this thread to be the starting point of this effort. I would like to 
>> ask anyone who would also like this feature or who has substantial 
>> experience using either Api to add use cases or comment here so that we can 
>> try to define the user story for both apis. From there, we could decide 
>> what we would like to see supported and what, if anything, we don't need 
>> for now and suggest Elm Apis.
>>
>> I have two stories from a side project of mine. It is a slideshow editor 
>> that allows the user to select photos and audio files from the local 
>> system, uploads them to a web service, let's the user arrange and 
>> manipulate photos and music and then share the result with others. For 
>> this, I have two immediate use cases plus some more ideas:
>>
>> *Upload local files as binary blob to AWS S3*
>>
>> In my current, (hacky) version, I use the FileReader api (via 
>> simonH1000's filereader library) to read the content of a file into an 
>> ArrayBuffer, (represented as Json.Value in Elm) then use a modified version 
>> of elm-http to upload the content of the ArrayBuffer to an S3 storage 
>> bucket.
>>
>> *Download mp3 files, decode them and play them back via the AudioApi*
>>
>> Currently I do this with my modified http library to download the mp3 
>> file into an arraybuffer, then pass the resulting arraybuffer through a 
>> port to some native javascript that then uses the Audio Api to decode the 
>> mp3 file into a playable audiobuffer.
>>
>> *Parsing or otherwise processing local text files. *
>>
>> For another project I would be interested in reading and parsing 
>> Swagger/OpenAPI definition files and then providing a UI to compare rest 
>> apis. Since the processing will be done on simple Strings, this would only 
>> require FileReader support (specifically the readAsText method). This would 
>> already work with the FileReader library as is (though that one is not 
>> available on package.elm-lang.org because it contains native code and is 
>> not whitelisted).
>>
>> *TypedArrays and DataViews*
>>
>> I haven't worked with these yet, but I can anticipate some cases that 
>> would be interesting:
>>
>> *Parsing/manipulating of binary data via the ArrayBuffer api.*
>>
>> One case I personally would like to do with this, is to parse the Exif 
>> header of the jpeg files the user loaded from the local file system. My 
>> slideshow could then display metadata information without roundtripping to 
>> the server.
>>
>> *Create geometry for WebGL in the form of Vertex Buffers*
>>
>> *Generating sound/music by writing raw audio samples*
>>
>> These could then be played back via the Web audio apis.
>>
>>
>> Please add your own ideas to this thread. Once we have compiled a list of 
>> use cases, we can look at the JS Apis available under the Web Platform for 
>> Files, ArrayBuffers, Typed Arrays etc. and think how these could be exposed 
>> to Elm. 
>>

[elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[Jan Weitz]

I would like Binary decoders/encoders as John Watson  mentioned, as well.


- Encoding/Decoding MQTT messages (which itself might contain Protobuf 
messages) [
http://docs.oasis-open.org/mqtt/mqtt/v3.1.1/os/mqtt-v3.1.1-os.html#_Toc398718013]
- Encoding/Decoding Protobuf3 binary messages [
https://developers.google.com/protocol-buffers/docs/encoding]

Inspirations for native interfaces (for web or server-side) might be:

- https://github.com/dcodeIO/bytebuffer.js [Native/bytebuffer.js and 
ByteBuffer.elm]
- https://github.com/dcodeIO/long.js
- (https://github.com/dcodeIO/ProtoBuf.js) [Should be regular elm code]
- (https://github.com/google/protobuf/tree/master/js/binary) [Should be 
regular elm code]



On Thursday, July 28, 2016 at 11:17:51 PM UTC+2, Daniel Bachler wrote:
>
> I'd love to see support for the File and ArrayBuffer Apis, and maybe 
> TypedArrays/DataViews as well. IMHO they are an important piece of the Web 
> Platform that is still missing in Elm.
>
> Evan suggested collecting concrete use cases to guide the design. I would 
> like this thread to be the starting point of this effort. I would like to 
> ask anyone who would also like this feature or who has substantial 
> experience using either Api to add use cases or comment here so that we can 
> try to define the user story for both apis. From there, we could decide 
> what we would like to see supported and what, if anything, we don't need 
> for now and suggest Elm Apis.
>
> I have two stories from a side project of mine. It is a slideshow editor 
> that allows the user to select photos and audio files from the local 
> system, uploads them to a web service, let's the user arrange and 
> manipulate photos and music and then share the result with others. For 
> this, I have two immediate use cases plus some more ideas:
>
> *Upload local files as binary blob to AWS S3*
>
> In my current, (hacky) version, I use the FileReader api (via simonH1000's 
> filereader library) to read the content of a file into an ArrayBuffer, 
> (represented as Json.Value in Elm) then use a modified version of elm-http 
> to upload the content of the ArrayBuffer to an S3 storage bucket.
>
> *Download mp3 files, decode them and play them back via the AudioApi*
>
> Currently I do this with my modified http library to download the mp3 file 
> into an arraybuffer, then pass the resulting arraybuffer through a port to 
> some native javascript that then uses the Audio Api to decode the mp3 file 
> into a playable audiobuffer.
>
> *Parsing or otherwise processing local text files. *
>
> For another project I would be interested in reading and parsing 
> Swagger/OpenAPI definition files and then providing a UI to compare rest 
> apis. Since the processing will be done on simple Strings, this would only 
> require FileReader support (specifically the readAsText method). This would 
> already work with the FileReader library as is (though that one is not 
> available on package.elm-lang.org because it contains native code and is 
> not whitelisted).
>
> *TypedArrays and DataViews*
>
> I haven't worked with these yet, but I can anticipate some cases that 
> would be interesting:
>
> *Parsing/manipulating of binary data via the ArrayBuffer api.*
>
> One case I personally would like to do with this, is to parse the Exif 
> header of the jpeg files the user loaded from the local file system. My 
> slideshow could then display metadata information without roundtripping to 
> the server.
>
> *Create geometry for WebGL in the form of Vertex Buffers*
>
> *Generating sound/music by writing raw audio samples*
>
> These could then be played back via the Web audio apis.
>
>
> Please add your own ideas to this thread. Once we have compiled a list of 
> use cases, we can look at the JS Apis available under the Web Platform for 
> Files, ArrayBuffers, Typed Arrays etc. and think how these could be exposed 
> to Elm. 
>

-- 
You received this message because you are subscribed to the Google Groups "Elm 
Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elm-discuss+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[Peter Damoc]

I need to upload user avatar image and company logo. :)

On Fri, Jul 29, 2016 at 11:54 AM, Michael B  wrote:

> ..and it's for an audio programming language, so the ability to read and
> write binary data would be fantastic.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Elm Discuss" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to elm-discuss+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>



-- 
There is NO FATE, we are the creators.
blog: http://damoc.ro/

-- 
You received this message because you are subscribed to the Google Groups "Elm 
Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elm-discuss+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[Michael B]

..and it's for an audio programming language, so the ability to read and write 
binary data would be fantastic.

-- 
You received this message because you are subscribed to the Google Groups "Elm 
Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elm-discuss+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[Michael B]

I'm making a browser based IDE, so support for the FileReader API is essential 
for opening local files.

-- 
You received this message because you are subscribed to the Google Groups "Elm 
Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elm-discuss+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[elm-discuss] Re: Collecting use cases for File, ArrayBuffer and TypedArrays/DataViews

[John Watson]

Hi, Daniel,  thanks for starting this off.  One thing I'd like to add:

*Binary Base64 decoders.*

These could obviously be for any binary resource that is smuggled into elm 
as text.  In my case I need to reconstitute soundfonts that are available 
as base64 encoded resources embedded in JSON.

I'm mainly interested in web-audio.  It seems to me if ever Evan (or 
somebody) gets round to doing elm-lang/web-audio, then binary types will be 
needed.  And I really would like access to web-audio (and web-midi) by 
means of a core elm library.   

On Thursday, 28 July 2016 22:17:51 UTC+1, Daniel Bachler wrote:
>
> I'd love to see support for the File and ArrayBuffer Apis, and maybe 
> TypedArrays/DataViews as well. IMHO they are an important piece of the Web 
> Platform that is still missing in Elm.
>
> Evan suggested collecting concrete use cases to guide the design. I would 
> like this thread to be the starting point of this effort. I would like to 
> ask anyone who would also like this feature or who has substantial 
> experience using either Api to add use cases or comment here so that we can 
> try to define the user story for both apis. From there, we could decide 
> what we would like to see supported and what, if anything, we don't need 
> for now and suggest Elm Apis.
>
> I have two stories from a side project of mine. It is a slideshow editor 
> that allows the user to select photos and audio files from the local 
> system, uploads them to a web service, let's the user arrange and 
> manipulate photos and music and then share the result with others. For 
> this, I have two immediate use cases plus some more ideas:
>
> *Upload local files as binary blob to AWS S3*
>
> In my current, (hacky) version, I use the FileReader api (via simonH1000's 
> filereader library) to read the content of a file into an ArrayBuffer, 
> (represented as Json.Value in Elm) then use a modified version of elm-http 
> to upload the content of the ArrayBuffer to an S3 storage bucket.
>
> *Download mp3 files, decode them and play them back via the AudioApi*
>
> Currently I do this with my modified http library to download the mp3 file 
> into an arraybuffer, then pass the resulting arraybuffer through a port to 
> some native javascript that then uses the Audio Api to decode the mp3 file 
> into a playable audiobuffer.
>
> *Parsing or otherwise processing local text files. *
>
> For another project I would be interested in reading and parsing 
> Swagger/OpenAPI definition files and then providing a UI to compare rest 
> apis. Since the processing will be done on simple Strings, this would only 
> require FileReader support (specifically the readAsText method). This would 
> already work with the FileReader library as is (though that one is not 
> available on package.elm-lang.org because it contains native code and is 
> not whitelisted).
>
> *TypedArrays and DataViews*
>
> I haven't worked with these yet, but I can anticipate some cases that 
> would be interesting:
>
> *Parsing/manipulating of binary data via the ArrayBuffer api.*
>
> One case I personally would like to do with this, is to parse the Exif 
> header of the jpeg files the user loaded from the local file system. My 
> slideshow could then display metadata information without roundtripping to 
> the server.
>
> *Create geometry for WebGL in the form of Vertex Buffers*
>
> *Generating sound/music by writing raw audio samples*
>
> These could then be played back via the Web audio apis.
>
>
> Please add your own ideas to this thread. Once we have compiled a list of 
> use cases, we can look at the JS Apis available under the Web Platform for 
> Files, ArrayBuffers, Typed Arrays etc. and think how these could be exposed 
> to Elm. 
>

-- 
You received this message because you are subscribed to the Google Groups "Elm 
Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elm-discuss+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.