Re: Regarding Beam Slack Channel

2017-06-23 Thread Jyotirmoy Sundi
Hi Manu,
 May you please also send to me ?

On Fri, Jun 23, 2017 at 4:31 AM, Manu Zhang <owenzhang1...@gmail.com> wrote:

> Hey Kamil,
>
> Just sent you an invitation.
>
>
> On Fri, Jun 23, 2017 at 6:38 PM Kamil Szewczyk <szewi...@gmail.com> wrote:
>
>> Hello,
>>
>> Can someone please add me to the Beam slack channel?
>>
>> Thanks.
>>
>


-- 
Best Regards,
Jyotirmoy Sundi


reading from s3 file in aws

2017-06-21 Thread Jyotirmoy Sundi
Hi Folks,

   Is there any way to read from s3 buckets in beam,

Trace:
Exception in thread "main" java.lang.IllegalStateException: Failed to
validate s3://my_bucket/path/to/input-*.csv
at org.apache.beam.sdk.io.TextIO$Read$Bound.expand(TextIO.java:254)
at org.apache.beam.sdk.io.TextIO$Read$Bound.expand(TextIO.java:165)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:420)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:334)
at org.apache.beam.sdk.values.PBegin.apply(PBegin.java:47)
at org.apache.beam.sdk.Pipeline.apply(Pipeline.java:157)
at com.intuit.pml.sessions.Eyeball.main(Eyeball.java:77)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.intellij.rt.execution.application.AppMain.main(AppMain.java:144)
Caused by: java.io.IOException: Unable to find handler for
s3://my_bucket/path/to/input-*.csv
at
org.apache.beam.sdk.util.IOChannelUtils.getFactory(IOChannelUtils.java:307)
at org.apache.beam.sdk.io.TextIO$Read$Bound.expand(TextIO.java:249)
... 11 more
-- 
Best Regards,