Re: Regarding Beam Slack Channel
Hi Manu, May you please also send to me ? On Fri, Jun 23, 2017 at 4:31 AM, Manu Zhang <owenzhang1...@gmail.com> wrote: > Hey Kamil, > > Just sent you an invitation. > > > On Fri, Jun 23, 2017 at 6:38 PM Kamil Szewczyk <szewi...@gmail.com> wrote: > >> Hello, >> >> Can someone please add me to the Beam slack channel? >> >> Thanks. >> > -- Best Regards, Jyotirmoy Sundi
reading from s3 file in aws
Hi Folks, Is there any way to read from s3 buckets in beam, Trace: Exception in thread "main" java.lang.IllegalStateException: Failed to validate s3://my_bucket/path/to/input-*.csv at org.apache.beam.sdk.io.TextIO$Read$Bound.expand(TextIO.java:254) at org.apache.beam.sdk.io.TextIO$Read$Bound.expand(TextIO.java:165) at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:420) at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:334) at org.apache.beam.sdk.values.PBegin.apply(PBegin.java:47) at org.apache.beam.sdk.Pipeline.apply(Pipeline.java:157) at com.intuit.pml.sessions.Eyeball.main(Eyeball.java:77) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.intellij.rt.execution.application.AppMain.main(AppMain.java:144) Caused by: java.io.IOException: Unable to find handler for s3://my_bucket/path/to/input-*.csv at org.apache.beam.sdk.util.IOChannelUtils.getFactory(IOChannelUtils.java:307) at org.apache.beam.sdk.io.TextIO$Read$Bound.expand(TextIO.java:249) ... 11 more -- Best Regards,