Thank you @Amit
Sent from my iPhone
> On Jan 23, 2017, at 12:08 PM, Amit Sela <amitsel...@gmail.com> wrote:
>
> Done. Welcome!
>
>> On Mon, Jan 23, 2017 at 10:03 PM Xu Mingmin <mmxu1...@gmail.com> wrote:
>> can anyone add me to the channel as well? Tha
> <https://issues.apache.org/jira/browse/BEAM-1294>.
>
> Amit.
>
> On Sat, Jan 21, 2017 at 10:41 PM Xu Mingmin <mmxu1...@gmail.com> wrote:
>
> Thanks @Amit for the detailed design doc, that helps a lot to understand
> how it works in the backend.
>
> I t
, since your pipeline only reads/writes and doesn't
> apply any time-consuming computations or shuffles, you could increase the
> read time percentage ("--readTimePercentage": (0, 1) defaults to 0.1).
>
> Let me know if this helps.
>
> Amit
>
> On Sat, Jan 21, 2017 at 12:0
machine can provide instead of
> the default 4 set in SparkPipelineOptions.
> If resources are indeed the problem you could also try increasing the
> batch interval (--batchIntervalMillis) (default: 1000) and even bounding
> the records read in each microbatch ("--maxRecordsPerBat
ngListenerBus has already stopped".
>
> Are you running in local-mode ("local[*]") ? or over YARN ?
> Any specific options you're using ?
> Would you mind trying the Beam Snapshot ? 0.5.0-SNAPSHOT
>
> Amit.
>
> On Fri, Jan 20, 2017 at 9:20 PM Xu Mingmin &
