[jira] [Commented] (BEAM-302) Add Scio Scala DSL to Beam

2017-01-24 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836540#comment-15836540 ] Amit Sela commented on BEAM-302: [~davor] where are we with Scio integration ? > Add Scio Scala DSL to Beam

[jira] [Commented] (BEAM-302) Add Scio Scala DSL to Beam

2017-01-24 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836535#comment-15836535 ] Amit Sela commented on BEAM-302: Scio currently supports the Dataflow SDK (sort of Beam predecessor), and

[jira] [Created] (BEAM-1294) Long running UnboundedSource Readers via Broadcasts

2017-01-21 Thread Amit Sela (JIRA)
Amit Sela created BEAM-1294: --- Summary: Long running UnboundedSource Readers via Broadcasts Key: BEAM-1294 URL: https://issues.apache.org/jira/browse/BEAM-1294 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-1291) KafkaIO: don't log warning in offset fetcher while closing the reader.

2017-01-21 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela resolved BEAM-1291. - Resolution: Fixed Fix Version/s: 0.5.0 > KafkaIO: don't log warning in offset fetcher while closing

[jira] [Closed] (BEAM-1214) fail to run on SparkRunner with VerifyError

2017-01-19 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela closed BEAM-1214. --- Resolution: Fixed Fix Version/s: 0.5.0 > fail to run on SparkRunner with VerifyError >

[jira] [Updated] (BEAM-648) Persist and restore Aggergator values in case of recovery from failure

2017-01-19 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-648: --- Assignee: Aviem Zur (was: Jean-Baptiste Onofré) > Persist and restore Aggergator values in case of recovery

[jira] [Comment Edited] (BEAM-1214) fail to run on SparkRunner with VerifyError

2017-01-19 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829944#comment-15829944 ] Amit Sela edited comment on BEAM-1214 at 1/19/17 1:56 PM: -- Sorry for taking so

[jira] [Commented] (BEAM-1214) fail to run on SparkRunner with VerifyError

2017-01-19 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829944#comment-15829944 ] Amit Sela commented on BEAM-1214: - [~mingmxu] could you share your pom please ? I'm wondering if you're

[jira] [Resolved] (BEAM-979) ConcurrentModificationException exception after hours of running

2017-01-19 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela resolved BEAM-979. Resolution: Fixed Fix Version/s: 0.5.0 Resolved by BEAM-1177 > ConcurrentModificationException

[jira] [Resolved] (BEAM-921) Register Coders and Sources to serialize with JavaSerializer

2017-01-19 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela resolved BEAM-921. Resolution: Fixed Fix Version/s: 0.5.0 > Register Coders and Sources to serialize with JavaSerializer

[jira] [Commented] (BEAM-849) Redesign PipelineResult API

2017-01-12 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820729#comment-15820729 ] Amit Sela commented on BEAM-849: So in the "spirit" of the unified model, would you agree that bounded

[jira] [Created] (BEAM-1256) SparkPipelineResult.StreamingMode should not return null on awaitTermination()

2017-01-10 Thread Amit Sela (JIRA)
Amit Sela created BEAM-1256: --- Summary: SparkPipelineResult.StreamingMode should not return null on awaitTermination() Key: BEAM-1256 URL: https://issues.apache.org/jira/browse/BEAM-1256 Project: Beam

[jira] [Closed] (BEAM-1177) Input DStream "bundles" should be in serialized form and include relevant metadata.

2017-01-10 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela closed BEAM-1177. --- > Input DStream "bundles" should be in serialized form and include relevant > metadata. >

[jira] [Closed] (BEAM-1250) Remove leaf when materializing PCollection to avoid re-evaluation.

2017-01-07 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela closed BEAM-1250. --- Resolution: Fixed Fix Version/s: 0.5.0 > Remove leaf when materializing PCollection to avoid

[jira] [Updated] (BEAM-1250) Remove leaf when materializing PCollection to avoid re-evaluation.

2017-01-06 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-1250: Description: When materializing a {{PCollection}} (implemented as {{RDD}}), to create a {{PCollectionView}}

[jira] [Created] (BEAM-1250) Remove leaf when materializing PCollection to avoid re-evaluation.

2017-01-06 Thread Amit Sela (JIRA)
Amit Sela created BEAM-1250: --- Summary: Remove leaf when materializing PCollection to avoid re-evaluation. Key: BEAM-1250 URL: https://issues.apache.org/jira/browse/BEAM-1250 Project: Beam Issue

[jira] [Updated] (BEAM-649) Cache any PCollection implementation if accessed more than once

2017-01-04 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-649: --- Description: Currently, the runner will cache any {{PCollection}} implementation - {{RDD}} or {{DStream}} - if

[jira] [Updated] (BEAM-649) Cache any PCollection implementation if accessed more than once

2017-01-04 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-649: --- Summary: Cache any PCollection implementation if accessed more than once (was: Pipeline "actions" should use

[jira] [Commented] (BEAM-18) Add support for new Beam Sink API

2017-01-04 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799073#comment-15799073 ] Amit Sela commented on BEAM-18: --- Since {{Sink}} is not a {{PTransform}}, but made of several {{Par.Do}}s, it is

[jira] [Resolved] (BEAM-1145) Remove classifier from shaded spark runner artifact

2017-01-02 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela resolved BEAM-1145. - Resolution: Fixed Fix Version/s: 0.5.0 > Remove classifier from shaded spark runner artifact >

[jira] [Resolved] (BEAM-1146) Decrease spark runner startup overhead

2017-01-02 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela resolved BEAM-1146. - Resolution: Fixed Fix Version/s: 0.5.0 > Decrease spark runner startup overhead >

<    1   2