[jira] (BEAM-1354) TextIO should comply with PTransform style guide

Title: Message Title Aviem Zur updated an issue

[jira] [Commented] (BEAM-1092) Shade commonly used libraries (e.g. Guava) to avoid class conflicts

[ https://issues.apache.org/jira/browse/BEAM-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848318#comment-15848318 ] Aviem Zur commented on BEAM-1092: - [~davor] I agree that a general solution requires some thought.

[jira] [Commented] (BEAM-1379) Shade Guava in beam-sdks-java-io-kafka module

[ https://issues.apache.org/jira/browse/BEAM-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15850030#comment-15850030 ] Aviem Zur commented on BEAM-1379: - Kafka IO is commonly used in clusters which may have a different version

[jira] [Created] (BEAM-1379) Shade Guava in beam-sdks-java-io-kafka module

Aviem Zur created BEAM-1379: --- Summary: Shade Guava in beam-sdks-java-io-kafka module Key: BEAM-1379 URL: https://issues.apache.org/jira/browse/BEAM-1379 Project: Beam Issue Type: Task

[jira] [Commented] (BEAM-1092) Shade commonly used libraries (e.g. Guava) to avoid class conflicts

[ https://issues.apache.org/jira/browse/BEAM-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15850033#comment-15850033 ] Aviem Zur commented on BEAM-1092: - [~dhalp...@google.com] Sure. See:

[jira] [Assigned] (BEAM-1354) TextIO should comply with PTransform style guide

[ https://issues.apache.org/jira/browse/BEAM-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1354: --- Assignee: Aviem Zur > TextIO should comply with PTransform style guide >

[jira] [Assigned] (BEAM-1397) Introduce IO metrics

[ https://issues.apache.org/jira/browse/BEAM-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1397: --- Assignee: Aviem Zur (was: Daniel Halperin) > Introduce IO metrics > > >

[jira] [Created] (BEAM-1397) Introduce IO metrics

Aviem Zur created BEAM-1397: --- Summary: Introduce IO metrics Key: BEAM-1397 URL: https://issues.apache.org/jira/browse/BEAM-1397 Project: Beam Issue Type: New Feature Components:

[jira] [Assigned] (BEAM-1397) Introduce IO metrics

[ https://issues.apache.org/jira/browse/BEAM-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1397: --- Assignee: Daniel Halperin (was: Davor Bonaci) > Introduce IO metrics > > >

[jira] [Assigned] (BEAM-1398) KafkaIO metrics

[ https://issues.apache.org/jira/browse/BEAM-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1398: --- Assignee: Aviem Zur (was: Daniel Halperin) > KafkaIO metrics > --- > >

[jira] [Assigned] (BEAM-1398) KafkaIO metrics

[ https://issues.apache.org/jira/browse/BEAM-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1398: --- Assignee: Daniel Halperin (was: Davor Bonaci) > KafkaIO metrics > --- > >

[jira] [Created] (BEAM-1398) KafkaIO metrics

Aviem Zur created BEAM-1398: --- Summary: KafkaIO metrics Key: BEAM-1398 URL: https://issues.apache.org/jira/browse/BEAM-1398 Project: Beam Issue Type: New Feature Components:

[jira] [Resolved] (BEAM-1126) Expose UnboundedSource split backlog in number of events

[ https://issues.apache.org/jira/browse/BEAM-1126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1126. - Resolution: Invalid Fix Version/s: Not applicable > Expose UnboundedSource split backlog in number

[jira] [Resolved] (BEAM-1334) Split UsesMetrics category and tests into UsesCommittedMetrics and UsesAttemptedMetrics

[ https://issues.apache.org/jira/browse/BEAM-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1334. - Resolution: Done Fix Version/s: 0.6.0 > Split UsesMetrics category and tests into

[jira] [Resolved] (BEAM-1379) Shade Guava in beam-sdks-java-io-kafka module

[ https://issues.apache.org/jira/browse/BEAM-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1379. - Resolution: Fixed Fix Version/s: 0.6.0 > Shade Guava in beam-sdks-java-io-kafka module >

[jira] [Created] (BEAM-1433) Remove coder from TextIO

Aviem Zur created BEAM-1433: --- Summary: Remove coder from TextIO Key: BEAM-1433 URL: https://issues.apache.org/jira/browse/BEAM-1433 Project: Beam Issue Type: Sub-task Components:

[jira] [Commented] (BEAM-1402) Make TextIO and AvroIO use best-practice types.

[ https://issues.apache.org/jira/browse/BEAM-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857408#comment-15857408 ] Aviem Zur commented on BEAM-1402: - OK. Created sub-task BEAM-1433 and PR. > Make TextIO and AvroIO use

[jira] [Commented] (BEAM-1402) Make TextIO and AvroIO use best-practice types.

[ https://issues.apache.org/jira/browse/BEAM-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857339#comment-15857339 ] Aviem Zur commented on BEAM-1402: - I've started working on some of what [~jkff] mentioned in BEAM-1354

[jira] [Commented] (BEAM-1354) TextIO should comply with PTransform style guide

[ https://issues.apache.org/jira/browse/BEAM-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857335#comment-15857335 ] Aviem Zur commented on BEAM-1354: - I've started working on this (locally). I've gone ahead with removing

[jira] [Assigned] (BEAM-1334) Split UsesMetrics category and tests into UsesCommittedMetrics and UsesAttemptedMetrics

[ https://issues.apache.org/jira/browse/BEAM-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1334: --- Assignee: Aviem Zur (was: Ben Chambers) > Split UsesMetrics category and tests into

[jira] [Created] (BEAM-1334) Split UsesMetrics category and tests into UsesCommittedMetrics and UsesAttemptedMetrics

Aviem Zur created BEAM-1334: --- Summary: Split UsesMetrics category and tests into UsesCommittedMetrics and UsesAttemptedMetrics Key: BEAM-1334 URL: https://issues.apache.org/jira/browse/BEAM-1334 Project:

[jira] [Updated] (BEAM-1334) Split UsesMetrics category and tests into UsesCommittedMetrics and UsesAttemptedMetrics

[ https://issues.apache.org/jira/browse/BEAM-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1334: Assignee: Ben Chambers (was: Davor Bonaci) > Split UsesMetrics category and tests into UsesCommittedMetrics

[jira] (BEAM-1344) Uniform metrics step name semantics

Title: Message Title Aviem Zur created an issue

[jira] [Updated] (BEAM-1465) No natural place to flush/close resources in FileBasedWriter

[ https://issues.apache.org/jira/browse/BEAM-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1465: Summary: No natural place to flush/close resources in FileBasedWriter (was: No natural place to flush

[jira] [Assigned] (BEAM-1465) No natural place to flush/close resources in FileBasedWriter

[ https://issues.apache.org/jira/browse/BEAM-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1465: --- Assignee: Aviem Zur (was: Daniel Halperin) > No natural place to flush/close resources in

[jira] [Updated] (BEAM-1465) No natural place to flush outputs in FileBasedWriter

[ https://issues.apache.org/jira/browse/BEAM-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1465: Description: {{FileBasedWriter}} API does not have a natural place to flush/close resources opened by the

[jira] [Updated] (BEAM-1398) KafkaIO metrics

[ https://issues.apache.org/jira/browse/BEAM-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1398: Description: Add metrics to {{KafkaIO}} using the metrics API. Metrics (Feel free to add more ideas here)

[jira] [Updated] (BEAM-1513) Skip slower verifications if '-DskipTests' specified

[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1513: Description: Skip slower verifications (checkstyle, rat and findbugs) if '-DskipTests' was specified in the

[jira] [Updated] (BEAM-1513) Skip slower verifications if '-DskipTests' specified

[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1513: Description: Skip slower verifications (checkstyle, rat and findbugs) if '-DskipTests' was specified in the

[jira] [Updated] (BEAM-1513) Skip slower verifications if '-Dquick' specified. Enable them otherwise

[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1513: Description: Skip slower verifications (checkstyle, rat and findbugs) if '-Dquick' was specified in the

[jira] [Updated] (BEAM-1513) Skip slower verifications if '-Dquick' specified

[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1513: Summary: Skip slower verifications if '-Dquick' specified (was: Skip slower verifications if '-DskipTests'

[jira] [Assigned] (BEAM-1446) Create should take a TypeDescriptor as an alternative to explicitly specifying the Coder

[ https://issues.apache.org/jira/browse/BEAM-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1446: --- Assignee: Aviem Zur > Create should take a TypeDescriptor as an alternative to explicitly >

[jira] [Assigned] (BEAM-1379) Shade Guava in beam-sdks-java-io-kafka module

[ https://issues.apache.org/jira/browse/BEAM-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1379: --- Assignee: Aviem Zur (was: Davor Bonaci) > Shade Guava in beam-sdks-java-io-kafka module >

[jira] [Assigned] (BEAM-1061) PreCommit test with side inputs

[ https://issues.apache.org/jira/browse/BEAM-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1061: --- Assignee: (was: Aviem Zur) > PreCommit test with side inputs > --- >

[jira] [Updated] (BEAM-1146) Decrease spark runner startup overhead

[ https://issues.apache.org/jira/browse/BEAM-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1146: Description: BEAM-921 introduced a lazy singleton instantiated once in each JVM (driver & executors) which

[jira] [Updated] (BEAM-1145) Remove classifier from shaded spark runner artifact

[ https://issues.apache.org/jira/browse/BEAM-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1145: Description: Shade plugin configured in spark runner's pom adds a classifier to spark runner shaded jar

[jira] [Updated] (BEAM-1146) Decrease spark runner startup overhead

[ https://issues.apache.org/jira/browse/BEAM-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1146: Description: BEAM-921 introduced a lazy singleton instantiated once in each JVM (driver & executors) which

[jira] [Updated] (BEAM-1465) No natural place to flush resources in FileBasedWriter

[ https://issues.apache.org/jira/browse/BEAM-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1465: Description: {{FileBasedWriter}} API does not have a natural place to flush resources opened by the writer.

[jira] [Updated] (BEAM-1512) Optimize leaf transforms materialization

[ https://issues.apache.org/jira/browse/BEAM-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1512: Summary: Optimize leaf transforms materialization (was: Optimize leaf transformation materialization) >

[jira] [Assigned] (BEAM-1512) Optimize leaf transforms materialization

[ https://issues.apache.org/jira/browse/BEAM-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1512: --- Assignee: Aviem Zur (was: Amit Sela) > Optimize leaf transforms materialization >

[jira] [Created] (BEAM-1513) Skip slower verifications if '-DskipTests' specified

Aviem Zur created BEAM-1513: --- Summary: Skip slower verifications if '-DskipTests' specified Key: BEAM-1513 URL: https://issues.apache.org/jira/browse/BEAM-1513 Project: Beam Issue Type:

[jira] [Assigned] (BEAM-1513) Skip slower verifications if '-DskipTests' specified

[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1513: --- Assignee: Aviem Zur (was: Davor Bonaci) > Skip slower verifications if '-DskipTests' specified >

[jira] [Updated] (BEAM-1513) Skip slower verifications if '-DskipTests' specified

[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1513: Priority: Minor (was: Major) > Skip slower verifications if '-DskipTests' specified >

[jira] [Assigned] (BEAM-1356) `mvn clean install -DskipTests` still runs python tests

[ https://issues.apache.org/jira/browse/BEAM-1356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1356: --- Assignee: Aviem Zur (was: Ahmet Altay) > `mvn clean install -DskipTests` still runs python tests >

[jira] [Assigned] (BEAM-1513) Skip slower verifications if '-Dquick' specified. Enable them otherwise

[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1513: --- Assignee: Davor Bonaci (was: Aviem Zur) > Skip slower verifications if '-Dquick' specified. Enable

[jira] [Updated] (BEAM-1398) KafkaIO metrics

[ https://issues.apache.org/jira/browse/BEAM-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1398: Description: Add metrics to {{KafkaIO}} using the metrics API. Metrics (Feel free to add more ideas here)

[jira] [Resolved] (BEAM-1465) No natural place to flush resources in FileBasedWriter

[ https://issues.apache.org/jira/browse/BEAM-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1465. - Resolution: Fixed Fix Version/s: 0.6.0 > No natural place to flush resources in FileBasedWriter >

[jira] [Assigned] (BEAM-1437) Spark runner StreamingListeners are not recoverable.

[ https://issues.apache.org/jira/browse/BEAM-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1437: --- Assignee: Aviem Zur > Spark runner StreamingListeners are not recoverable. >

[jira] [Assigned] (BEAM-1465) No natural place to flush outputs in FileBasedWriter

[ https://issues.apache.org/jira/browse/BEAM-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1465: --- Assignee: Daniel Halperin (was: Davor Bonaci) > No natural place to flush outputs in FileBasedWriter

[jira] [Created] (BEAM-1465) No natural place to flush outputs in FileBasedWriter

Aviem Zur created BEAM-1465: --- Summary: No natural place to flush outputs in FileBasedWriter Key: BEAM-1465 URL: https://issues.apache.org/jira/browse/BEAM-1465 Project: Beam Issue Type: Bug

[jira] [Assigned] (BEAM-1466) JSON utils extension

[ https://issues.apache.org/jira/browse/BEAM-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1466: --- Assignee: Aviem Zur (was: Davor Bonaci) > JSON utils extension > > >

[jira] [Assigned] (BEAM-1294) Long running UnboundedSource Readers via Broadcasts

[ https://issues.apache.org/jira/browse/BEAM-1294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1294: --- Assignee: Aviem Zur (was: Amit Sela) > Long running UnboundedSource Readers via Broadcasts >

[jira] [Commented] (BEAM-1457) Enable rat plugin and findbugs plugin in default build

[ https://issues.apache.org/jira/browse/BEAM-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15863223#comment-15863223 ] Aviem Zur commented on BEAM-1457: - Not really sure what was decided around this issue. > Enable rat plugin

[jira] [Resolved] (BEAM-1433) Remove coder from TextIO

[ https://issues.apache.org/jira/browse/BEAM-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1433. - Resolution: Done Fix Version/s: 0.6.0 > Remove coder from TextIO > > >

[jira] [Created] (BEAM-1457) Enable rat plugin and findbugs plugin in default build

Aviem Zur created BEAM-1457: --- Summary: Enable rat plugin and findbugs plugin in default build Key: BEAM-1457 URL: https://issues.apache.org/jira/browse/BEAM-1457 Project: Beam Issue Type:

[jira] [Commented] (BEAM-1457) Enable rat plugin and findbugs plugin in default build

[ https://issues.apache.org/jira/browse/BEAM-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861391#comment-15861391 ] Aviem Zur commented on BEAM-1457: - I ran a quick test on my laptop to see how much time they add to the

[jira] [Updated] (BEAM-1457) Enable rat plugin and findbugs plugin in default build

[ https://issues.apache.org/jira/browse/BEAM-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1457: Description: Today, maven rat plugin and findbugs plugin only run when `release` profile is specified.

[jira] [Created] (BEAM-1448) Coder encode/decode context documentation is lacking

Aviem Zur created BEAM-1448: --- Summary: Coder encode/decode context documentation is lacking Key: BEAM-1448 URL: https://issues.apache.org/jira/browse/BEAM-1448 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-1563) Flatten Spark runner libraries.

[ https://issues.apache.org/jira/browse/BEAM-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1563: Description: Flatten Spark runner libraries into a single package (or two) so that everything is private.

[jira] [Commented] (BEAM-1572) Add per-stage matching of scope in metrics for the DirectRunner

[ https://issues.apache.org/jira/browse/BEAM-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887219#comment-15887219 ] Aviem Zur commented on BEAM-1572: - Please note that this relates to

[jira] [Assigned] (BEAM-1551) Allow PAssert#that to take a message

[ https://issues.apache.org/jira/browse/BEAM-1551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1551: --- Assignee: Aviem Zur > Allow PAssert#that to take a message > > >

[jira] [Updated] (BEAM-1337) Use our coder infrastructure for coders for state

[ https://issues.apache.org/jira/browse/BEAM-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1337: Description: Today the user must explicitly provide any coders needed for serializing state data. We'd

[jira] [Assigned] (BEAM-351) Add DisplayData to KafkaIO

[ https://issues.apache.org/jira/browse/BEAM-351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-351: -- Assignee: Aviem Zur > Add DisplayData to KafkaIO > -- > > Key:

[jira] [Assigned] (BEAM-774) Implement Metrics support for Spark runner

[ https://issues.apache.org/jira/browse/BEAM-774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-774: -- Assignee: Aviem Zur (was: Amit Sela) > Implement Metrics support for Spark runner >

[jira] [Commented] (BEAM-775) Remove Aggregators from the Java SDK

[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935104#comment-15935104 ] Aviem Zur commented on BEAM-775: Apex runner does not support metrics either. > Remove Aggregators from the

[jira] [Comment Edited] (BEAM-1802) Spark Runner does not shutdown correctly when executing multiple pipelines in sequence

[ https://issues.apache.org/jira/browse/BEAM-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15940346#comment-15940346 ] Aviem Zur edited comment on BEAM-1802 at 3/24/17 1:37 PM: -- [~iemejia] Please call

[jira] [Updated] (BEAM-1398) KafkaIO metrics

[ https://issues.apache.org/jira/browse/BEAM-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1398: Description: Add metrics to {{KafkaIO}} using the metrics API. Metrics (Feel free to add more ideas here)

[jira] [Resolved] (BEAM-1617) Add Gauge metric type to Java SDK

[ https://issues.apache.org/jira/browse/BEAM-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1617. - Resolution: Implemented > Add Gauge metric type to Java SDK > - > >

[jira] [Updated] (BEAM-1617) Add Gauge metric type to Java SDK

[ https://issues.apache.org/jira/browse/BEAM-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1617: Fix Version/s: First stable release > Add Gauge metric type to Java SDK > -

[jira] [Resolved] (BEAM-1810) Spark runner combineGlobally uses Kryo serialization

[ https://issues.apache.org/jira/browse/BEAM-1810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1810. - Resolution: Fixed Fix Version/s: First stable release > Spark runner combineGlobally uses Kryo

[jira] [Commented] (BEAM-1805) a new option `asInnerJoin` for CoGroupByKey

[ https://issues.apache.org/jira/browse/BEAM-1805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15942640#comment-15942640 ] Aviem Zur commented on BEAM-1805: - Have you taken a look at

[jira] [Commented] (BEAM-1806) a new option `asLeftOuterJoin` for CoGroupByKey

[ https://issues.apache.org/jira/browse/BEAM-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15942642#comment-15942642 ] Aviem Zur commented on BEAM-1806: - Have you taken a look at

[jira] [Commented] (BEAM-775) Remove Aggregators from the Java SDK

[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937681#comment-15937681 ] Aviem Zur commented on BEAM-775: I think we should consider instead to move on

[jira] [Assigned] (BEAM-463) BoundedHeapCoder should be a StandardCoder and not a CustomCoder

[ https://issues.apache.org/jira/browse/BEAM-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-463: -- Assignee: (was: Aviem Zur) > BoundedHeapCoder should be a StandardCoder and not a CustomCoder >

[jira] [Closed] (BEAM-1075) Sub-task?

[ https://issues.apache.org/jira/browse/BEAM-1075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur closed BEAM-1075. --- > Sub-task? > - > > Key: BEAM-1075 > URL:

[jira] [Resolved] (BEAM-1075) Sub-task?

[ https://issues.apache.org/jira/browse/BEAM-1075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1075. - Resolution: Invalid Fix Version/s: Not applicable > Sub-task? > - > > Key:

[jira] [Updated] (BEAM-1075) Sub-task?

[ https://issues.apache.org/jira/browse/BEAM-1075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1075: Summary: Sub-task? (was: Shuffle the input read-values to get maximum parallelism.) > Sub-task? >

[jira] [Resolved] (BEAM-1792) Spark runner uses its own filtering logic to match metrics

[ https://issues.apache.org/jira/browse/BEAM-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1792. - Resolution: Fixed Fix Version/s: First stable release > Spark runner uses its own filtering logic

[jira] [Updated] (BEAM-1074) Set default-partitioner in SourceRDD.Unbounded.

[ https://issues.apache.org/jira/browse/BEAM-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1074: Description: The SparkRunner uses {{mapWithState}} to read and manage CheckpointMarks, and this stateful

[jira] [Updated] (BEAM-1074) Set default-partitioner in SourceRDD.Unbounded.

[ https://issues.apache.org/jira/browse/BEAM-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1074: Issue Type: Improvement (was: Sub-task) Parent: (was: BEAM-848) > Set default-partitioner in

[jira] [Resolved] (BEAM-1397) Introduce IO metrics

[ https://issues.apache.org/jira/browse/BEAM-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1397. - Resolution: Done Fix Version/s: First stable release > Introduce IO metrics >

[jira] [Updated] (BEAM-848) Shuffle the input read-values to get maximum parallelism.

[ https://issues.apache.org/jira/browse/BEAM-848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-848: --- Summary: Shuffle the input read-values to get maximum parallelism. (was: A better shuffle after reading from

[jira] [Updated] (BEAM-848) A better shuffle after reading from within mapWithState.

[ https://issues.apache.org/jira/browse/BEAM-848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-848: --- Description: It would be wise to shuffle the read values _after_ flatmap to increase parallelism in processing

[jira] [Comment Edited] (BEAM-1840) shaded classes are not getting into the proper package

[ https://issues.apache.org/jira/browse/BEAM-1840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951050#comment-15951050 ] Aviem Zur edited comment on BEAM-1840 at 3/31/17 2:51 PM: -- The relocation rules

[jira] [Commented] (BEAM-1840) shaded classes are not getting into the proper package

[ https://issues.apache.org/jira/browse/BEAM-1840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951050#comment-15951050 ] Aviem Zur commented on BEAM-1840: - The relocation rules are based on the artifact ids, and not the package

[jira] [Updated] (BEAM-1840) shaded classes are not getting into the proper package

[ https://issues.apache.org/jira/browse/BEAM-1840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1840: Affects Version/s: (was: First stable release) > shaded classes are not getting into the proper package

[jira] [Resolved] (BEAM-1074) Set default-partitioner in SourceRDD.Unbounded.

[ https://issues.apache.org/jira/browse/BEAM-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1074. - Resolution: Fixed Fix Version/s: First stable release > Set default-partitioner in

[jira] [Commented] (BEAM-1802) Spark Runner does not shutdown correctly when executing multiple pipelines in sequence

[ https://issues.apache.org/jira/browse/BEAM-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15940346#comment-15940346 ] Aviem Zur commented on BEAM-1802: - [~iemejia] Please call `stop()` after calling `waitUntilFinish()` it

[jira] [Assigned] (BEAM-1276) StateSpecs.combiningValue interface is very awkward to use

[ https://issues.apache.org/jira/browse/BEAM-1276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1276: --- Assignee: (was: Aviem Zur) > StateSpecs.combiningValue interface is very awkward to use >

[jira] [Assigned] (BEAM-1706) Ban Guava as a transitive dependency

[ https://issues.apache.org/jira/browse/BEAM-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1706: --- Assignee: (was: Aviem Zur) > Ban Guava as a transitive dependency >

[jira] [Updated] (BEAM-1706) Ban Guava as a transitive dependency

[ https://issues.apache.org/jira/browse/BEAM-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1706: Description: Leaks of Guava dependencies to users can cause conflicts since provided dependencies may rely

[jira] [Assigned] (BEAM-1075) Shuffle the input read-values to get maximum parallelism.

[ https://issues.apache.org/jira/browse/BEAM-1075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1075: --- Assignee: Aviem Zur (was: Amit Sela) > Shuffle the input read-values to get maximum parallelism. >

[jira] [Assigned] (BEAM-1074) Set default-partitioner in SourceRDD.Unbounded.

[ https://issues.apache.org/jira/browse/BEAM-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1074: --- Assignee: Aviem Zur (was: Amit Sela) > Set default-partitioner in SourceRDD.Unbounded. >

[jira] [Commented] (BEAM-1765) Remove Aggregators from Spark runner

[ https://issues.apache.org/jira/browse/BEAM-1765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934063#comment-15934063 ] Aviem Zur commented on BEAM-1765: - How can this be removed from the runners independently from Java SDK?

[jira] [Comment Edited] (BEAM-1765) Remove Aggregators from Spark runner

[ https://issues.apache.org/jira/browse/BEAM-1765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934063#comment-15934063 ] Aviem Zur edited comment on BEAM-1765 at 3/21/17 4:04 AM: -- Awesome to hear we are

[jira] [Comment Edited] (BEAM-1765) Remove Aggregators from Spark runner

[ https://issues.apache.org/jira/browse/BEAM-1765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934063#comment-15934063 ] Aviem Zur edited comment on BEAM-1765 at 3/21/17 4:57 AM: -- Awesome to see we are

[jira] [Resolved] (BEAM-1652) Add code style xml to the website

[ https://issues.apache.org/jira/browse/BEAM-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1652. - Resolution: Done Fix Version/s: Not applicable > Add code style xml to the website >

[jira] [Created] (BEAM-1720) Consider minimization on shaded jars

Aviem Zur created BEAM-1720: --- Summary: Consider minimization on shaded jars Key: BEAM-1720 URL: https://issues.apache.org/jira/browse/BEAM-1720 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-1650) Add code style xml to the project repo and website

[ https://issues.apache.org/jira/browse/BEAM-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1650. - Resolution: Fixed Fix Version/s: Not applicable > Add code style xml to the project repo and

[jira] [Updated] (BEAM-1581) JSON sources and sinks

[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1581: Description: JSON source and sink to read/write JSON files. Similarly to {{XmlSource}}/{{XmlSink}}, these be

  1   2   3   4   >