[jira] [Updated] (BEAM-1581) JSON sources and sinks

2017-03-15 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1581: Summary: JSON sources and sinks (was: JsonIO) > JSON sources and sinks > -- > >

[jira] [Assigned] (BEAM-1757) Improve log configuration when using multiple logging frameworks in Pipeline

2017-03-20 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1757: --- Assignee: Aviem Zur > Improve log configuration when using multiple logging frameworks in Pipeline >

[jira] [Assigned] (BEAM-1726) TestFlinkRunner should assert PAssert success/failure counters

2017-03-17 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1726: --- Assignee: Aviem Zur (was: Aljoscha Krettek) > TestFlinkRunner should assert PAssert success/failure

[jira] [Commented] (BEAM-775) Remove Aggregators from the Java SDK

2017-03-21 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934683#comment-15934683 ] Aviem Zur commented on BEAM-775: Awesome to see we are moving forward with the removal of aggregators.

[jira] [Comment Edited] (BEAM-775) Remove Aggregators from the Java SDK

2017-03-21 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935726#comment-15935726 ] Aviem Zur edited comment on BEAM-775 at 3/22/17 3:46 AM: - As [~aljoscha] mentioned

[jira] [Commented] (BEAM-775) Remove Aggregators from the Java SDK

2017-03-21 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935726#comment-15935726 ] Aviem Zur commented on BEAM-775: As [~aljoscha] mentioned we are adding this assertion to Flink runner as

[jira] [Commented] (BEAM-1581) JSON sources and sinks

2017-03-15 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926687#comment-15926687 ] Aviem Zur commented on BEAM-1581: - I think we should avoid exposing a contract to the user which promises

[jira] [Comment Edited] (BEAM-1581) JSON sources and sinks

2017-03-15 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926687#comment-15926687 ] Aviem Zur edited comment on BEAM-1581 at 3/15/17 6:16 PM: -- I think we should avoid

[jira] [Resolved] (BEAM-1704) Create.TimestampedValues should take a TypeDescriptor as an alternative to explicitly specifying the Coder

2017-03-15 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1704. - Resolution: Done > Create.TimestampedValues should take a TypeDescriptor as an alternative to >

[jira] [Comment Edited] (BEAM-1581) JSON sources and sinks

2017-03-15 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926687#comment-15926687 ] Aviem Zur edited comment on BEAM-1581 at 3/15/17 6:18 PM: -- I think we should avoid

[jira] [Comment Edited] (BEAM-1581) JSON sources and sinks

2017-03-15 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926687#comment-15926687 ] Aviem Zur edited comment on BEAM-1581 at 3/15/17 6:24 PM: -- I think we should avoid

[jira] [Comment Edited] (BEAM-1581) JSON sources and sinks

2017-03-15 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926687#comment-15926687 ] Aviem Zur edited comment on BEAM-1581 at 3/15/17 6:24 PM: -- I think we should avoid

[jira] [Updated] (BEAM-1581) JSON source and sink

2017-03-15 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1581: Summary: JSON source and sink (was: JSON sources and sinks) > JSON source and sink > >

[jira] [Updated] (BEAM-1704) Create.TimestampedValues should take a TypeDescriptor as an alternative to explicitly specifying the Coder

2017-03-15 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1704: Fix Version/s: First stable release > Create.TimestampedValues should take a TypeDescriptor as an

[jira] [Comment Edited] (BEAM-1581) JSON sources and sinks

2017-03-15 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926687#comment-15926687 ] Aviem Zur edited comment on BEAM-1581 at 3/15/17 6:19 PM: -- I think we should avoid

[jira] [Comment Edited] (BEAM-1581) JSON sources and sinks

2017-03-15 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926687#comment-15926687 ] Aviem Zur edited comment on BEAM-1581 at 3/15/17 6:26 PM: -- I think we should avoid

[jira] [Comment Edited] (BEAM-1581) JSON sources and sinks

2017-03-15 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926687#comment-15926687 ] Aviem Zur edited comment on BEAM-1581 at 3/15/17 6:32 PM: -- I think we should avoid

[jira] [Created] (BEAM-1726) TestFlinkRunner should assert PAssert success/failure counters

2017-03-15 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1726: --- Summary: TestFlinkRunner should assert PAssert success/failure counters Key: BEAM-1726 URL: https://issues.apache.org/jira/browse/BEAM-1726 Project: Beam Issue Type:

[jira] [Updated] (BEAM-1726) TestFlinkRunner should assert PAssert success/failure counters

2017-03-15 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1726: Description: {{TestFlinkRunner}} should assert the value of {{PAssert}}'s success/failure aggregators. i.e.

[jira] [Assigned] (BEAM-1482) Support SetState in Spark runner

2017-04-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1482: --- Assignee: Aviem Zur > Support SetState in Spark runner > > >

[jira] [Assigned] (BEAM-1477) Support MapState in Spark runner

2017-04-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1477: --- Assignee: Aviem Zur > Support MapState in Spark runner > > >

[jira] [Assigned] (BEAM-1035) Support for new State API in SparkRunner

2017-04-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1035: --- Assignee: Aviem Zur (was: Amit Sela) > Support for new State API in SparkRunner >

[jira] [Assigned] (BEAM-1692) Convert to Codahale Metric interfaces where possible in WithMetricsSupport MetricRegistry

2017-04-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1692: --- Assignee: (was: Aviem Zur) > Convert to Codahale Metric interfaces where possible in

[jira] [Commented] (BEAM-848) Shuffle input read-values to get maximum parallelism.

2017-04-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953748#comment-15953748 ] Aviem Zur commented on BEAM-848: Now that BEAM-1074 is resolved a user can improve parallelism simply by

[jira] [Updated] (BEAM-1581) JSON source and sink

2017-04-01 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1581: Description: JSON source and sink to read/write JSON files. Similarly to {{XmlSource}}/{{XmlSink}}, these be

[jira] [Updated] (BEAM-1581) JSON source and sink

2017-04-01 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1581: Description: JSON source and sink to read/write JSON files. Similarly to {{XmlSource}}/{{XmlSink}}, these be

[jira] [Updated] (BEAM-1581) JSON source and sink

2017-04-01 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1581: Description: JSON source and sink to read/write JSON files. Similarly to {{XmlSource}}/{{XmlSink}}, these be

[jira] [Assigned] (BEAM-1858) improve error message when Create.of() is called with an empty iterator

2017-04-01 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1858: --- Assignee: Davor Bonaci (was: Frances Perry) > improve error message when Create.of() is called with

[jira] [Updated] (BEAM-1858) improve error message when Create.of() is called with an empty iterator

2017-04-01 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1858: Priority: Trivial (was: Major) > improve error message when Create.of() is called with an empty iterator >

[jira] [Updated] (BEAM-1858) improve error message when Create.of() is called with an empty iterator

2017-04-01 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1858: Component/s: (was: beam-model) sdk-java-core > improve error message when Create.of()

[jira] [Updated] (BEAM-1581) JSON source and sink

2017-04-01 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1581: Description: JSON source and sink to read/write JSON files. Similarly to {{XmlSource}}/{{XmlSink}}, these be

[jira] [Assigned] (BEAM-1603) Enable programmatic execution of spark pipelines.

2017-04-01 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1603: --- Assignee: (was: Aviem Zur) > Enable programmatic execution of spark pipelines. >

[jira] [Resolved] (BEAM-1337) Use our coder infrastructure for coders for state

2017-04-01 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1337. - Resolution: Fixed Fix Version/s: First stable release > Use our coder infrastructure for coders for

[jira] [Assigned] (BEAM-1726) TestFlinkRunner should assert PAssert success/failure counters

2017-04-12 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1726: --- Assignee: Aljoscha Krettek (was: Aviem Zur) > TestFlinkRunner should assert PAssert success/failure

[jira] [Assigned] (BEAM-1950) Access to static field shouldn't be protected by lock on non-static MicrobatchSource.this

2017-04-12 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1950: --- Assignee: Aviem Zur (was: Amit Sela) > Access to static field shouldn't be protected by lock on

[jira] [Commented] (BEAM-1950) Access to static field shouldn't be protected by lock on non-static MicrobatchSource.this

2017-04-12 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966246#comment-15966246 ] Aviem Zur commented on BEAM-1950: - Yes. {{initReaderCache}} should be marked static. > Access to static

[jira] [Assigned] (BEAM-1336) A StateSpec that doesn't care about the key shouldn't be forced to declare it as type Object

2017-04-07 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1336: --- Assignee: (was: Aviem Zur) > A StateSpec that doesn't care about the key shouldn't be forced to

[jira] [Resolved] (BEAM-1294) Long running UnboundedSource Readers

2017-04-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1294. - Resolution: Implemented Fix Version/s: First stable release > Long running UnboundedSource Readers

[jira] [Created] (BEAM-1957) Missing DoFn annotations documentation

2017-04-12 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1957: --- Summary: Missing DoFn annotations documentation Key: BEAM-1957 URL: https://issues.apache.org/jira/browse/BEAM-1957 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-1958) Standard IO Metrics in Java SDK

2017-04-12 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1958: --- Summary: Standard IO Metrics in Java SDK Key: BEAM-1958 URL: https://issues.apache.org/jira/browse/BEAM-1958 Project: Beam Issue Type: Sub-task Components:

[jira] [Created] (BEAM-1959) Standard IO Metrics in Python SDK

2017-04-12 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1959: --- Summary: Standard IO Metrics in Python SDK Key: BEAM-1959 URL: https://issues.apache.org/jira/browse/BEAM-1959 Project: Beam Issue Type: Sub-task

[jira] [Resolved] (BEAM-1950) Access to static field shouldn't be protected by lock on non-static MicrobatchSource.this

2017-04-12 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1950. - Resolution: Fixed Fix Version/s: First stable release > Access to static field shouldn't be

[jira] [Updated] (BEAM-1950) Access to static field shouldn't be protected by lock on non-static MicrobatchSource.this

2017-04-12 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1950: Fix Version/s: (was: First stable release) > Access to static field shouldn't be protected by lock on

[jira] [Created] (BEAM-2038) PTransform identifier(name) documentation in Python SDK.

2017-04-20 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-2038: --- Summary: PTransform identifier(name) documentation in Python SDK. Key: BEAM-2038 URL: https://issues.apache.org/jira/browse/BEAM-2038 Project: Beam Issue Type:

[jira] [Updated] (BEAM-2038) PTransform identifier(name) documentation in Python SDK.

2017-04-20 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2038: Description: PTransform identifier(name) documentation in Python SDK. Specifically address this in in

[jira] [Created] (BEAM-2037) PTransform identifier(name) documentation in Java SDK.

2017-04-20 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-2037: --- Summary: PTransform identifier(name) documentation in Java SDK. Key: BEAM-2037 URL: https://issues.apache.org/jira/browse/BEAM-2037 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-2036) PTransform identifier(name) documentation in website.

2017-04-20 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-2036: --- Summary: PTransform identifier(name) documentation in website. Key: BEAM-2036 URL: https://issues.apache.org/jira/browse/BEAM-2036 Project: Beam Issue Type: Sub-task

[jira] [Updated] (BEAM-2036) PTransform identifier(name) documentation in website.

2017-04-20 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2036: Description: PTransform identifier(name) documentation in the website. Section 'Applying transforms' -

[jira] [Assigned] (BEAM-1581) JSON source and sink

2017-04-21 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1581: --- Assignee: (was: Aviem Zur) > JSON source and sink > > > Key:

[jira] [Updated] (BEAM-2035) PTransform application identifier(name) documentation.

2017-04-21 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2035: Description: Add documentation around the user supplied/automatically created identifier (name) of the

[jira] [Updated] (BEAM-2038) PTransform identifier(name) documentation in Python SDK.

2017-04-21 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2038: Description: Add PTransform identifier(name) documentation in Python SDK. Specifically address this in in

[jira] [Updated] (BEAM-2037) PTransform identifier(name) documentation in Java SDK.

2017-04-21 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2037: Description: Add/improve PTransform identifier(name) documentation in Java SDK. Specifically address this

[jira] [Updated] (BEAM-2038) PTransform identifier(name) documentation in Python SDK.

2017-04-21 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2038: Description: Add/improve PTransform identifier(name) documentation in Python SDK. Specifically address this

[jira] [Updated] (BEAM-2038) PTransform identifier(name) documentation in Python SDK.

2017-04-21 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2038: Description: Add PTransform identifier(name) documentation in Python SDK. Specifically address this in in

[jira] [Updated] (BEAM-2036) PTransform identifier(name) documentation in website.

2017-04-21 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2036: Description: Add PTransform identifier(name) documentation to the website. Section 'Applying transforms' -

[jira] [Updated] (BEAM-2037) PTransform identifier(name) documentation in Java SDK.

2017-04-21 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2037: Description: Add PTransform identifier(name) documentation in Java SDK. Specifically address this in

[jira] [Assigned] (BEAM-1757) Improve log configuration when using multiple logging frameworks in Pipeline

2017-04-14 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1757: --- Assignee: (was: Aviem Zur) > Improve log configuration when using multiple logging frameworks in

[jira] [Created] (BEAM-1975) Documentation around logging in different runners

2017-04-13 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1975: --- Summary: Documentation around logging in different runners Key: BEAM-1975 URL: https://issues.apache.org/jira/browse/BEAM-1975 Project: Beam Issue Type: Sub-task

[jira] [Updated] (BEAM-1975) Documentation around logging in different runners

2017-04-14 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1975: Description: Add documentation on how to configure logging in different runners, relate to SLF4J and

[jira] [Created] (BEAM-1976) Allow only one runner profile active at once in examples and archetypes

2017-04-13 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1976: --- Summary: Allow only one runner profile active at once in examples and archetypes Key: BEAM-1976 URL: https://issues.apache.org/jira/browse/BEAM-1976 Project: Beam

[jira] [Created] (BEAM-1974) Metrics documentation

2017-04-13 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1974: --- Summary: Metrics documentation Key: BEAM-1974 URL: https://issues.apache.org/jira/browse/BEAM-1974 Project: Beam Issue Type: Improvement Components: website

[jira] [Updated] (BEAM-1757) Improve log configuration when using multiple logging frameworks in Pipeline

2017-04-13 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1757: Description: We need to improve / document how to configure the different logging frameworks to support the

[jira] [Assigned] (BEAM-1757) Improve log configuration when using multiple logging frameworks in Pipeline

2017-04-13 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1757: --- Assignee: (was: Aviem Zur) > Improve log configuration when using multiple logging frameworks in

[jira] [Commented] (BEAM-1802) Spark Runner does not shutdown correctly when executing multiple pipelines in sequence

2017-04-14 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969101#comment-15969101 ] Aviem Zur commented on BEAM-1802: - Yes, it is working as designed, there is an inconsistency regarding the

[jira] [Created] (BEAM-1961) Standard IO metrics documentation

2017-04-13 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1961: --- Summary: Standard IO metrics documentation Key: BEAM-1961 URL: https://issues.apache.org/jira/browse/BEAM-1961 Project: Beam Issue Type: Sub-task

[jira] [Commented] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

2017-04-19 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975193#comment-15975193 ] Aviem Zur commented on BEAM-2005: - I'll refine - it should be in a separate module, but I think core should

[jira] [Commented] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

2017-04-19 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975196#comment-15975196 ] Aviem Zur commented on BEAM-2005: - Wouldn't this ticket mean actually implementing

[jira] [Issue Comment Deleted] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

2017-04-19 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2005: Comment: was deleted (was: I'll refine - it should be in a separate module, but I think core should depend

[jira] [Commented] (BEAM-1984) Enable dependency analysis of non-compile dependencies

2017-04-16 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15970425#comment-15970425 ] Aviem Zur commented on BEAM-1984: - Another issue with the blanket {{ignoreNonCompile}} is we could have

[jira] [Updated] (BEAM-1726) Verify PAssert execution in TestFlinkRunner

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1726: Summary: Verify PAssert execution in TestFlinkRunner (was: TestFlinkRunner should assert PAssert

[jira] [Created] (BEAM-2002) Verify PAssert execution in TestSparkRunner

2017-04-18 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-2002: --- Summary: Verify PAssert execution in TestSparkRunner Key: BEAM-2002 URL: https://issues.apache.org/jira/browse/BEAM-2002 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-2003) Verify PAssert execution in TestDataflowRunner

2017-04-18 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-2003: --- Summary: Verify PAssert execution in TestDataflowRunner Key: BEAM-2003 URL: https://issues.apache.org/jira/browse/BEAM-2003 Project: Beam Issue Type: Sub-task

[jira] [Assigned] (BEAM-2002) Verify PAssert execution in TestSparkRunner

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-2002: --- Assignee: Aviem Zur (was: Amit Sela) > Verify PAssert execution in TestSparkRunner >

[jira] [Updated] (BEAM-2001) Verify PAssert execution in all runners

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2001: Description: Currently, {{PAssert}} assertions may not happen and tests will pass while silently hiding

[jira] [Updated] (BEAM-1763) TestPipeline should ensure that all assertions succeeded

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1763: Fix Version/s: (was: First stable release) > TestPipeline should ensure that all assertions succeeded >

[jira] [Assigned] (BEAM-1763) TestPipeline should ensure that all assertions succeeded

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1763: --- Assignee: Aviem Zur > TestPipeline should ensure that all assertions succeeded >

[jira] [Assigned] (BEAM-1591) Implement Combine optimizations for GABW in streaming.

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1591: --- Assignee: Kobi Salant (was: Aviem Zur) > Implement Combine optimizations for GABW in streaming. >

[jira] [Assigned] (BEAM-2004) Verify PAssert execution in TestApexRunner

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-2004: --- Assignee: Thomas Weise > Verify PAssert execution in TestApexRunner >

[jira] [Created] (BEAM-2004) Verify PAssert execution in TestApexRunner

2017-04-18 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-2004: --- Summary: Verify PAssert execution in TestApexRunner Key: BEAM-2004 URL: https://issues.apache.org/jira/browse/BEAM-2004 Project: Beam Issue Type: Sub-task

[jira] [Updated] (BEAM-2002) Verify PAssert execution in TestSparkRunner

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2002: Fix Version/s: First stable release > Verify PAssert execution in TestSparkRunner >

[jira] [Updated] (BEAM-2004) Verify PAssert execution in TestApexRunner

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2004: Fix Version/s: First stable release > Verify PAssert execution in TestApexRunner >

[jira] [Updated] (BEAM-2003) Verify PAssert execution in TestDataflowRunner

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2003: Fix Version/s: First stable release > Verify PAssert execution in TestDataflowRunner >

[jira] [Updated] (BEAM-2001) Verify PAssert execution in all runners

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2001: Description: Currently, {{PAssert}} assertions may not happen and tests will pass while silently hiding

[jira] [Updated] (BEAM-1726) TestFlinkRunner should assert PAssert success/failure counters

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1726: Issue Type: Sub-task (was: Improvement) Parent: BEAM-2001 > TestFlinkRunner should assert PAssert

[jira] [Updated] (BEAM-1726) Verify PAssert execution in TestFlinkRunner

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1726: Description: (was: {{TestFlinkRunner}} should assert the value of {{PAssert}}'s success/failure

[jira] [Updated] (BEAM-1763) TestPipeline should ensure that all assertions succeeded

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1763: Issue Type: Sub-task (was: Improvement) Parent: BEAM-2001 > TestPipeline should ensure that all

[jira] [Updated] (BEAM-1763) TestPipeline should ensure that all assertions succeeded

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1763: Priority: Major (was: Blocker) > TestPipeline should ensure that all assertions succeeded >

[jira] [Updated] (BEAM-1763) TestPipeline should ensure that all assertions succeeded

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1763: Description: This doesn't need to be part of each {{PipelineRunner}} implementation if it goes through the

[jira] [Assigned] (BEAM-2001) Verify PAssert execution in all runners

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-2001: --- Assignee: Aviem Zur (was: Kenneth Knowles) > Verify PAssert execution in all runners >

[jira] [Assigned] (BEAM-2001) Verify PAssert execution in all runners

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-2001: --- Assignee: (was: Aviem Zur) > Verify PAssert execution in all runners >

[jira] [Updated] (BEAM-2001) Verify PAssert execution in all runners

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2001: Fix Version/s: First stable release > Verify PAssert execution in all runners >

[jira] [Commented] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

2017-04-19 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974980#comment-15974980 ] Aviem Zur commented on BEAM-2005: - I think this should be in `core` not in `extensions`. Also, I think this

[jira] [Commented] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

2017-04-19 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976046#comment-15976046 ] Aviem Zur commented on BEAM-2005: - Regarding {{core}} vs {{extensions}}. This can reside in a separate

[jira] [Updated] (BEAM-1763) TestPipeline should ensure that all assertions succeeded

2017-04-19 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1763: Description: This doesn't need to be part of each {{PipelineRunner}} implementation if it goes through the

[jira] [Created] (BEAM-2057) Test metrics are reported to Spark Metrics sink.

2017-04-23 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-2057: --- Summary: Test metrics are reported to Spark Metrics sink. Key: BEAM-2057 URL: https://issues.apache.org/jira/browse/BEAM-2057 Project: Beam Issue Type: Test

[jira] [Assigned] (BEAM-2057) Test metrics are reported to Spark Metrics sink.

2017-04-23 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-2057: --- Assignee: (was: Amit Sela) > Test metrics are reported to Spark Metrics sink. >

[jira] [Updated] (BEAM-2057) Test metrics are reported to Spark Metrics sink.

2017-04-23 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2057: Description: Test that metrics are reported to Spark's metric sink. Use {{InMemoryMetrics}} and

[jira] [Comment Edited] (BEAM-2027) get error sometimes while running the same code using beam0.6

2017-04-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979797#comment-15979797 ] Aviem Zur edited comment on BEAM-2027 at 4/22/17 7:22 AM: -- {{local class

[jira] [Comment Edited] (BEAM-2027) get error sometimes while running the same code using beam0.6

2017-04-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979797#comment-15979797 ] Aviem Zur edited comment on BEAM-2027 at 4/22/17 7:21 AM: -- {{local class

[jira] [Assigned] (BEAM-1919) Standard IO Metrics

2017-04-23 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1919: --- Assignee: (was: Aviem Zur) > Standard IO Metrics > --- > > Key:

<    1   2   3   4   >