[2/7] beam git commit: HadoopInputFormatIO with junits

http://git-wip-us.apache.org/repos/asf/beam/blob/174436bc/sdks/java/io/hadoop/jdk1.8-tests/src/test/java/org/apache/beam/sdk/io/hadoop/inputformat/integration/tests/HIFIOCassandraIT.java -- diff --git

[3/7] beam git commit: HadoopInputFormatIO with junits

http://git-wip-us.apache.org/repos/asf/beam/blob/174436bc/sdks/java/io/hadoop/input-format/src/test/java/org/apache/beam/sdk/io/hadoop/inputformat/HadoopInputFormatIOTest.java -- diff --git

[7/7] beam git commit: This closes #2193

This closes #2193 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/82694fe7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/82694fe7 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/82694fe7 Branch:

[5/7] beam git commit: HadoopInputFormatIO with junits

http://git-wip-us.apache.org/repos/asf/beam/blob/174436bc/sdks/java/io/hadoop-input-format/src/test/java/org/apache/beam/sdk/io/hadoop/inputformat/HadoopInputFormatIOTest.java -- diff --git

[6/7] beam git commit: HadoopInputFormatIO with junits

HadoopInputFormatIO with junits Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/174436bc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/174436bc Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/174436bc Branch:

[1/7] beam git commit: HadoopInputFormatIO with junits

Repository: beam Updated Branches: refs/heads/master 9c284d625 -> 82694fe72 http://git-wip-us.apache.org/repos/asf/beam/blob/174436bc/sdks/java/io/hadoop/jdk1.8-tests/src/test/resources/kubernetes/elasticsearch/LargeProductionCluster/es-services.yaml

[GitHub] beam pull request #2193: Add Elasticsearch and Cassandra tests in HadoopInpu...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2193 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-1700) Add Timer metric type to Java SDK

[ https://issues.apache.org/jira/browse/BEAM-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959042#comment-15959042 ] tarush grover commented on BEAM-1700: - To which branch this issue have to start implementation? > Add

[jira] [Assigned] (BEAM-1714) Null Pointer Exception when outputting a TableRow with a Null value for a key

[ https://issues.apache.org/jira/browse/BEAM-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Shalda reassigned BEAM-1714: - Assignee: Mark Shalda > Null Pointer Exception when outputting a TableRow with a Null value for a

[jira] [Assigned] (BEAM-1852) dead links on beam website

[ https://issues.apache.org/jira/browse/BEAM-1852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk reassigned BEAM-1852: -- Assignee: Stephen Sisk (was: Davor Bonaci) > dead links on beam website >

[jira] [Commented] (BEAM-301) Add a Beam SQL DSL

[ https://issues.apache.org/jira/browse/BEAM-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959139#comment-15959139 ] Julian Hyde commented on BEAM-301: -- {{EMIT}} is just slide-ware at this point. I don't plan to start work

[jira] [Commented] (BEAM-677) Add element modification check to Python Beam

[ https://issues.apache.org/jira/browse/BEAM-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959288#comment-15959288 ] Ahmet Altay commented on BEAM-677: -- [~robertwb] Is this a duplicate of [BEAM-529]? > Add element

[jira] [Closed] (BEAM-1160) Disabling Read transform validation cause empty file patterns to unexpected succeed

[ https://issues.apache.org/jira/browse/BEAM-1160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1160. - Resolution: Fixed Fix Version/s: Not applicable These jobs will now fail in the Beam SDK

[jira] [Updated] (BEAM-1318) PipelineOptions should warn if there are unused options

[ https://issues.apache.org/jira/browse/BEAM-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-1318: -- Labels: newbie starter (was: ) > PipelineOptions should warn if there are unused options >

[jira] [Assigned] (BEAM-842) dependency.py: package not found when running on Windows

[ https://issues.apache.org/jira/browse/BEAM-842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-842: Assignee: (was: Ahmet Altay) > dependency.py: package not found when running on Windows >

[jira] [Commented] (BEAM-1896) Add list of In Progress IOs to the Pipeline I/O section of the website

[ https://issues.apache.org/jira/browse/BEAM-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959062#comment-15959062 ] ASF GitHub Bot commented on BEAM-1896: -- GitHub user ssisk opened a pull request:

[GitHub] beam-site pull request #203: [BEAM-1852] Fix ICLA link

GitHub user ssisk opened a pull request: https://github.com/apache/beam-site/pull/203 [BEAM-1852] Fix ICLA link The link at https://www.apache.org/licenses/ under "CONTRIBUTOR LICENSE AGREEMENTS" now links to the pdf version, and this commit changed the link in core beam:

[jira] [Assigned] (BEAM-497) Modify offset range tracker to use first response as start offset

[ https://issues.apache.org/jira/browse/BEAM-497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-497: Assignee: (was: Chamikara Jayalath) > Modify offset range tracker to use first response as start

[jira] [Updated] (BEAM-497) Modify offset range tracker to use first response as start offset

[ https://issues.apache.org/jira/browse/BEAM-497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-497: - Labels: newbie starter (was: ) > Modify offset range tracker to use first response as start offset >

[jira] [Assigned] (BEAM-663) AvroSource should update progress within blocks

[ https://issues.apache.org/jira/browse/BEAM-663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-663: Assignee: (was: Chamikara Jayalath) > AvroSource should update progress within blocks >

[jira] [Commented] (BEAM-301) Add a Beam SQL DSL

[ https://issues.apache.org/jira/browse/BEAM-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959283#comment-15959283 ] Xu Mingmin commented on BEAM-301: - Regarding of {{STREAM}} keyword, it's determined by the type of source,

[jira] [Commented] (BEAM-618) Python SDKs writes non RFC compliant JSON files for BQ Export

[ https://issues.apache.org/jira/browse/BEAM-618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959280#comment-15959280 ] Ahmet Altay commented on BEAM-618: -- [~ajam...@google.com] is this fixed? > Python SDKs writes non RFC

[jira] [Commented] (BEAM-115) Beam Runner API

[ https://issues.apache.org/jira/browse/BEAM-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959305#comment-15959305 ] ASF GitHub Bot commented on BEAM-115: - GitHub user kennknowles opened a pull request:

[jira] [Updated] (BEAM-1080) python sdk apiclient needs proper unit tests

[ https://issues.apache.org/jira/browse/BEAM-1080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-1080: -- Labels: newbie starter (was: ) > python sdk apiclient needs proper unit tests >

[jira] [Commented] (BEAM-1852) dead links on beam website

[ https://issues.apache.org/jira/browse/BEAM-1852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959085#comment-15959085 ] ASF GitHub Bot commented on BEAM-1852: -- GitHub user ssisk opened a pull request:

[jira] [Commented] (BEAM-539) Error when writing to the root of a GCS location

[ https://issues.apache.org/jira/browse/BEAM-539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959260#comment-15959260 ] Ahmet Altay commented on BEAM-539: -- Any updates here? Should we unassign and make it a starter issue? >

[jira] [Commented] (BEAM-1900) create feature branch 'dsls_sql' for Beam SQL

[ https://issues.apache.org/jira/browse/BEAM-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959309#comment-15959309 ] Jean-Baptiste Onofré commented on BEAM-1900: Yes, I'm preparing it as discussed. > create

[jira] [Updated] (BEAM-1070) Service Account Based Authentication Broken

[ https://issues.apache.org/jira/browse/BEAM-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-1070: -- Priority: Minor (was: Critical) > Service Account Based Authentication Broken >

[jira] [Updated] (BEAM-1359) Move most of python sdk README.md to website

[ https://issues.apache.org/jira/browse/BEAM-1359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-1359: -- Summary: Move most of python sdk README.md to website (was: Remove python sdk README.md) > Move most

[jira] [Commented] (BEAM-1373) Update Python SDK code to support both Python 2 and 3

[ https://issues.apache.org/jira/browse/BEAM-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959346#comment-15959346 ] Ahmet Altay commented on BEAM-1373: --- [~chamikara] Is this a duplicate of [BEAM-1251]? > Update Python

[GitHub] beam-site pull request #202: [BEAM-1896] Add "In-Progress" info to the Built...

GitHub user ssisk opened a pull request: https://github.com/apache/beam-site/pull/202 [BEAM-1896] Add "In-Progress" info to the Built-in I/O Transforms page Also added the Apache Hadoop InputFormat to the existing transforms list. cc @melap You can merge this pull request

[jira] [Updated] (BEAM-497) Modify offset range tracker to use first response as start offset

[ https://issues.apache.org/jira/browse/BEAM-497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-497: - Issue Type: Improvement (was: Bug) > Modify offset range tracker to use first response as start offset >

[jira] [Updated] (BEAM-518) More sophisticated assert matchers

[ https://issues.apache.org/jira/browse/BEAM-518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-518: - Labels: newbie starter (was: starter) > More sophisticated assert matchers >

[jira] [Commented] (BEAM-662) SlidingWindows should support sub-second periods

[ https://issues.apache.org/jira/browse/BEAM-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959279#comment-15959279 ] Ahmet Altay commented on BEAM-662: -- [~charleschen] could you take a look at this? This will be a breaking

[jira] [Commented] (BEAM-817) Fill in the learn/sdks/python portion of the website

[ https://issues.apache.org/jira/browse/BEAM-817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959296#comment-15959296 ] Ahmet Altay commented on BEAM-817: -- This is done: https://beam.apache.org/documentation/sdks/python/ >

[jira] [Resolved] (BEAM-817) Fill in the learn/sdks/python portion of the website

[ https://issues.apache.org/jira/browse/BEAM-817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-817. -- Resolution: Fixed Fix Version/s: Not applicable > Fill in the learn/sdks/python portion of the

[jira] [Resolved] (BEAM-1319) PipelineOptions subclasses defined in the main session could be duplicated

[ https://issues.apache.org/jira/browse/BEAM-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-1319. --- Resolution: Fixed Assignee: Ahmet Altay Fix Version/s: Not applicable >

[jira] [Commented] (BEAM-819) The DirectRunner can complete before reporting the results of all ModelEnforcements

[ https://issues.apache.org/jira/browse/BEAM-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959239#comment-15959239 ] Thomas Groh commented on BEAM-819: -- I believe so. The fix probably consists of draining the active

[jira] [Updated] (BEAM-529) Check immutability violations in DirectPipelineRunner

[ https://issues.apache.org/jira/browse/BEAM-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-529: - Labels: newbie starter (was: ) > Check immutability violations in DirectPipelineRunner >

[jira] [Resolved] (BEAM-1881) Exclude protobuf-lite everywhere

[ https://issues.apache.org/jira/browse/BEAM-1881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1881. --- Resolution: Fixed Fix Version/s: (was: First stable release) Not

[jira] [Updated] (BEAM-662) SlidingWindows should support sub-second periods

[ https://issues.apache.org/jira/browse/BEAM-662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-662: - Fix Version/s: First stable release > SlidingWindows should support sub-second periods >

[jira] [Created] (BEAM-1900) create feature branch 'dsls_sql' for Beam SQL

Xu Mingmin created BEAM-1900: Summary: create feature branch 'dsls_sql' for Beam SQL Key: BEAM-1900 URL: https://issues.apache.org/jira/browse/BEAM-1900 Project: Beam Issue Type: Task

[jira] [Assigned] (BEAM-562) DoFn Reuse: Add new methods to DoFn

[ https://issues.apache.org/jira/browse/BEAM-562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-562: Assignee: (was: Ahmet Altay) > DoFn Reuse: Add new methods to DoFn >

[jira] [Closed] (BEAM-1290) Consider rehtrowing the original exception from the waitUntilFinish

[ https://issues.apache.org/jira/browse/BEAM-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay closed BEAM-1290. - Resolution: Incomplete Fix Version/s: Not applicable There is a larger design discussion about

[GitHub] beam pull request #2453: Remove DirectSideInputReader, PTuple

GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2453 Remove DirectSideInputReader, PTuple Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[jira] [Commented] (BEAM-1363) Python SDK should be fully integrated with Maven

[ https://issues.apache.org/jira/browse/BEAM-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959334#comment-15959334 ] Ahmet Altay commented on BEAM-1363: --- Status of this so far: - We can use Maven to build and release

[jira] [Commented] (BEAM-1364) Update Jenkins to provide granular signals for python sdk

[ https://issues.apache.org/jira/browse/BEAM-1364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959339#comment-15959339 ] Ahmet Altay commented on BEAM-1364: --- Hey [~jasonkuster] do you have another issues tracking this (e.g.

[jira] [Updated] (BEAM-629) Cleanup SDK regardign lint warnings (and lint warning suppression).

[ https://issues.apache.org/jira/browse/BEAM-629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-629: - Labels: newbie starter (was: ) > Cleanup SDK regardign lint warnings (and lint warning suppression). >

[jira] [Assigned] (BEAM-563) DoFn Reuse: Update DirectRunner

[ https://issues.apache.org/jira/browse/BEAM-563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-563: Assignee: (was: Ahmet Altay) > DoFn Reuse: Update DirectRunner > ---

[jira] [Assigned] (BEAM-681) DoFns should be serialized at apply time and deserialized when executing

[ https://issues.apache.org/jira/browse/BEAM-681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-681: Assignee: (was: Frances Perry) > DoFns should be serialized at apply time and deserialized when

[jira] [Assigned] (BEAM-677) Add element modification check to Python Beam

[ https://issues.apache.org/jira/browse/BEAM-677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-677: Assignee: (was: Frances Perry) > Add element modification check to Python Beam >

[jira] [Assigned] (BEAM-1080) python sdk apiclient needs proper unit tests

[ https://issues.apache.org/jira/browse/BEAM-1080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-1080: - Assignee: (was: Frances Perry) > python sdk apiclient needs proper unit tests >

[jira] [Commented] (BEAM-1179) Update assertions of source_test_utils from camelcase to underscore-separated

[ https://issues.apache.org/jira/browse/BEAM-1179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959318#comment-15959318 ] Ahmet Altay commented on BEAM-1179: --- Updated link:

[jira] [Updated] (BEAM-1179) Update assertions of source_test_utils from camelcase to underscore-separated

[ https://issues.apache.org/jira/browse/BEAM-1179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-1179: -- Fix Version/s: First stable release > Update assertions of source_test_utils from camelcase to

[jira] [Assigned] (BEAM-1364) Update Jenkins to provide granular signals for python sdk

[ https://issues.apache.org/jira/browse/BEAM-1364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-1364: - Assignee: (was: Ahmet Altay) > Update Jenkins to provide granular signals for python sdk >

[jira] [Commented] (BEAM-842) dependency.py: package not found when running on Windows

[ https://issues.apache.org/jira/browse/BEAM-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959355#comment-15959355 ] Ahmet Altay commented on BEAM-842: -- [~matthiasa4] Are you still able to reproduce this? If yes, could you

[jira] [Assigned] (BEAM-588) All runners should support ProfilingOptions

[ https://issues.apache.org/jira/browse/BEAM-588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-588: Assignee: (was: Ahmet Altay) > All runners should support ProfilingOptions >

[2/2] beam git commit: [BEAM-1856] This closes #2399

[BEAM-1856] This closes #2399 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f87597e1 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f87597e1 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f87597e1 Branch:

[jira] [Commented] (BEAM-1723) FlinkRunner should deduplicate when an UnboundedSource requires Deduping

[ https://issues.apache.org/jira/browse/BEAM-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959226#comment-15959226 ] Jingsong Lee commented on BEAM-1723: I see {{CachedIdDeduplicator}} in direct runner. It use

[jira] [Assigned] (BEAM-1723) FlinkRunner should deduplicate when an UnboundedSource requires Deduping

[ https://issues.apache.org/jira/browse/BEAM-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee reassigned BEAM-1723: -- Assignee: Jingsong Lee > FlinkRunner should deduplicate when an UnboundedSource requires

[jira] [Assigned] (BEAM-662) SlidingWindows should support sub-second periods

[ https://issues.apache.org/jira/browse/BEAM-662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-662: Assignee: (was: Frances Perry) > SlidingWindows should support sub-second periods >

[jira] [Updated] (BEAM-963) runtime_type_check issues

[ https://issues.apache.org/jira/browse/BEAM-963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-963: - Labels: newbie starter (was: ) > runtime_type_check issues > - > >

[jira] [Commented] (BEAM-526) Mismatched pipelines give unclear error

[ https://issues.apache.org/jira/browse/BEAM-526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959374#comment-15959374 ] Ahmet Altay commented on BEAM-526: -- Any update on this one? > Mismatched pipelines give unclear error >

[jira] [Commented] (BEAM-1575) Add ValidatesRunner test to PipelineTest.test_metrics_in_source

[ https://issues.apache.org/jira/browse/BEAM-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959427#comment-15959427 ] Pablo Estrada commented on BEAM-1575: - I have not made any progress, because it seems like there's no

Build failed in Jenkins: beam_PerformanceTests_Dataflow #276

See Changes: [davor] HadoopInputFormatIO with junits [jbonofre] [BEAM-1856] Use the same configuration in master thread and slave thread -- [...truncated

[jira] [Updated] (BEAM-588) All runners should support ProfilingOptions

[ https://issues.apache.org/jira/browse/BEAM-588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-588: - Labels: newbie starter (was: ) > All runners should support ProfilingOptions >

[1/2] beam git commit: [BEAM-1856] Use the same configuration in master thread and slave thread in the HDFSFileSink

Repository: beam Updated Branches: refs/heads/master 82694fe72 -> f87597e10 [BEAM-1856] Use the same configuration in master thread and slave thread in the HDFSFileSink Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[jira] [Commented] (BEAM-1856) HDFSFileSink class do not use the same configuration in master and slave

[ https://issues.apache.org/jira/browse/BEAM-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959361#comment-15959361 ] ASF GitHub Bot commented on BEAM-1856: -- Github user asfgit closed the pull request at:

[jira] [Resolved] (BEAM-1856) HDFSFileSink class do not use the same configuration in master and slave

[ https://issues.apache.org/jira/browse/BEAM-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-1856. Resolution: Fixed Fix Version/s: First stable release > HDFSFileSink class do

[GitHub] beam pull request #2399: [BEAM-1856]HDFSFileSink class do not use the same c...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2399 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-588) All runners should support ProfilingOptions

[ https://issues.apache.org/jira/browse/BEAM-588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959360#comment-15959360 ] Ahmet Altay commented on BEAM-588: -- Status: - DataflowRunner supports cpu and memory profiling. -

[1/2] beam git commit: [BEAM-1892] File size estimation process reporting

Repository: beam Updated Branches: refs/heads/master f87597e10 -> 37e4cc1b8 [BEAM-1892] File size estimation process reporting Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/378b3f5b Tree:

[GitHub] beam pull request #2445: [BEAM-1892] File size estimation thresholding and p...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2445 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Assigned] (BEAM-1509) Python sdk pom runs only on unix

[ https://issues.apache.org/jira/browse/BEAM-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-1509: - Assignee: (was: Ahmet Altay) > Python sdk pom runs only on unix >

[jira] [Updated] (BEAM-1506) py DataflowRunner should warn if the stagingLocation has a TTL

[ https://issues.apache.org/jira/browse/BEAM-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-1506: -- Labels: newbie starter (was: ) > py DataflowRunner should warn if the stagingLocation has a TTL >

[jira] [Assigned] (BEAM-1506) py DataflowRunner should warn if the stagingLocation has a TTL

[ https://issues.apache.org/jira/browse/BEAM-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-1506: - Assignee: (was: Ahmet Altay) > py DataflowRunner should warn if the stagingLocation has a TTL

[jira] [Commented] (BEAM-1575) Add ValidatesRunner test to PipelineTest.test_metrics_in_source

[ https://issues.apache.org/jira/browse/BEAM-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959375#comment-15959375 ] Ahmet Altay commented on BEAM-1575: --- [~pabloem] Any progress on this one? > Add ValidatesRunner test to

[jira] [Commented] (BEAM-1723) FlinkRunner should deduplicate when an UnboundedSource requires Deduping

[ https://issues.apache.org/jira/browse/BEAM-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959390#comment-15959390 ] Kenneth Knowles commented on BEAM-1723: --- The caches do need to be fault-tolerant or you'll get dupes.

[jira] [Commented] (BEAM-526) Mismatched pipelines give unclear error

[ https://issues.apache.org/jira/browse/BEAM-526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959461#comment-15959461 ] Ahmet Altay commented on BEAM-526: -- [~nssalian] Thank you, that is great. > Mismatched pipelines give

[2/2] beam git commit: This closes #2445

This closes #2445 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/37e4cc1b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/37e4cc1b Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/37e4cc1b Branch:

[jira] [Updated] (BEAM-1462) DirectRunner unnecessarily re-scheules tasks after exceptions

[ https://issues.apache.org/jira/browse/BEAM-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-1462: -- Labels: newbie starter (was: ) > DirectRunner unnecessarily re-scheules tasks after exceptions >

[jira] [Assigned] (BEAM-1472) Use cross-language serialization schema for triggers in Python SDK

[ https://issues.apache.org/jira/browse/BEAM-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-1472: - Assignee: Robert Bradshaw (was: Vikas Kedigehalli) > Use cross-language serialization schema for

[jira] [Resolved] (BEAM-1368) Python setup should be portable to Python 3.x

[ https://issues.apache.org/jira/browse/BEAM-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-1368. --- Resolution: Fixed Assignee: (was: Ahmet Altay) Fix Version/s: Not applicable >

[jira] [Assigned] (BEAM-1368) Python setup should be portable to Python 3.x

[ https://issues.apache.org/jira/browse/BEAM-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-1368: - Assignee: Sergio Fernández > Python setup should be portable to Python 3.x >

[jira] [Commented] (BEAM-1373) Update Python SDK code to support both Python 2 and 3

[ https://issues.apache.org/jira/browse/BEAM-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959462#comment-15959462 ] Chamikara Jayalath commented on BEAM-1373: -- We'll have to run 2to3 but without porting

[jira] [Assigned] (BEAM-1373) Update Python SDK code to support both Python 2 and 3

[ https://issues.apache.org/jira/browse/BEAM-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reassigned BEAM-1373: Assignee: Ahmet Altay (was: Chamikara Jayalath) > Update Python SDK code to

[jira] [Commented] (BEAM-115) Beam Runner API

[ https://issues.apache.org/jira/browse/BEAM-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959537#comment-15959537 ] ASF GitHub Bot commented on BEAM-115: - Github user asfgit closed the pull request at:

[jira] [Commented] (BEAM-301) Add a Beam SQL DSL

[ https://issues.apache.org/jira/browse/BEAM-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959621#comment-15959621 ] Tyler Akidau commented on BEAM-301: --- I agree with what I think Mingmin is saying here in that it's

[jira] [Commented] (BEAM-1832) Potentially unclosed OutputStream in ApexYarnLauncher

[ https://issues.apache.org/jira/browse/BEAM-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959529#comment-15959529 ] ASF GitHub Bot commented on BEAM-1832: -- GitHub user rekhajoshm opened a pull request:

[jira] [Resolved] (BEAM-1892) Log process during size estimation in filebasedsource

[ https://issues.apache.org/jira/browse/BEAM-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sourabh Bajaj resolved BEAM-1892. - Resolution: Fixed Fix Version/s: Not applicable > Log process during size estimation in

[2/2] beam git commit: This closes #2452: Rename FunctionSpec and UrnWithParameter to their (hopefully) final names

This closes #2452: Rename FunctionSpec and UrnWithParameter to their (hopefully) final names Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0a176454 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0a176454 Diff:

[1/2] beam git commit: Rename FunctionSpec and UrnWithParameter to their (hopefully) final names

Repository: beam Updated Branches: refs/heads/master 37e4cc1b8 -> 0a176454c Rename FunctionSpec and UrnWithParameter to their (hopefully) final names Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fa47527e Tree:

[GitHub] beam pull request #2452: [BEAM-115] Rename FunctionSpec and UrnWithParameter...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2452 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-1874) Google Cloud Storage TextIO read fails with gz-files having Content-Encoding: gzip header

[ https://issues.apache.org/jira/browse/BEAM-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959683#comment-15959683 ] Chamikara Jayalath commented on BEAM-1874: -- Python SDK currently doesn't support these files but I

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #3199

See

[GitHub] beam pull request #2453: Remove DirectSideInputReader, PTuple

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2453 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: Remove DirectSideInputReader, PTuple

Remove DirectSideInputReader, PTuple DirectSideInputReader is unused. PTuple is unused except in DirectSideInputReader. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3e922ed5 Tree:

[1/2] beam git commit: This closes #2453

Repository: beam Updated Branches: refs/heads/master 0a176454c -> 61790f038 This closes #2453 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/61790f03 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/61790f03 Diff:

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #3200

See

[GitHub] beam pull request #2425: Rename filePath to filePattern in NumbedShardedFile

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2425 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

  1   2   >