[jira] [Created] (BEAM-2709) Add TezRunner

2017-08-01 Thread Brandon Scheller (JIRA)
Brandon Scheller created BEAM-2709: -- Summary: Add TezRunner Key: BEAM-2709 URL: https://issues.apache.org/jira/browse/BEAM-2709 Project: Beam Issue Type: New Feature Components:

[jira] [Updated] (BEAM-2708) Decompressing bzip2 files with multiple "streams" only reads the first stream

2017-08-01 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers updated BEAM-2708: --- Summary: Decompressing bzip2 files with multiple "streams" only reads the first stream (was: Support

[jira] [Comment Edited] (BEAM-2708) Support for pbzip2 in IO

2017-08-01 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109703#comment-16109703 ] Ben Chambers edited comment on BEAM-2708 at 8/1/17 8:35 PM: This looks to be a

[jira] [Comment Edited] (BEAM-2708) Support for pbzip2 in IO

2017-08-01 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109703#comment-16109703 ] Ben Chambers edited comment on BEAM-2708 at 8/1/17 8:35 PM: This looks to be a

[jira] [Comment Edited] (BEAM-2708) Support for pbzip2 in IO

2017-08-01 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109703#comment-16109703 ] Ben Chambers edited comment on BEAM-2708 at 8/1/17 8:34 PM: This looks to be a

[jira] [Commented] (BEAM-2708) Support for pbzip2 in IO

2017-08-01 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109703#comment-16109703 ] Ben Chambers commented on BEAM-2708: This looks to be a bug in the CompressedSource support for BZIP2.

[jira] [Assigned] (BEAM-2708) Support for pbzip2 in IO

2017-08-01 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers reassigned BEAM-2708: -- Assignee: Ben Chambers (was: Chamikara Jayalath) > Support for pbzip2 in IO >

[jira] [Commented] (BEAM-1364) Update Jenkins to provide granular signals for python sdk

2017-08-01 Thread Jason Kuster (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109682#comment-16109682 ] Jason Kuster commented on BEAM-1364: Just saw this -- adding additional python signals will be handled

[jira] [Created] (BEAM-2708) Support for pbzip2 in IO

2017-08-01 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-2708: --- Summary: Support for pbzip2 in IO Key: BEAM-2708 URL: https://issues.apache.org/jira/browse/BEAM-2708 Project: Beam Issue Type: Bug Components:

[jira] [Commented] (BEAM-2706) Create JdbcIO.readAll()

2017-08-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109649#comment-16109649 ] Jean-Baptiste Onofré commented on BEAM-2706: Yes. > Create JdbcIO.readAll() >

[jira] [Updated] (BEAM-2707) DSL_SQL branch broken by PR 3334

2017-08-01 Thread Tyler Akidau (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tyler Akidau updated BEAM-2707: --- Description: The DSL_SQL branch recently started seeing a number of failures in tests when running

[jira] [Updated] (BEAM-2707) DSL_SQL branch broken by PR 3334

2017-08-01 Thread Tyler Akidau (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tyler Akidau updated BEAM-2707: --- Description: The DSL_SQL branch recently started seeing a number of failures in tests when running

[jira] [Created] (BEAM-2707) DSL_SQL branch broken by PR 3334

2017-08-01 Thread Tyler Akidau (JIRA)
Tyler Akidau created BEAM-2707: -- Summary: DSL_SQL branch broken by PR 3334 Key: BEAM-2707 URL: https://issues.apache.org/jira/browse/BEAM-2707 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-1323) Add parallelism/splitting in JdbcIO

2017-08-01 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109644#comment-16109644 ] Eugene Kirpichov commented on BEAM-1323: Filed https://issues.apache.org/jira/browse/BEAM-2706 for

[jira] [Created] (BEAM-2706) Create JdbcIO.readAll()

2017-08-01 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-2706: -- Summary: Create JdbcIO.readAll() Key: BEAM-2706 URL: https://issues.apache.org/jira/browse/BEAM-2706 Project: Beam Issue Type: Bug Components:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3695

2017-08-01 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1323) Add parallelism/splitting in JdbcIO

2017-08-01 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109527#comment-16109527 ] Eugene Kirpichov commented on BEAM-1323: This may be addressed by creating JdbcIO.readAll() that

[jira] [Assigned] (BEAM-2547) FireBase IO

2017-08-01 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reassigned BEAM-2547: Assignee: (was: Chamikara Jayalath) > FireBase IO > --- > >

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2754

2017-08-01 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2705) DoFnTester supports for StateParameter

2017-08-01 Thread Yihua Eric Fang (JIRA)
Yihua Eric Fang created BEAM-2705: - Summary: DoFnTester supports for StateParameter Key: BEAM-2705 URL: https://issues.apache.org/jira/browse/BEAM-2705 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-2676) move BeamSqlRow and BeamSqlRowType to sdk/java/core

2017-08-01 Thread Tyler Akidau (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109295#comment-16109295 ] Tyler Akidau commented on BEAM-2676: +1 to Robert's proposal (including renaming BeamRecord; BeamRow

Build failed in Jenkins: beam_PostCommit_Python_Verify #2844

2017-08-01 Thread Apache Jenkins Server
See -- [...truncated 559.28 KB...] File was already downloaded /tmp/dataflow-requirements-cache/six-1.10.0.tar.gz Collecting funcsigs>=1 (from mock->-r

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3694

2017-08-01 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3693

2017-08-01 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2753

2017-08-01 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Python_Verify #2843

2017-08-01 Thread Apache Jenkins Server
See Changes: [iemejia] [BEAM-2690] HCatalogIO needs provided scope dependencies on Hadoop, Hive -- [...truncated 559.68 KB...] File was already downloaded

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2752

2017-08-01 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-2690) Make hadoop and hive dependencies provided for HCatalogIO

2017-08-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-2690: --- Summary: Make hadoop and hive dependencies provided for HCatalogIO (was: HCatalogIO has compile

[jira] [Resolved] (BEAM-2690) HCatalogIO has compile scoped dependencies on Hadoop and Hive

2017-08-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-2690. Resolution: Fixed Fix Version/s: 2.2.0 > HCatalogIO has compile scoped dependencies on Hadoop

[GitHub] beam pull request #3660: [BEAM-2690] HCatalogIO needs provided scope depende...

2017-08-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3660 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Assigned] (BEAM-2690) HCatalogIO has compile scoped dependencies on Hadoop and Hive

2017-08-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-2690: -- Assignee: Nathan Howell (was: Davor Bonaci) > HCatalogIO has compile scoped dependencies on

[jira] [Commented] (BEAM-2690) HCatalogIO has compile scoped dependencies on Hadoop and Hive

2017-08-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108771#comment-16108771 ] ASF GitHub Bot commented on BEAM-2690: -- Github user asfgit closed the pull request at:

[1/2] beam git commit: [BEAM-2690] HCatalogIO needs provided scope dependencies on Hadoop, Hive

2017-08-01 Thread iemejia
Repository: beam Updated Branches: refs/heads/master 2816b15ee -> 3c81766e2 [BEAM-2690] HCatalogIO needs provided scope dependencies on Hadoop, Hive Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/14563c64 Tree:

[2/2] beam git commit: This closes #3660

2017-08-01 Thread iemejia
This closes #3660 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3c81766e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3c81766e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3c81766e Branch:

[jira] [Commented] (BEAM-1323) Add parallelism/splitting in JdbcIO

2017-08-01 Thread Anuj Jamwal (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108720#comment-16108720 ] Anuj Jamwal commented on BEAM-1323: --- If i understand correctly, what Jean is implying is that, we can

Build failed in Jenkins: beam_PostCommit_Python_Verify #2842

2017-08-01 Thread Apache Jenkins Server
See -- [...truncated 558.54 KB...] File was already downloaded /tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz Collecting pbr>=0.11 (from mock->-r

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3692

2017-08-01 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3691

2017-08-01 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Python_Verify #2841

2017-08-01 Thread Apache Jenkins Server
See Changes: [jbonofre] [BEAM-2530] Upgrade maven plugins to the latest versions -- [...truncated 559.70 KB...] Successfully downloaded pyhamcrest mock

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Apex #2102

2017-08-01 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2751

2017-08-01 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2530) Make Beam compatible with Java 9

2017-08-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108456#comment-16108456 ] ASF GitHub Bot commented on BEAM-2530: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3665: [BEAM-2530] Upgrade maven plugins to the latest ver...

2017-08-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3665 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-2530] Upgrade maven plugins to the latest versions

2017-08-01 Thread jbonofre
Repository: beam Updated Branches: refs/heads/master 870551ccc -> 2816b15ee [BEAM-2530] Upgrade maven plugins to the latest versions This is part of the ongoing work to support java 9 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[2/2] beam git commit: [BEAM-2530] This closes #3665

2017-08-01 Thread jbonofre
[BEAM-2530] This closes #3665 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2816b15e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2816b15e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/2816b15e Branch:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2750

2017-08-01 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Apex #2101

2017-08-01 Thread Apache Jenkins Server
See -- [...truncated 144.25 KB...] 2017-08-01T06:02:30.771 [INFO] Downloading:

<    1   2