date:20170813

[jira] [Updated] (BEAM-2335) Document various maven commands for running tests

2017-08-13 Thread Ted Yu (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ted Yu updated BEAM-2335:
-
Description: 
In this discussion thread, various maven commands for running / not running 
selected tests were mentioned:

http://search-hadoop.com/m/Beam/gfKHFd9bPDh5WJr1?subj=Re+How+can+I+disable+running+Python+SDK+tests+when+testing+my+Java+change+

We should document these commands under 
https://beam.apache.org/contribute/testing/ 

Borisa raised the following questions:

how do I execute only one test marked as @NeedsRunner?
How do I execute one specific test in java io?
How to execute one pecific test in any of the runners?
How to use beamTestpipelineoptions with few json examples?
Will mvn clean verify execute ALL tests against all runners?

For the #1 above, we can create profile which is used run tests in NeedsRunner 
category.
See the following:
http://stackoverflow.com/questions/3100924/how-to-run-junit-tests-by-category-in-maven

  was:
In this discussion thread, various maven commands for running / not running 
selected tests were mentioned:

http://search-hadoop.com/m/Beam/gfKHFd9bPDh5WJr1?subj=Re+How+can+I+disable+running+Python+SDK+tests+when+testing+my+Java+change+

We should document these commands under 
https://beam.apache.org/contribute/testing/ 

Borisa raised the following questions:

how do I execute only one test marked as @NeedsRunner?
How do I execute one specific test in java io?
How to execute one pecific test in any of the runners?
How to use beamTestpipelineoptions with few json examples?
Will mvn clean verify execute ALL tests against all runners?


For the #1 above, we can create profile which is used run tests in NeedsRunner 
category.
See the following:
http://stackoverflow.com/questions/3100924/how-to-run-junit-tests-by-category-in-maven


> Document various maven commands for running tests
> -
>
> Key: BEAM-2335
> URL: https://issues.apache.org/jira/browse/BEAM-2335
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Ted Yu
>  Labels: document
>
> In this discussion thread, various maven commands for running / not running 
> selected tests were mentioned:
> http://search-hadoop.com/m/Beam/gfKHFd9bPDh5WJr1?subj=Re+How+can+I+disable+running+Python+SDK+tests+when+testing+my+Java+change+
> We should document these commands under 
> https://beam.apache.org/contribute/testing/ 
> Borisa raised the following questions:
> how do I execute only one test marked as @NeedsRunner?
> How do I execute one specific test in java io?
> How to execute one pecific test in any of the runners?
> How to use beamTestpipelineoptions with few json examples?
> Will mvn clean verify execute ALL tests against all runners?
> For the #1 above, we can create profile which is used run tests in 
> NeedsRunner category.
> See the following:
> http://stackoverflow.com/questions/3100924/how-to-run-junit-tests-by-category-in-maven



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (BEAM-1962) Connection should be closed in case start() throws exception

2017-08-13 Thread Ted Yu (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-1962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ted Yu updated BEAM-1962:
-
Description: 
In JmsIO#start() :
{code}
  try {
Connection connection;
if (spec.getUsername() != null) {
  connection =
  connectionFactory.createConnection(spec.getUsername(), 
spec.getPassword());
} else {
  connection = connectionFactory.createConnection();
}
connection.start();
this.connection = connection;
  } catch (Exception e) {
throw new IOException("Error connecting to JMS", e);
  }
{code}
If start() throws exception, connection should be closed.

  was:
In JmsIO#start() :

{code}
  try {
Connection connection;
if (spec.getUsername() != null) {
  connection =
  connectionFactory.createConnection(spec.getUsername(), 
spec.getPassword());
} else {
  connection = connectionFactory.createConnection();
}
connection.start();
this.connection = connection;
  } catch (Exception e) {
throw new IOException("Error connecting to JMS", e);
  }
{code}
If start() throws exception, connection should be closed.


> Connection should be closed in case start() throws exception
> 
>
> Key: BEAM-1962
> URL: https://issues.apache.org/jira/browse/BEAM-1962
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-extensions
>Reporter: Ted Yu
>Assignee: Jean-Baptiste Onofré
>Priority: Minor
>
> In JmsIO#start() :
> {code}
>   try {
> Connection connection;
> if (spec.getUsername() != null) {
>   connection =
>   connectionFactory.createConnection(spec.getUsername(), 
> spec.getPassword());
> } else {
>   connection = connectionFactory.createConnection();
> }
> connection.start();
> this.connection = connection;
>   } catch (Exception e) {
> throw new IOException("Error connecting to JMS", e);
>   }
> {code}
> If start() throws exception, connection should be closed.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2823

2017-08-13 Thread Apache Jenkins Server

See

[jira] [Commented] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

2017-08-13 Thread Stas Levin (JIRA)


[ 
https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124897#comment-16124897
 ] 

Stas Levin commented on BEAM-2671:
--

[~kenn], could you elaborate on when there might be a race, and what triggers 
will be involved in such a race?

> CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark 
> runner
> 
>
> Key: BEAM-2671
> URL: https://issues.apache.org/jira/browse/BEAM-2671
> Project: Beam
>  Issue Type: Bug
>  Components: runner-spark
>Reporter: Etienne Chauchot
>Assignee: Jean-Baptiste Onofré
> Fix For: 2.2.0
>
>
> Error message:
> Flatten.Iterables/FlattenIterables/FlatMap/ParMultiDo(Anonymous).out0: 
> Expected: iterable over [] in any order
>  but: Not matched: "late"



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[beam-site] branch asf-site updated (1b92d41 -> 3c2d094)

2017-08-13 Thread aviemzur

This is an automated email from the ASF dual-hosted git repository.

aviemzur pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git.


from 1b92d41  This closes #279: Expands the section on Coders in Style Guide
 new 97b1ec9  Update PMC
 new 6835c8a  Regenerate website
 new 3c2d094  This closes #287

The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 content/contribute/team/index.html | 2 +-
 src/_beam_team/team.md | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
['"commits@beam.apache.org" '].

[beam-site] 02/03: Regenerate website

2017-08-13 Thread aviemzur

This is an automated email from the ASF dual-hosted git repository.

aviemzur pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 6835c8a4f015f0cebaf55a09730e9f3938273f0f
Author: Aviem Zur 
AuthorDate: Sun Aug 13 15:32:38 2017 +0300

Regenerate website
---
 content/contribute/team/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/content/contribute/team/index.html 
b/content/contribute/team/index.html
index 76ec22e..ea48ea3 100644
--- a/content/contribute/team/index.html
+++ b/content/contribute/team/index.html
@@ -379,7 +379,7 @@
   aviemzur
   aviemzur [at] apache [dot] org
   PayPal
-  committer
+  committer, PMC
   +2
 
   

-- 
To stop receiving notification emails like this one, please contact
"commits@beam.apache.org" .

[beam-site] 03/03: This closes #287

2017-08-13 Thread aviemzur

This is an automated email from the ASF dual-hosted git repository.

aviemzur pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 3c2d09447750cee276a1e1f197b53b7ecb40af8c
Merge: 1b92d41 6835c8a
Author: Aviem Zur 
AuthorDate: Sun Aug 13 15:32:46 2017 +0300

This closes #287

 content/contribute/team/index.html | 2 +-
 src/_beam_team/team.md | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
"commits@beam.apache.org" .

[beam-site] 01/03: Update PMC

2017-08-13 Thread aviemzur

This is an automated email from the ASF dual-hosted git repository.

aviemzur pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 97b1ec9cbdbb5bd71cde3ec9170f5dd9236e4f78
Author: Aviem Zur 
AuthorDate: Fri Aug 11 00:51:00 2017 +0300

Update PMC
---
 src/_beam_team/team.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/src/_beam_team/team.md b/src/_beam_team/team.md
index fd3feb2..8083d22 100644
--- a/src/_beam_team/team.md
+++ b/src/_beam_team/team.md
@@ -150,6 +150,6 @@ members:
 apache_id: aviemzur
 email: aviemzur [at] apache [dot] org
 organization: PayPal
-roles: committer
+roles: committer, PMC
 time_zone: "+2"
 ---

-- 
To stop receiving notification emails like this one, please contact
"commits@beam.apache.org" .

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3761

2017-08-13 Thread Apache Jenkins Server

See

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4568

2017-08-13 Thread Apache Jenkins Server

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2822

2017-08-13 Thread Apache Jenkins Server

See

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4567

2017-08-13 Thread Apache Jenkins Server

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2821

2017-08-13 Thread Apache Jenkins Server

See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4566

2017-08-13 Thread Apache Jenkins Server

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3760

2017-08-13 Thread Apache Jenkins Server

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3762

2017-08-13 Thread Apache Jenkins Server

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2824

2017-08-13 Thread Apache Jenkins Server

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3763

2017-08-13 Thread Apache Jenkins Server

See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4569

2017-08-13 Thread Apache Jenkins Server

See 


--
[...truncated 1.08 MB...]
2017-08-14T00:31:09.051 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/googlecode/concurrent-trees/concurrent-trees/2.4.0/concurrent-trees-2.4.0.jar
2017-08-14T00:31:09.093 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/googlecode/concurrent-trees/concurrent-trees/2.4.0/concurrent-trees-2.4.0.jar
 (116 KB at 17.9 KB/sec)
2017-08-14T00:31:09.093 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/github/jbellis/jamm/0.3.0/jamm-0.3.0.jar
2017-08-14T00:31:09.123 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/github/jbellis/jamm/0.3.0/jamm-0.3.0.jar
 (21 KB at 3.2 KB/sec)
2017-08-14T00:31:09.123 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/io/netty/netty-all/4.0.39.Final/netty-all-4.0.39.Final.jar
2017-08-14T00:31:09.179 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/cassandra/cassandra-thrift/3.9/cassandra-thrift-3.9.jar
 (1858 KB at 282.8 KB/sec)
2017-08-14T00:31:09.179 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/fusesource/sigar/1.6.4/sigar-1.6.4.jar
2017-08-14T00:31:09.265 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/fusesource/sigar/1.6.4/sigar-1.6.4.jar 
(419 KB at 62.9 KB/sec)
2017-08-14T00:31:09.265 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/eclipse/jdt/core/compiler/ecj/4.4.2/ecj-4.4.2.jar
2017-08-14T00:31:09.376 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/io/netty/netty-all/4.0.39.Final/netty-all-4.0.39.Final.jar
 (2219 KB at 327.9 KB/sec)
2017-08-14T00:31:09.376 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/caffinitas/ohc/ohc-core/0.4.3/ohc-core-0.4.3.jar
2017-08-14T00:31:09.424 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/caffinitas/ohc/ohc-core/0.4.3/ohc-core-0.4.3.jar
 (125 KB at 18.2 KB/sec)
2017-08-14T00:31:09.424 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/github/ben-manes/caffeine/caffeine/2.2.6/caffeine-2.2.6.jar
2017-08-14T00:31:09.535 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/eclipse/jdt/core/compiler/ecj/4.4.2/ecj-4.4.2.jar
 (2257 KB at 325.9 KB/sec)
2017-08-14T00:31:09.536 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/datastax/cassandra/cassandra-driver-core/3.1.1/cassandra-driver-core-3.1.1.jar
2017-08-14T00:31:09.569 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/github/ben-manes/caffeine/caffeine/2.2.6/caffeine-2.2.6.jar
 (926 KB at 133.0 KB/sec)
2017-08-14T00:31:09.662 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/datastax/cassandra/cassandra-driver-core/3.1.1/cassandra-driver-core-3.1.1.jar
 (1029 KB at 145.8 KB/sec)
2017-08-14T00:31:10.123 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/it/unimi/dsi/fastutil/6.5.7/fastutil-6.5.7.jar
 (16508 KB at 2197.5 KB/sec)
2017-08-14T00:31:13.447 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/storm/storm-core/1.0.1/storm-core-1.0.1.jar
 (19650 KB at 1813.4 KB/sec)
2017-08-14T00:31:13.492 [INFO] Downloading: 
http://conjars.org/repo/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar
2017-08-14T00:31:13.492 [INFO] Downloading: 
http://conjars.org/repo/cascading/cascading-hadoop/2.6.3/cascading-hadoop-2.6.3.jar
2017-08-14T00:31:13.492 [INFO] Downloading: 
http://conjars.org/repo/riffle/riffle/0.1-dev/riffle-0.1-dev.jar
2017-08-14T00:31:13.493 [INFO] Downloading: 
http://conjars.org/repo/cascading/cascading-core/2.6.3/cascading-core-2.6.3.jar
2017-08-14T00:31:13.494 [INFO] Downloading: 
http://conjars.org/repo/thirdparty/jgrapht-jdk1.6/0.8.1/jgrapht-jdk1.6-0.8.1.jar
2017-08-14T00:31:13.606 [INFO] Downloaded: 
http://conjars.org/repo/riffle/riffle/0.1-dev/riffle-0.1-dev.jar (12 KB at 97.2 
KB/sec)
2017-08-14T00:31:13.606 [INFO] Downloading: 
http://conjars.org/repo/cascading/cascading-local/2.6.3/cascading-local-2.6.3.jar
2017-08-14T00:31:13.661 [INFO] Downloaded: 
http://conjars.org/repo/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar
 (48 KB at 280.6 KB/sec)
2017-08-14T00:31:13.775 [INFO] Downloaded: 
http://conjars.org/repo/cascading/cascading-local/2.6.3/cascading-local-2.6.3.jar
 (43 KB at 150.1 KB/sec)
2017-08-14T00:31:13.829 [INFO] Downloaded: 
http://conjars.org/repo/thirdparty/jgrapht-jdk1.6/0.8.1/jgrapht-jdk1.6-0.8.1.jar
 (230 KB at 680.3 KB/sec)
2017-08-14T00:31:13.918 [INFO] Downloaded: 
http://conjars.org/repo/cascading/cascading-hadoop/2.6.3/cascading-hadoop-2.6.3.jar
 (246 KB at 577.2 KB/sec)
2017-08-14T00:31:14.155 [INFO] Downloaded: 
http://conjars.org/repo/cascading/cascading-core/2.6.3/cascading-core-2.6.3.jar 
(680 KB at 1024.8 KB/sec)
[JENKINS] Archiving disabled
2017-08-14T00:31:15.220 [INFO]

[beam-site] branch asf-site updated (3c2d094 -> 00c39f4)

2017-08-13 Thread altay

This is an automated email from the ASF dual-hosted git repository.

altay pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git.


from 3c2d094  This closes #287
 new f4ac4bd  Update PMC
 new f0ba09c  Regenerate website
 new 00c39f4  This closes #289

The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 content/contribute/team/index.html | 2 +-
 src/_beam_team/team.md | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
['"commits@beam.apache.org" '].

[beam-site] 01/03: Update PMC

2017-08-13 Thread altay

This is an automated email from the ASF dual-hosted git repository.

altay pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit f4ac4bd3346eb7e5ba3380d9c309288af8c85983
Author: Ahmet Altay 
AuthorDate: Thu Aug 10 19:01:47 2017 -0700

Update PMC
---
 src/_beam_team/team.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/src/_beam_team/team.md b/src/_beam_team/team.md
index 8083d22..856f54f 100644
--- a/src/_beam_team/team.md
+++ b/src/_beam_team/team.md
@@ -12,7 +12,7 @@ members:
 apache_id: altay
 email: altay [at] apache [dot] org
 organization: Google
-roles: committer
+roles: committer, PMC
 time_zone: "-8"
   - name: Jesse Anderson
 apache_id: jesseanderson

-- 
To stop receiving notification emails like this one, please contact
"commits@beam.apache.org" .

[beam-site] 03/03: This closes #289

2017-08-13 Thread altay

This is an automated email from the ASF dual-hosted git repository.

altay pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 00c39f403233bd6937c8e03a5319147bbb69a7fa
Merge: 3c2d094 f0ba09c
Author: Ahmet Altay 
AuthorDate: Sun Aug 13 20:59:07 2017 -0700

This closes #289

 content/contribute/team/index.html | 2 +-
 src/_beam_team/team.md | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
"commits@beam.apache.org" .

[beam-site] 02/03: Regenerate website

2017-08-13 Thread altay

This is an automated email from the ASF dual-hosted git repository.

altay pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit f0ba09cf48073dd0d65a2ea9fc05146da70efec6
Author: Ahmet Altay 
AuthorDate: Sun Aug 13 20:59:06 2017 -0700

Regenerate website
---
 content/contribute/team/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/content/contribute/team/index.html 
b/content/contribute/team/index.html
index ea48ea3..8f1203f 100644
--- a/content/contribute/team/index.html
+++ b/content/contribute/team/index.html
@@ -172,7 +172,7 @@
   altay
   altay [at] apache [dot] org
   Google
-  committer
+  committer, PMC
   -8
 
   

-- 
To stop receiving notification emails like this one, please contact
"commits@beam.apache.org" .

[jira] [Updated] (BEAM-2335) Document various maven commands for running tests

[jira] [Updated] (BEAM-1962) Connection should be closed in case start() throws exception

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2823

[jira] [Commented] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

[beam-site] branch asf-site updated (1b92d41 -> 3c2d094)

[beam-site] 02/03: Regenerate website

[beam-site] 03/03: This closes #287

[beam-site] 01/03: Update PMC

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3761

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4568

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2822

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4567

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2821

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4566

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3760

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3762

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2824

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3763

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4569

[beam-site] branch asf-site updated (3c2d094 -> 00c39f4)

[beam-site] 01/03: Update PMC

[beam-site] 03/03: This closes #289

[beam-site] 02/03: Regenerate website

23 matches

Site Navigation

Mail list logo

Footer information