Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2475

2017-06-25 Thread Apache Jenkins Server 
See

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Dataflow #3448

2017-06-25 Thread Apache Jenkins Server 
See 


--
[...truncated 261.94 KB...]
2017-06-26T06:02:34.910 [INFO] 
2017-06-26T06:02:34.910 [INFO] --- maven-site-plugin:3.5.1:attach-descriptor 
(attach-descriptor) @ beam-sdks-common-parent ---
2017-06-26T06:02:35.010 [INFO] 
2017-06-26T06:02:35.010 [INFO] --- maven-jar-plugin:3.0.2:jar (default-jar) @ 
beam-sdks-common-parent ---
2017-06-26T06:02:35.011 [INFO] Skipping packaging of the jar
2017-06-26T06:02:35.109 [INFO] 
2017-06-26T06:02:35.109 [INFO] --- maven-jar-plugin:3.0.2:test-jar 
(default-test-jar) @ beam-sdks-common-parent ---
2017-06-26T06:02:35.110 [INFO] Skipping packaging of the test-jar
2017-06-26T06:02:35.159 [INFO] 
2017-06-26T06:02:35.159 [INFO] --- maven-shade-plugin:3.0.0:shade 
(bundle-and-repackage) @ beam-sdks-common-parent ---
2017-06-26T06:02:35.163 [INFO] Replacing original artifact with shaded artifact.
2017-06-26T06:02:35.212 [INFO] 
2017-06-26T06:02:35.212 [INFO] --- maven-dependency-plugin:3.0.1:analyze-only 
(default) @ beam-sdks-common-parent ---
2017-06-26T06:02:35.213 [INFO] Skipping pom project
[JENKINS] Archiving disabled
2017-06-26T06:02:35.841 [INFO]  
   
2017-06-26T06:02:35.841 [INFO] 

2017-06-26T06:02:35.841 [INFO] Building Apache Beam :: SDKs :: Common :: Runner 
API 2.1.0-SNAPSHOT
2017-06-26T06:02:35.841 [INFO] 

2017-06-26T06:02:35.842 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/xolstice/maven/plugins/protobuf-maven-plugin/0.5.0/protobuf-maven-plugin-0.5.0.pom
2017-06-26T06:02:35.872 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/xolstice/maven/plugins/protobuf-maven-plugin/0.5.0/protobuf-maven-plugin-0.5.0.pom
 (30 KB at 975.7 KB/sec)
2017-06-26T06:02:35.874 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/xolstice/maven/plugins/protobuf-maven-plugin/0.5.0/protobuf-maven-plugin-0.5.0.jar
2017-06-26T06:02:35.912 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/xolstice/maven/plugins/protobuf-maven-plugin/0.5.0/protobuf-maven-plugin-0.5.0.jar
 (176 KB at 4625.4 KB/sec)
2017-06-26T06:02:35.920 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/mojo/findbugs-maven-plugin/3.0.4/findbugs-maven-plugin-3.0.4.pom
2017-06-26T06:02:35.947 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/mojo/findbugs-maven-plugin/3.0.4/findbugs-maven-plugin-3.0.4.pom
 (22 KB at 798.0 KB/sec)
2017-06-26T06:02:35.949 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/mojo/mojo-parent/35/mojo-parent-35.pom
2017-06-26T06:02:35.977 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/mojo/mojo-parent/35/mojo-parent-35.pom
 (25 KB at 868.5 KB/sec)
2017-06-26T06:02:35.979 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/codehaus-parent/4/codehaus-parent-4.pom
2017-06-26T06:02:36.004 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/codehaus-parent/4/codehaus-parent-4.pom
 (5 KB at 188.3 KB/sec)
2017-06-26T06:02:36.007 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/mojo/findbugs-maven-plugin/3.0.4/findbugs-maven-plugin-3.0.4.jar
2017-06-26T06:02:36.044 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/mojo/findbugs-maven-plugin/3.0.4/findbugs-maven-plugin-3.0.4.jar
 (143 KB at 3844.5 KB/sec)
2017-06-26T06:02:36.049 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/protobuf/protobuf-java/3.2.0/protobuf-java-3.2.0.pom
2017-06-26T06:02:36.077 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/protobuf/protobuf-java/3.2.0/protobuf-java-3.2.0.pom
 (5 KB at 162.9 KB/sec)
2017-06-26T06:02:36.078 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/protobuf/protobuf-parent/3.2.0/protobuf-parent-3.2.0.pom
2017-06-26T06:02:36.106 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/protobuf/protobuf-parent/3.2.0/protobuf-parent-3.2.0.pom
 (7 KB at 238.7 KB/sec)
2017-06-26T06:02:36.108 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/google/protobuf/protobuf-java/3.2.0/protobuf-java-3.2.0.jar
2017-06-26T06:02:36.230 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/google/protobuf/protobuf-java/3.2.0/protobuf-java-3.2.0.jar
 (1316 KB at 10783.2 KB/sec)
2017-06-26T06:02:36.231 [INFO] 
2017-06-26T06:02:36.231 [INFO] --- maven-clean-plugin:3.0.0:clean 
(default-clean) @ beam-sdks-common-runner-api ---
2017-06-26T06:02:36.232 [INFO] Deleting 

 (includes = [**/*.pyc, **/*.egg-info/, **/sdks/python/LICENSE, 
**/sdks/python/NOTICE, **/sdks/python/README.md],

[jira] [Commented] (BEAM-2478) Distinct Aggregates

2017-06-25 Thread Tarush Grover (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-2478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062558#comment-16062558
 ] 

Tarush Grover commented on BEAM-2478:
-

Thanks [~julianhyde] [~lzljs3620320] 

> Distinct Aggregates
> ---
>
> Key: BEAM-2478
> URL: https://issues.apache.org/jira/browse/BEAM-2478
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: Jingsong Lee
>Assignee: Tarush Grover
>
> eg: COUNT(DISTINCT empno)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Resolved] (BEAM-2463) EXP Function

2017-06-25 Thread Tarush Grover (JIRA) 

 [ 
https://issues.apache.org/jira/browse/BEAM-2463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tarush Grover resolved BEAM-2463.
-
   Resolution: Fixed
Fix Version/s: 2.1.0

> EXP Function
> 
>
> Key: BEAM-2463
> URL: https://issues.apache.org/jira/browse/BEAM-2463
> Project: Beam
>  Issue Type: Sub-task
>  Components: dsl-sql
>Reporter: Tarush Grover
>Assignee: Tarush Grover
>  Labels: dsl_sql_merge
> Fix For: 2.1.0
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Resolved] (BEAM-2462) LOG10 Function

2017-06-25 Thread Tarush Grover (JIRA) 

 [ 
https://issues.apache.org/jira/browse/BEAM-2462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tarush Grover resolved BEAM-2462.
-
   Resolution: Fixed
Fix Version/s: 2.1.0

> LOG10 Function
> --
>
> Key: BEAM-2462
> URL: https://issues.apache.org/jira/browse/BEAM-2462
> Project: Beam
>  Issue Type: Sub-task
>  Components: dsl-sql
>Reporter: Tarush Grover
>Assignee: Tarush Grover
>  Labels: dsl_sql_merge
> Fix For: 2.1.0
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Closed] (BEAM-2461) LN Function

2017-06-25 Thread Tarush Grover (JIRA) 

 [ 
https://issues.apache.org/jira/browse/BEAM-2461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tarush Grover closed BEAM-2461.
---
   Resolution: Fixed
Fix Version/s: 2.1.0

> LN Function
> ---
>
> Key: BEAM-2461
> URL: https://issues.apache.org/jira/browse/BEAM-2461
> Project: Beam
>  Issue Type: Sub-task
>  Components: dsl-sql
>Reporter: Tarush Grover
>Assignee: Tarush Grover
>  Labels: dsl_sql_merge
> Fix For: 2.1.0
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Closed] (BEAM-2480) ACOS, ASIN, ATAN, COS, COT, DEGREES, RADIANS, SIN, TAN, SIGN, LN, LOG10, EXP Functions

2017-06-25 Thread Tarush Grover (JIRA) 

 [ 
https://issues.apache.org/jira/browse/BEAM-2480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tarush Grover closed BEAM-2480.
---
   Resolution: Fixed
Fix Version/s: 2.1.0

> ACOS, ASIN, ATAN, COS, COT, DEGREES, RADIANS, SIN, TAN, SIGN, LN, LOG10, EXP 
> Functions
> --
>
> Key: BEAM-2480
> URL: https://issues.apache.org/jira/browse/BEAM-2480
> Project: Beam
>  Issue Type: Sub-task
>  Components: dsl-sql
>Reporter: Tarush Grover
>Assignee: Tarush Grover
>  Labels: dsl_sql_merge
> Fix For: 2.1.0
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[GitHub] beam pull request #3400: Beam-2480 ACOS, ASIN, ATAN, COS, COT, DEGREES, RADI...

2017-06-25 Thread app-tarush 
Github user app-tarush closed the pull request at:

https://github.com/apache/beam/pull/3400


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4213

2017-06-25 Thread Apache Jenkins Server 
See

[jira] [Commented] (BEAM-2478) Distinct Aggregates

2017-06-25 Thread Jingsong Lee (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-2478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062468#comment-16062468
 ] 

Jingsong Lee commented on BEAM-2478:


(y) You are right.
Calcite native offers a lot of useful Rules, which is really exciting.

> Distinct Aggregates
> ---
>
> Key: BEAM-2478
> URL: https://issues.apache.org/jira/browse/BEAM-2478
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: Jingsong Lee
>Assignee: Tarush Grover
>
> eg: COUNT(DISTINCT empno)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2474

2017-06-25 Thread Apache Jenkins Server 
See

[jira] [Comment Edited] (BEAM-2478) Distinct Aggregates

2017-06-25 Thread Julian Hyde (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-2478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062450#comment-16062450
 ] 

Julian Hyde edited comment on BEAM-2478 at 6/25/17 10:45 PM:
-

Your rewrite for hierarchical calculation is slightly wrong.

{code}
select a, count(distinct b) from t group by a

becomes

select a, count(distinct_b) from (
  select a, b as distinct_b
  from t
  group by a, b)
group by a
{code}

This correctly ignores rows where b is null.

Calcite's 
[AggregateExpandDistinctAggregatesRule|https://insight.io/github.com/apache/calcite/blob/master/core/src/main/java/org/apache/calcite/rel/rules/AggregateExpandDistinctAggregatesRule.java]
 does this rewrite; it can also do a more complex rewrite using GROUPING SETS 
if there are multiple distinct-counts in the same query. See also CALCITE-1588 
for approximate distinct-count.


was (Author: julianhyde):
Your rewrite for hierarchical calculation is slightly wrong.

{code}
select a, count(distinct b) from t group by a

becomes

select a, count(distinct_b) from (
  select a, b as distinct_b
  from t
  group by a, b)
group by a)
{code}

This correctly ignores rows where b is null.

Calcite's 
[AggregateExpandDistinctAggregatesRule|https://insight.io/github.com/apache/calcite/blob/master/core/src/main/java/org/apache/calcite/rel/rules/AggregateExpandDistinctAggregatesRule.java]
 does this rewrite; it can also do a more complex rewrite using GROUPING SETS 
if there are multiple distinct-counts in the same query. See also CALCITE-1588 
for approximate distinct-count.

> Distinct Aggregates
> ---
>
> Key: BEAM-2478
> URL: https://issues.apache.org/jira/browse/BEAM-2478
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: Jingsong Lee
>Assignee: Tarush Grover
>
> eg: COUNT(DISTINCT empno)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (BEAM-2478) Distinct Aggregates

2017-06-25 Thread Julian Hyde (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-2478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062450#comment-16062450
 ] 

Julian Hyde commented on BEAM-2478:
---

Your rewrite for hierarchical calculation is slightly wrong.

{code}
select a, count(distinct b) from t group by a

becomes

select a, count(distinct_b) from (
  select a, b as distinct_b
  from t
  group by a, b)
group by a)
{code}

This correctly ignores rows where b is null.

Calcite's 
[AggregateExpandDistinctAggregatesRule|https://insight.io/github.com/apache/calcite/blob/master/core/src/main/java/org/apache/calcite/rel/rules/AggregateExpandDistinctAggregatesRule.java]
 does this rewrite; it can also do a more complex rewrite using GROUPING SETS 
if there are multiple distinct-counts in the same query. See also CALCITE-1588 
for approximate distinct-count.

> Distinct Aggregates
> ---
>
> Key: BEAM-2478
> URL: https://issues.apache.org/jira/browse/BEAM-2478
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: Jingsong Lee
>Assignee: Tarush Grover
>
> eg: COUNT(DISTINCT empno)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4212

2017-06-25 Thread Apache Jenkins Server 
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2473

2017-06-25 Thread Apache Jenkins Server 
See

[jira] [Commented] (BEAM-2389) GcpCoreApiSurfaceTest isn't testing right module

2017-06-25 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062329#comment-16062329
 ] 

ASF GitHub Bot commented on BEAM-2389:
--

GitHub user adude3141 opened a pull request:

https://github.com/apache/beam/pull/3436

BEAM-2389 moved GcpCoreApiSurfaceTest to corresponding module, adapte…

…d exposed packagees

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`.
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.pdf).

---


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/adude3141/beam BEAM-2389

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/3436.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3436


commit 67313b616d0f8ab5a7a8f7d2a6d11a693adadf9b
Author: Michael Luckey 
Date:   2017-06-25T13:01:08Z

BEAM-2389 moved GcpCoreApiSurfaceTest to corresponding module, adapted 
exposed packagees




> GcpCoreApiSurfaceTest isn't testing right module
> 
>
> Key: BEAM-2389
> URL: https://issues.apache.org/jira/browse/BEAM-2389
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-gcp
>Affects Versions: 2.0.0
>Reporter: Daniel Halperin
>Assignee: Michael Luckey
> Fix For: 2.1.0
>
>
> It looks like a clone of {{SdkApiSurfaceTest}} that was not updated, outside 
> of being renamed, now that it's in a new module. Even the java package of the 
> test is wrong.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[GitHub] beam pull request #3436: BEAM-2389 moved GcpCoreApiSurfaceTest to correspond...

2017-06-25 Thread adude3141 
GitHub user adude3141 opened a pull request:

https://github.com/apache/beam/pull/3436

BEAM-2389 moved GcpCoreApiSurfaceTest to corresponding module, adapte…

…d exposed packagees

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`.
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.pdf).

---


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/adude3141/beam BEAM-2389

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/3436.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3436


commit 67313b616d0f8ab5a7a8f7d2a6d11a693adadf9b
Author: Michael Luckey 
Date:   2017-06-25T13:01:08Z

BEAM-2389 moved GcpCoreApiSurfaceTest to corresponding module, adapted 
exposed packagees




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4211

2017-06-25 Thread Apache Jenkins Server 
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2472

2017-06-25 Thread Apache Jenkins Server 
See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4210

2017-06-25 Thread Apache Jenkins Server 
See