[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Peter Somogyi (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210629#comment-16210629
 ] 

Peter Somogyi commented on HBASE-19042:
---

The error comes from here: 
https://github.com/apache/yetus/blob/3c28739fc618a47854e1e55faca6afb2eca52d7c/precommit/core.d/docker.sh#L613-L627
Can we somehow check the exact command there?

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v10.patch, 
> HBASE-19042-v2.patch, HBASE-19042-v3.patch, HBASE-19042-v4.patch, 
> HBASE-19042-v5.patch, HBASE-19042-v6.patch, HBASE-19042-v7.patch, 
> HBASE-19042-v8.patch, HBASE-19042-v9.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by 

[jira] [Updated] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Duo Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-19042:
--
Attachment: HBASE-19042-v10.patch

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v10.patch, 
> HBASE-19042-v2.patch, HBASE-19042-v3.patch, HBASE-19042-v4.patch, 
> HBASE-19042-v5.patch, HBASE-19042-v6.patch, HBASE-19042-v7.patch, 
> HBASE-19042-v8.patch, HBASE-19042-v9.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210625#comment-16210625
 ] 

Hadoop QA commented on HBASE-19042:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red}  0m 
17s{color} | {color:red} Docker failed to build yetus/hbase:5d60123. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-19042 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892987/HBASE-19042-v9.patch |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9208/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042-v6.patch, HBASE-19042-v7.patch, HBASE-19042-v8.patch, 
> HBASE-19042-v9.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 

[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210623#comment-16210623
 ] 

Hadoop QA commented on HBASE-19042:
---

(!) A patch to the testing environment has been detected. 
Re-executing against the patched versions to perform further tests. 
The console is at 
https://builds.apache.org/job/PreCommit-HBASE-Build/9208/console in case of 
problems.


> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042-v6.patch, HBASE-19042-v7.patch, HBASE-19042-v8.patch, 
> HBASE-19042-v9.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was 

[jira] [Updated] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Duo Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-19042:
--
Attachment: HBASE-19042-v9.patch

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042-v6.patch, HBASE-19042-v7.patch, HBASE-19042-v8.patch, 
> HBASE-19042-v9.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19035) Miss metrics when coprocessor use region scanner to read data

2017-10-18 Thread Anoop Sam John (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210616#comment-16210616
 ] 

Anoop Sam John commented on HBASE-19035:


Ya I was abt to ask this Q on other issue comments..  Even if CP do the work 
and by pass the original work, the action (like write or read) will be done via 
Region level APIs only. So any way the metric will get update..  Seems there is 
inconsistency as per this bug report.  
For eg: as reported in the mail thread for bypass support, a delete op might be 
converted to a special put at preDelete and actual write been carried out there 
and doing bypass on core flow.  So this write is again done by calling put API 
on the Region which is updating some metric..  So whether CP on its own should 
update metric?   I mean the core metric.  That might be double update issue.  
Sorry am not knowing this metric area well.. Pls correct if wrong

> Miss metrics when coprocessor use region scanner to read data
> -
>
> Key: HBASE-19035
> URL: https://issues.apache.org/jira/browse/HBASE-19035
> Project: HBase
>  Issue Type: Bug
>Reporter: Guanghao Zhang
>
> Region interface is exposed to coprocessor. So coprocessor use getScanner to 
> get a region scanner to read data. But the scan metrics was only updated in 
> region server level. So we will miss some scan metrics for the read from 
> coprocessor.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Peter Somogyi (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210614#comment-16210614
 ] 

Peter Somogyi commented on HBASE-19042:
---

This is the same error message with {{maven:3.5.0-jdk-8}} base that [~mdrob] 
started to investigate. I'm checking yetus's source code now.

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042-v6.patch, HBASE-19042-v7.patch, HBASE-19042-v8.patch, 
> HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Duo Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210613#comment-16210613
 ] 

Duo Zhang commented on HBASE-19042:
---

The docker image is built but we failed on commit the image... strange...

Let me try reverting to 14.04, and see how to install openjdk 8 on 14.04...

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042-v6.patch, HBASE-19042-v7.patch, HBASE-19042-v8.patch, 
> HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210605#comment-16210605
 ] 

Hadoop QA commented on HBASE-19042:
---

(!) A patch to the testing environment has been detected. 
Re-executing against the patched versions to perform further tests. 
The console is at 
https://builds.apache.org/job/PreCommit-HBASE-Build/9207/console in case of 
problems.


> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042-v6.patch, HBASE-19042-v7.patch, HBASE-19042-v8.patch, 
> HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA

[jira] [Updated] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Duo Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-19042:
--
Attachment: HBASE-19042-v8.patch

gem install rake

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042-v6.patch, HBASE-19042-v7.patch, HBASE-19042-v8.patch, 
> HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-15172) Support setting storage policy in bulkload

2017-10-18 Thread Anoop Sam John (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210601#comment-16210601
 ] 

Anoop Sam John commented on HBASE-15172:


bq.we could set storage policy through "hbase.hstore.block.storage.policy" 
property for bulkload, or "hbase.hstore.block.storage.policy." for 
a specified family
So this only for specifying policy to be used for files loaded via bulk load 
only?  For normal HFiles being flushed/compacted, the setting is at HCD?

> Support setting storage policy in bulkload
> --
>
> Key: HBASE-15172
> URL: https://issues.apache.org/jira/browse/HBASE-15172
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Yu Li
>Assignee: Yu Li
> Fix For: 2.0.0
>
> Attachments: HBASE-15172.patch, HBASE-15172.v2.patch
>
>
> When using tiered HFile storage, we should be able to generating hfile with 
> correct storage type during bulkload. This JIRA is targeting at making it 
> possible.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210600#comment-16210600
 ] 

Hadoop QA commented on HBASE-19042:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red}  0m  
9s{color} | {color:red} Docker failed to build yetus/hbase:5d60123. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-19042 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892983/HBASE-19042-v7.patch |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9206/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042-v6.patch, HBASE-19042-v7.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 

[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210599#comment-16210599
 ] 

Hadoop QA commented on HBASE-19042:
---

(!) A patch to the testing environment has been detected. 
Re-executing against the patched versions to perform further tests. 
The console is at 
https://builds.apache.org/job/PreCommit-HBASE-Build/9206/console in case of 
problems.


> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042-v6.patch, HBASE-19042-v7.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Duo Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-19042:
--
Attachment: HBASE-19042-v7.patch

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042-v6.patch, HBASE-19042-v7.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Duo Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210597#comment-16210597
 ] 

Duo Zhang commented on HBASE-19042:
---

Seems the robocup in 16.04 requires newer version of ruby... Let me upgrade to 
ruby 2.3 first as most pre commit jobs does not require ruby.

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042-v6.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-18770) Remove bypass method in ObserverContext and implement the 'bypass' logic case by case

2017-10-18 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-18770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210595#comment-16210595
 ] 

stack commented on HBASE-18770:
---

Summarizing the above and what came of the discussion up on the dev list (See 
link cited above in this JIRAs description):

 * Only a select few preXXX ops can be by-passed; all others cannot opt to 
by-pass the core call.
 ** Which few is TBD: candidates include flush, compaction, and RPC preXXX 
calls for query and mutation, checkAndPutt, etc.
 ** We will make it so you CANNOT  bypass loading of an hfile in 
RegionObserver.preBulkLoadHFile (see comment above).
 * The bypass will be flagged by a boolean returned out of the preXXX call; 
true to by-pass. The current bypass flag in CP will be removed.
 * The CP can say 'bypass' and provide its own answer (e.g. the Timeline Server 
says 'bypass' and returns its own Get result out of the preGet to return to the 
caller -- this would still work).
 * Even if we bypass, we must update pertinent core metrics (in old days, on 
by-pass, a CP might want to increment certain metrics anyways for whatever 
reason); we'd do this so we do NOT have to expose internal metrics systems to 
CPs (It has its own metrics to which it can gain access via CPEnv).

The thread up on dev has good examples of CPs using bypass; e.g. Tephra and 
CDAP. Make sure these cases still work.




> Remove bypass method in ObserverContext and implement the 'bypass' logic case 
> by case
> -
>
> Key: HBASE-18770
> URL: https://issues.apache.org/jira/browse/HBASE-18770
> Project: HBase
>  Issue Type: Sub-task
>  Components: Coprocessors
>Reporter: Duo Zhang
>Assignee: stack
> Fix For: 2.0.0-alpha-4
>
>
> http://search-hadoop.com/m/HBase/YGbbXd0RDCIHSC1



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210594#comment-16210594
 ] 

Hadoop QA commented on HBASE-19042:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red}  0m 
44s{color} | {color:red} Docker failed to build yetus/hbase:5d60123. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-19042 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892982/HBASE-19042-v6.patch |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9205/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042-v6.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 

[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210593#comment-16210593
 ] 

Hadoop QA commented on HBASE-19042:
---

(!) A patch to the testing environment has been detected. 
Re-executing against the patched versions to perform further tests. 
The console is at 
https://builds.apache.org/job/PreCommit-HBASE-Build/9205/console in case of 
problems.


> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042-v6.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Duo Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-19042:
--
Attachment: HBASE-19042-v6.patch

Remove the sudo... Add pip install wheel.

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042-v6.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210584#comment-16210584
 ] 

Hadoop QA commented on HBASE-19042:
---

(!) A patch to the testing environment has been detected. 
Re-executing against the patched versions to perform further tests. 
The console is at 
https://builds.apache.org/job/PreCommit-HBASE-Build/9204/console in case of 
problems.


> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210585#comment-16210585
 ] 

Hadoop QA commented on HBASE-19042:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red}  0m  
1s{color} | {color:red} Docker failed to build yetus/hbase:5d60123. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-19042 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892979/HBASE-19042-v5.patch |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9204/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 

[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Duo Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210578#comment-16210578
 ] 

Duo Zhang commented on HBASE-19042:
---

Let's see the next result first.

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Peter Somogyi (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210577#comment-16210577
 ] 

Peter Somogyi commented on HBASE-19042:
---

[~Apache9], in the previous run there was another error as well but the build 
did not fail there. Do you think it is critical?
We might need to install wheel module as well.

{code}
21:23:29 Collecting wrapt (from astroid>=1.5.1->pylint)
21:23:29   Downloading wrapt-1.10.11.tar.gz
21:23:29 Building wheels for collected packages: configparser, wrapt
21:23:29   Running setup.py bdist_wheel for configparser: started
21:23:29   Running setup.py bdist_wheel for configparser: finished with status 
'error'
21:23:29   Complete output from command /usr/bin/python -u -c "import 
setuptools, 
tokenize;__file__='/tmp/pip-build-VcYD_V/configparser/setup.py';exec(compile(getattr(tokenize,
 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" 
bdist_wheel -d /tmp/tmpbpy_m9pip-wheel- --python-tag cp27:
21:23:29   usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
21:23:29  or: -c --help [cmd1 cmd2 ...]
21:23:29  or: -c --help-commands
21:23:29  or: -c cmd --help
21:23:29   
21:23:29   error: invalid command 'bdist_wheel'
21:23:29   
21:23:29   
21:23:29   Failed building wheel for configparser
21:23:29   Running setup.py clean for configparser
21:23:29   Running setup.py bdist_wheel for wrapt: started
21:23:29   Running setup.py bdist_wheel for wrapt: finished with status 'error'
21:23:29   Complete output from command /usr/bin/python -u -c "import 
setuptools, 
tokenize;__file__='/tmp/pip-build-VcYD_V/wrapt/setup.py';exec(compile(getattr(tokenize,
 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" 
bdist_wheel -d /tmp/tmpT0XxsKpip-wheel- --python-tag cp27:
21:23:29   usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
21:23:29  or: -c --help [cmd1 cmd2 ...]
21:23:29  or: -c --help-commands
21:23:29  or: -c cmd --help
21:23:29   
21:23:29   error: invalid command 'bdist_wheel'
21:23:29   
21:23:29   
21:23:29   Failed building wheel for wrapt
21:23:29   Running setup.py clean for wrapt
21:23:29 Failed to build configparser wrapt
{code}
https://builds.apache.org/job/PreCommit-HBASE-Build/9201/consoleFull

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  

[jira] [Commented] (HBASE-19007) Align Services Interfaces in Master and RegionServer

2017-10-18 Thread ramkrishna.s.vasudevan (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210570#comment-16210570
 ] 

ramkrishna.s.vasudevan commented on HBASE-19007:


If I get some time today will check this latest patch just to get an idea. If 
not pls go ahead with commit if you have a +1. Thanks.

> Align Services Interfaces in Master and RegionServer
> 
>
> Key: HBASE-19007
> URL: https://issues.apache.org/jira/browse/HBASE-19007
> Project: HBase
>  Issue Type: Task
>Reporter: stack
>Assignee: stack
>Priority: Blocker
>  Labels: coprocessor
> Fix For: 2.0.0-alpha-4
>
> Attachments: HBASE-19007.master.001.patch, 
> HBASE-19007.master.002.patch, HBASE-19007.master.003.patch, 
> HBASE-19007.master.004.patch, HBASE-19007.master.005.patch, 
> HBASE-19007.master.006.patch
>
>
> HBASE-18183 adds a CoprocessorRegionServerService to give a view on 
> RegionServiceServices that is safe to expose to Coprocessors.
> On the Master-side, MasterServices becomes an Interface for exposing to 
> Coprocessors.
> We need to align the two.
> For background, see 
> https://issues.apache.org/jira/browse/HBASE-12260?focusedCommentId=16203820=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16203820
>  



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-18961) doMiniBatchMutate() is big, split it into smaller methods

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-18961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210565#comment-16210565
 ] 

Hadoop QA commented on HBASE-18961:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red}  0m 
19s{color} | {color:red} Docker failed to build yetus/hbase:5d60123. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-18961 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892978/hbase-18961.master.001.patch
 |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9202/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> doMiniBatchMutate() is big, split it into smaller methods
> -
>
> Key: HBASE-18961
> URL: https://issues.apache.org/jira/browse/HBASE-18961
> Project: HBase
>  Issue Type: Sub-task
>  Components: regionserver
>Affects Versions: 2.0.0-alpha-3
>Reporter: Umesh Agashe
>Assignee: Umesh Agashe
> Fix For: 2.0.0-beta-1
>
> Attachments: hbase-18961.master.001.patch, 
> hbase-18961.master.001.patch
>
>
> Split doMiniBatchMutate() and improve readability.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Duo Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-19042:
--
Attachment: HBASE-19042-v5.patch

For ruby.

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042-v5.patch, 
> HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-18984) [AMv2] Retain assignment does not work well in AMv2

2017-10-18 Thread ramkrishna.s.vasudevan (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-18984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210573#comment-16210573
 ] 

ramkrishna.s.vasudevan commented on HBASE-18984:


{code}
// No need to update meta here, and this is the only place we set regionNode as 
OPENING
1438  // If master crashed before #markRegionAsOpened() (where we set 
region as OPEN in meta)
1439  // And after master is restarted, this region maybe reloaded and 
assigned when master do bulk assign.
1440  // So there are might be 2 AssignProcedures for this region. One 
is created by master when bulk
1441  // assign, the other is the one failed before master crashed. But 
there can only be one
1442  // AssignProcedure per region running at a time since each 
procedure takes a lock on the region.
1443  // No matter which one AssignProcedure succeed, the the other 
will fail, and wont affect others.
{code}
I have not fully checked the flow because of this impact. But before I could 
just asking - so you have now not updating the META with OPENING state. So the 
code that was working by reading the META and checking this OPENING state has 
been removed now? I mean here in the comment you talk about master going down  
but what about the RS going down while OPENING? Yes I agree that in that case 
anyway a new node has to be assigned for the region. Will check the patch and 
the flow and will be back here.

> [AMv2] Retain assignment does not work well in AMv2
> ---
>
> Key: HBASE-18984
> URL: https://issues.apache.org/jira/browse/HBASE-18984
> Project: HBase
>  Issue Type: Bug
>  Components: proc-v2
>Affects Versions: 2.0.0
>Reporter: Yi Liang
>Assignee: Yi Liang
> Fix For: 2.0.0
>
> Attachments: HBASE-18984-V1-master.patch, Screen Shot 2017-10-10 at 
> 2.24.19 PM.png
>
>
> work on 8.17 Retain assignment in 
> https://docs.google.com/document/d/1eVKa7FHdeoJ1-9o8yZcOTAQbv0u0bblBlCCzVSIn69g/edit#heading=h.epjn9nege80k
> To reproduce this error, in hbase shell:
> createTable t1 --> list_regions 't1' --> disable 't1' ---> enable 't1' --> 
> list_reigons 't1' (maybe you need to try enable/disable multiple times)
> See attached images. same region assigned to different region servers



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-15631) Backport Regionserver Groups (HBASE-6721) to branch-1

2017-10-18 Thread Lars Hofhansl (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210569#comment-16210569
 ] 

Lars Hofhansl commented on HBASE-15631:
---

I see that {{randomAssignment}} is overridden in {{RSGroupBasedLoadBalancer}}, 
so it might be relevant, ... hard to say without studying the complete patch. 
I'll do that.


> Backport Regionserver Groups (HBASE-6721) to branch-1 
> --
>
> Key: HBASE-15631
> URL: https://issues.apache.org/jira/browse/HBASE-15631
> Project: HBase
>  Issue Type: New Feature
>Affects Versions: 1.4.0
>Reporter: Francis Liu
>Assignee: Andrew Purtell
> Fix For: 1.4.0, 1.5.0
>
> Attachments: HBASE-15631-branch-1.patch, HBASE-15631-branch-1.patch, 
> HBASE-15631.branch-1.patch, HBASE-15631.patch
>
>
> Based on dev list discussion backporting region server group should not be an 
> issue as it does not: 1. destabilize the code. 2. cause backward 
> incompatibility. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19043) Purge TableWrapper and CoprocessorHConnnection

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210566#comment-16210566
 ] 

Hadoop QA commented on HBASE-19043:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red}  0m 
18s{color} | {color:red} Docker failed to build yetus/hbase:5d60123. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-19043 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892977/HBASE-19043.master.001.patch
 |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9203/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> Purge TableWrapper and CoprocessorHConnnection
> --
>
> Key: HBASE-19043
> URL: https://issues.apache.org/jira/browse/HBASE-19043
> Project: HBase
>  Issue Type: Task
>  Components: Coprocessors
>Reporter: stack
>Assignee: stack
> Fix For: 2.0.0-alpha-4
>
> Attachments: HBASE-19043.master.001.patch
>
>
> Repeating note from dev list today which had assent from [~apurtell] and 
> [~appy]:
> {code}
> Subject: [DISCUSS] Punt the Coprocessor TableWrapper and 
> CoprocessorHConnection?
> To: HBase Dev List 
> tl;dr I believe the original intent for TableWrapper and
> CoprocessorHConnection can now be gotten elsewhere so we should purge these
> classes.
> In base CoprocessorEnvironment, there are methods to return a Table
> instance. There are none to return an Admin. In our code base, the only
> user is the AccessController. Phoenix uses it twice in its Indexer
> implementation.
> When you call CE#getTable, the default implementation in
> BaseEnvironemnt calls HTableWrapper.createWrapper which takes a
> BaseEnvironment List in which we keep all Table instances. On shutdown of
> the coprocessor, the list is iterated and all tables are closed.
> Going via TableWrapper, the class comment says:
> * A wrapper for HTable. Can be used to restrict privilege.
> *
> * Currently it just helps to track tables opened by a Coprocessor and
> * facilitate close of them if it is aborted.
> *
> * We also disallow row locking.
> *
> * There is nothing now that will stop a coprocessor from using HTable
> * objects directly instead of this API, but in the future we intend to
> * analyze coprocessor implementations as they are loaded and reject those
> * which attempt to use objects and methods outside the Environment
> * sandbox.
> TableWrapper by my reading delegates all calls to a Table instance with no
> interception (there is not rowlocking to override anymore). On open, we do
> ensure the Table is up on a CoprocessorHConnection which does the following:
> * Connection to an HTable from within a Coprocessor. We can do some
> nice tricks since we know we
> * are on a regionserver, for instance skipping the full
> serialization/deserialization of objects
> * when talking to the server.
> The above 'trick' is now commonplace in servers as the Master and
> RegionServer always make Connections that will short-circuit if an
> opportunity.
> As I read TableWrapper and CoprocessorHConnection, they were written at
> another time when Table construction was heavyweight and Table#close was
> not expected of clients and before the introduction of the general
> Server-side short-circuit Connection facility.
> Unless objection, I think we should purge them.
> Writing here in case I'm missing some key facility they provide.
> {code}
> See 
> http://search-hadoop.com/m/HBase/YGbb8uCtg26VkBy?subj=+DISCUSS+Punt+the+Coprocessor+TableWrapper+and+CoprocessorHConnection+
> This issue is about removing these classes.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-17958) Avoid passing unexpected cell to ScanQueryMatcher when optimize SEEK to SKIP

2017-10-18 Thread Lars Hofhansl (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-17958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210563#comment-16210563
 ] 

Lars Hofhansl commented on HBASE-17958:
---

bq. sad thing is that, the indexed key could be changed if you call heap.next...

That is true, but it only means we're losing out on another chance for this 
optimization. The next indexed key will never go backwards, right? I think 
losing that is acceptable compared to the extra compare for each single KV. 
Doing the identity comparison that you mention is also a good idea.

Anyway, doing this in StoreFileScanner is better I think.

Thanks for humoring me here :)

> Avoid passing unexpected cell to ScanQueryMatcher when optimize SEEK to SKIP
> 
>
> Key: HBASE-17958
> URL: https://issues.apache.org/jira/browse/HBASE-17958
> Project: HBase
>  Issue Type: Bug
>Reporter: Guanghao Zhang
>Assignee: Guanghao Zhang
> Fix For: 2.0.0, 1.4.0
>
> Attachments: 0001-add-one-ut-testWithColumnCountGetFilter.patch, 
> 17958-add.txt, HBASE-17958-branch-1.patch, HBASE-17958-branch-1.patch, 
> HBASE-17958-branch-1.patch, HBASE-17958-branch-1.patch, HBASE-17958-v1.patch, 
> HBASE-17958-v2.patch, HBASE-17958-v3.patch, HBASE-17958-v4.patch, 
> HBASE-17958-v5.patch, HBASE-17958-v6.patch, HBASE-17958-v7.patch, 
> HBASE-17958-v7.patch
>
>
> {code}
> ScanQueryMatcher.MatchCode qcode = matcher.match(cell);
> qcode = optimize(qcode, cell);
> {code}
> The optimize method may change the MatchCode from SEEK_NEXT_COL/SEEK_NEXT_ROW 
> to SKIP. But it still pass the next cell to ScanQueryMatcher. It will get 
> wrong result when use some filter, etc. ColumnCountGetFilter. It just count 
> the  columns's number. If pass a same column to this filter, the count result 
> will be wrong. So we should avoid passing cell to ScanQueryMatcher when 
> optimize SEEK to SKIP.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-18945) Make a IA.LimitedPrivate interface for CellComparator

2017-10-18 Thread ramkrishna.s.vasudevan (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-18945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210562#comment-16210562
 ] 

ramkrishna.s.vasudevan commented on HBASE-18945:


[~saint@gmail.com]
You are good with this release note here?

> Make a IA.LimitedPrivate interface for CellComparator
> -
>
> Key: HBASE-18945
> URL: https://issues.apache.org/jira/browse/HBASE-18945
> Project: HBase
>  Issue Type: Sub-task
>Reporter: ramkrishna.s.vasudevan
>Assignee: ramkrishna.s.vasudevan
> Fix For: 2.0.0-alpha-4
>
> Attachments: 18945-addendum-branch-2.txt, HBASE-18495.patch, 
> HBASE-18945_2.patch, HBASE-18945_3.patch, HBASE-18945_4.patch, 
> HBASE-18945_5.patch, HBASE-18945_6.patch, HBASE-18945_6.patch, 
> HBASE-18945_7.patch
>
>
> Based on discussions over in HBASE-18826 and HBASE-18183 it is better we 
> expose CellComparator as a public interface so that it could be used in 
> Region/Store interfaces to be exposed to CPs.
> Currently the Comparator is exposed in Region, STore and StoreFile. There is 
> another discussion whether to expose it at all layers or only at Region. 
> However since we are exposing this to CPs CellComparator being @Private is 
> not the ideal way to do it. We have to change it to LimitedPrivate. But 
> CellComparator has lot of additional methods which are internal (like where a 
> Cell is compared with an incoming byte[] used in index comparsions etc).
> One way to expose is that as being done now in HBASE-18826 - by exposing the 
> return type as Comparator. But this is not powerful. It only allows to 
> compare cells. So we try to expose an IA.LimitedPrivate interface that is 
> more powerful and allows comparing individual cell components also. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18945) Make a IA.LimitedPrivate interface for CellComparator

2017-10-18 Thread ramkrishna.s.vasudevan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ramkrishna.s.vasudevan updated HBASE-18945:
---
Release Note: 
CellCompartor has been added as an interface with IA.LimitedPrivate. It has the 
following methods
#int compare(Cell leftCell, Cell rightCell);
#int compareRows(Cell leftCell, Cell rightCell)
#int compareRows(Cell cell, byte[] bytes, int offset, int length)
#int compareWithoutRow(Cell leftCell, Cell rightCell)
#int compareFamilies(Cell leftCell, Cell rightCell
#int compareQualifiers(Cell leftCell, Cell rightCell)
#int compareTimestamps(Cell leftCell, Cell rightCell)
#int compareTimestamps(long leftCellts, long rightCellts)

This is exposed to CPs and CPs can make use of the above methods to do 
comparisons on the cells.
For internal usage we have CellComparatorImpl and it has static references to 
COMPARATOR and META_CELL_COMPARATOR.
So when a region or store is initialized we should use one of the above 
comparator. For META table we need the META_CELL_COMPARATOR and all other 
table's  regions/stores will use the COMPARTOR.
While writing the comparator name in FixedFileTrailer of the Hfile we have now 
ensured that this rename of 
CellComparator.COMPARATOR/CellComparator.META_CELL_COMPARATOR to 
CellComparatorImpl.COMPARATOR/CellComparatorImpl.META_CELL_COMPARATOR is 
handled.

CellUtils is an util method that provides lot of APIs that helps to do compare, 
matching functionalities between two cells, or with a cell and a corrpesponding 
byte[] etc. Some of the APIs are internally used which will be cleaned up in a 
follow on JIRA HBASE-18995.

> Make a IA.LimitedPrivate interface for CellComparator
> -
>
> Key: HBASE-18945
> URL: https://issues.apache.org/jira/browse/HBASE-18945
> Project: HBase
>  Issue Type: Sub-task
>Reporter: ramkrishna.s.vasudevan
>Assignee: ramkrishna.s.vasudevan
> Fix For: 2.0.0-alpha-4
>
> Attachments: 18945-addendum-branch-2.txt, HBASE-18495.patch, 
> HBASE-18945_2.patch, HBASE-18945_3.patch, HBASE-18945_4.patch, 
> HBASE-18945_5.patch, HBASE-18945_6.patch, HBASE-18945_6.patch, 
> HBASE-18945_7.patch
>
>
> Based on discussions over in HBASE-18826 and HBASE-18183 it is better we 
> expose CellComparator as a public interface so that it could be used in 
> Region/Store interfaces to be exposed to CPs.
> Currently the Comparator is exposed in Region, STore and StoreFile. There is 
> another discussion whether to expose it at all layers or only at Region. 
> However since we are exposing this to CPs CellComparator being @Private is 
> not the ideal way to do it. We have to change it to LimitedPrivate. But 
> CellComparator has lot of additional methods which are internal (like where a 
> Cell is compared with an incoming byte[] used in index comparsions etc).
> One way to expose is that as being done now in HBASE-18826 - by exposing the 
> return type as Comparator. But this is not powerful. It only allows to 
> compare cells. So we try to expose an IA.LimitedPrivate interface that is 
> more powerful and allows comparing individual cell components also. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18961) doMiniBatchMutate() is big, split it into smaller methods

2017-10-18 Thread Umesh Agashe (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Umesh Agashe updated HBASE-18961:
-
Attachment: hbase-18961.master.001.patch

retry

> doMiniBatchMutate() is big, split it into smaller methods
> -
>
> Key: HBASE-18961
> URL: https://issues.apache.org/jira/browse/HBASE-18961
> Project: HBase
>  Issue Type: Sub-task
>  Components: regionserver
>Affects Versions: 2.0.0-alpha-3
>Reporter: Umesh Agashe
>Assignee: Umesh Agashe
> Fix For: 2.0.0-beta-1
>
> Attachments: hbase-18961.master.001.patch, 
> hbase-18961.master.001.patch
>
>
> Split doMiniBatchMutate() and improve readability.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Assigned] (HBASE-18770) Remove bypass method in ObserverContext and implement the 'bypass' logic case by case

2017-10-18 Thread stack (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack reassigned HBASE-18770:
-

Assignee: stack

> Remove bypass method in ObserverContext and implement the 'bypass' logic case 
> by case
> -
>
> Key: HBASE-18770
> URL: https://issues.apache.org/jira/browse/HBASE-18770
> Project: HBase
>  Issue Type: Sub-task
>  Components: Coprocessors
>Reporter: Duo Zhang
>Assignee: stack
> Fix For: 2.0.0-alpha-4
>
>
> http://search-hadoop.com/m/HBase/YGbbXd0RDCIHSC1



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19043) Purge TableWrapper and CoprocessorHConnnection

2017-10-18 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210559#comment-16210559
 ] 

stack commented on HBASE-19043:
---

.001 is mostly removals.

> Purge TableWrapper and CoprocessorHConnnection
> --
>
> Key: HBASE-19043
> URL: https://issues.apache.org/jira/browse/HBASE-19043
> Project: HBase
>  Issue Type: Task
>  Components: Coprocessors
>Reporter: stack
>Assignee: stack
> Fix For: 2.0.0-alpha-4
>
> Attachments: HBASE-19043.master.001.patch
>
>
> Repeating note from dev list today which had assent from [~apurtell] and 
> [~appy]:
> {code}
> Subject: [DISCUSS] Punt the Coprocessor TableWrapper and 
> CoprocessorHConnection?
> To: HBase Dev List 
> tl;dr I believe the original intent for TableWrapper and
> CoprocessorHConnection can now be gotten elsewhere so we should purge these
> classes.
> In base CoprocessorEnvironment, there are methods to return a Table
> instance. There are none to return an Admin. In our code base, the only
> user is the AccessController. Phoenix uses it twice in its Indexer
> implementation.
> When you call CE#getTable, the default implementation in
> BaseEnvironemnt calls HTableWrapper.createWrapper which takes a
> BaseEnvironment List in which we keep all Table instances. On shutdown of
> the coprocessor, the list is iterated and all tables are closed.
> Going via TableWrapper, the class comment says:
> * A wrapper for HTable. Can be used to restrict privilege.
> *
> * Currently it just helps to track tables opened by a Coprocessor and
> * facilitate close of them if it is aborted.
> *
> * We also disallow row locking.
> *
> * There is nothing now that will stop a coprocessor from using HTable
> * objects directly instead of this API, but in the future we intend to
> * analyze coprocessor implementations as they are loaded and reject those
> * which attempt to use objects and methods outside the Environment
> * sandbox.
> TableWrapper by my reading delegates all calls to a Table instance with no
> interception (there is not rowlocking to override anymore). On open, we do
> ensure the Table is up on a CoprocessorHConnection which does the following:
> * Connection to an HTable from within a Coprocessor. We can do some
> nice tricks since we know we
> * are on a regionserver, for instance skipping the full
> serialization/deserialization of objects
> * when talking to the server.
> The above 'trick' is now commonplace in servers as the Master and
> RegionServer always make Connections that will short-circuit if an
> opportunity.
> As I read TableWrapper and CoprocessorHConnection, they were written at
> another time when Table construction was heavyweight and Table#close was
> not expected of clients and before the introduction of the general
> Server-side short-circuit Connection facility.
> Unless objection, I think we should purge them.
> Writing here in case I'm missing some key facility they provide.
> {code}
> See 
> http://search-hadoop.com/m/HBase/YGbb8uCtg26VkBy?subj=+DISCUSS+Punt+the+Coprocessor+TableWrapper+and+CoprocessorHConnection+
> This issue is about removing these classes.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-19043) Purge TableWrapper and CoprocessorHConnnection

2017-10-18 Thread stack (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-19043:
--
Status: Patch Available  (was: Open)

This patch should go in before HBASE-19007; it'll make that patch smaller.

> Purge TableWrapper and CoprocessorHConnnection
> --
>
> Key: HBASE-19043
> URL: https://issues.apache.org/jira/browse/HBASE-19043
> Project: HBase
>  Issue Type: Task
>  Components: Coprocessors
>Reporter: stack
>Assignee: stack
> Fix For: 2.0.0-alpha-4
>
> Attachments: HBASE-19043.master.001.patch
>
>
> Repeating note from dev list today which had assent from [~apurtell] and 
> [~appy]:
> {code}
> Subject: [DISCUSS] Punt the Coprocessor TableWrapper and 
> CoprocessorHConnection?
> To: HBase Dev List 
> tl;dr I believe the original intent for TableWrapper and
> CoprocessorHConnection can now be gotten elsewhere so we should purge these
> classes.
> In base CoprocessorEnvironment, there are methods to return a Table
> instance. There are none to return an Admin. In our code base, the only
> user is the AccessController. Phoenix uses it twice in its Indexer
> implementation.
> When you call CE#getTable, the default implementation in
> BaseEnvironemnt calls HTableWrapper.createWrapper which takes a
> BaseEnvironment List in which we keep all Table instances. On shutdown of
> the coprocessor, the list is iterated and all tables are closed.
> Going via TableWrapper, the class comment says:
> * A wrapper for HTable. Can be used to restrict privilege.
> *
> * Currently it just helps to track tables opened by a Coprocessor and
> * facilitate close of them if it is aborted.
> *
> * We also disallow row locking.
> *
> * There is nothing now that will stop a coprocessor from using HTable
> * objects directly instead of this API, but in the future we intend to
> * analyze coprocessor implementations as they are loaded and reject those
> * which attempt to use objects and methods outside the Environment
> * sandbox.
> TableWrapper by my reading delegates all calls to a Table instance with no
> interception (there is not rowlocking to override anymore). On open, we do
> ensure the Table is up on a CoprocessorHConnection which does the following:
> * Connection to an HTable from within a Coprocessor. We can do some
> nice tricks since we know we
> * are on a regionserver, for instance skipping the full
> serialization/deserialization of objects
> * when talking to the server.
> The above 'trick' is now commonplace in servers as the Master and
> RegionServer always make Connections that will short-circuit if an
> opportunity.
> As I read TableWrapper and CoprocessorHConnection, they were written at
> another time when Table construction was heavyweight and Table#close was
> not expected of clients and before the introduction of the general
> Server-side short-circuit Connection facility.
> Unless objection, I think we should purge them.
> Writing here in case I'm missing some key facility they provide.
> {code}
> See 
> http://search-hadoop.com/m/HBase/YGbb8uCtg26VkBy?subj=+DISCUSS+Punt+the+Coprocessor+TableWrapper+and+CoprocessorHConnection+
> This issue is about removing these classes.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-17958) Avoid passing unexpected cell to ScanQueryMatcher when optimize SEEK to SKIP

2017-10-18 Thread Lars Hofhansl (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-17958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210558#comment-16210558
 ] 

Lars Hofhansl commented on HBASE-17958:
---

bq. How about we move optimize SEEK to SKIP to storefile scanner?

Good idea. I like that.

> Avoid passing unexpected cell to ScanQueryMatcher when optimize SEEK to SKIP
> 
>
> Key: HBASE-17958
> URL: https://issues.apache.org/jira/browse/HBASE-17958
> Project: HBase
>  Issue Type: Bug
>Reporter: Guanghao Zhang
>Assignee: Guanghao Zhang
> Fix For: 2.0.0, 1.4.0
>
> Attachments: 0001-add-one-ut-testWithColumnCountGetFilter.patch, 
> 17958-add.txt, HBASE-17958-branch-1.patch, HBASE-17958-branch-1.patch, 
> HBASE-17958-branch-1.patch, HBASE-17958-branch-1.patch, HBASE-17958-v1.patch, 
> HBASE-17958-v2.patch, HBASE-17958-v3.patch, HBASE-17958-v4.patch, 
> HBASE-17958-v5.patch, HBASE-17958-v6.patch, HBASE-17958-v7.patch, 
> HBASE-17958-v7.patch
>
>
> {code}
> ScanQueryMatcher.MatchCode qcode = matcher.match(cell);
> qcode = optimize(qcode, cell);
> {code}
> The optimize method may change the MatchCode from SEEK_NEXT_COL/SEEK_NEXT_ROW 
> to SKIP. But it still pass the next cell to ScanQueryMatcher. It will get 
> wrong result when use some filter, etc. ColumnCountGetFilter. It just count 
> the  columns's number. If pass a same column to this filter, the count result 
> will be wrong. So we should avoid passing cell to ScanQueryMatcher when 
> optimize SEEK to SKIP.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-19043) Purge TableWrapper and CoprocessorHConnnection

2017-10-18 Thread stack (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-19043:
--
Attachment: HBASE-19043.master.001.patch

> Purge TableWrapper and CoprocessorHConnnection
> --
>
> Key: HBASE-19043
> URL: https://issues.apache.org/jira/browse/HBASE-19043
> Project: HBase
>  Issue Type: Task
>  Components: Coprocessors
>Reporter: stack
>Assignee: stack
> Fix For: 2.0.0-alpha-4
>
> Attachments: HBASE-19043.master.001.patch
>
>
> Repeating note from dev list today which had assent from [~apurtell] and 
> [~appy]:
> {code}
> Subject: [DISCUSS] Punt the Coprocessor TableWrapper and 
> CoprocessorHConnection?
> To: HBase Dev List 
> tl;dr I believe the original intent for TableWrapper and
> CoprocessorHConnection can now be gotten elsewhere so we should purge these
> classes.
> In base CoprocessorEnvironment, there are methods to return a Table
> instance. There are none to return an Admin. In our code base, the only
> user is the AccessController. Phoenix uses it twice in its Indexer
> implementation.
> When you call CE#getTable, the default implementation in
> BaseEnvironemnt calls HTableWrapper.createWrapper which takes a
> BaseEnvironment List in which we keep all Table instances. On shutdown of
> the coprocessor, the list is iterated and all tables are closed.
> Going via TableWrapper, the class comment says:
> * A wrapper for HTable. Can be used to restrict privilege.
> *
> * Currently it just helps to track tables opened by a Coprocessor and
> * facilitate close of them if it is aborted.
> *
> * We also disallow row locking.
> *
> * There is nothing now that will stop a coprocessor from using HTable
> * objects directly instead of this API, but in the future we intend to
> * analyze coprocessor implementations as they are loaded and reject those
> * which attempt to use objects and methods outside the Environment
> * sandbox.
> TableWrapper by my reading delegates all calls to a Table instance with no
> interception (there is not rowlocking to override anymore). On open, we do
> ensure the Table is up on a CoprocessorHConnection which does the following:
> * Connection to an HTable from within a Coprocessor. We can do some
> nice tricks since we know we
> * are on a regionserver, for instance skipping the full
> serialization/deserialization of objects
> * when talking to the server.
> The above 'trick' is now commonplace in servers as the Master and
> RegionServer always make Connections that will short-circuit if an
> opportunity.
> As I read TableWrapper and CoprocessorHConnection, they were written at
> another time when Table construction was heavyweight and Table#close was
> not expected of clients and before the introduction of the general
> Server-side short-circuit Connection facility.
> Unless objection, I think we should purge them.
> Writing here in case I'm missing some key facility they provide.
> {code}
> See 
> http://search-hadoop.com/m/HBase/YGbb8uCtg26VkBy?subj=+DISCUSS+Punt+the+Coprocessor+TableWrapper+and+CoprocessorHConnection+
> This issue is about removing these classes.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-18945) Make a IA.LimitedPrivate interface for CellComparator

2017-10-18 Thread ramkrishna.s.vasudevan (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-18945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210553#comment-16210553
 ] 

ramkrishna.s.vasudevan commented on HBASE-18945:


[~tedyu]
Thanks for the addendum. I was away the whole day and did not have access to my 
laptop. Sorry for the trouble.
bq.I took a look at the patch. Seems good. What is the philosophy regards when 
CellComparator vs CellComparatorImpl vs CellUtils? Can you stick it in release 
note?
Yes will do it.
We already have CellUtil clean up JIRa - HBASE-18995.
bq.Main concern is that we have different CellComparator implemenations – one 
for Meta Table Rows and another for user-table Rows – and you have to use the 
right one else you get wonky results. Seems like you are doing right thing but 
just checking.
Yes it has been taken care of . Generally the REgion and Store uses the 
CellComparator and that is where we will get MetaCellcomparator and the generic 
comparator. That place works as usual and infact we are continuing with 
CellComparator only as a reference. 
In the layers of ColumnTrackers there we are passing 
CellComparatorImpl.COMPARATOR because there is no rows involved. But 
[~chia7712] has raised another issue to continue with CellComparator that is 
passed from ScanInfo so that we don't have this static references as far as 
possible.

> Make a IA.LimitedPrivate interface for CellComparator
> -
>
> Key: HBASE-18945
> URL: https://issues.apache.org/jira/browse/HBASE-18945
> Project: HBase
>  Issue Type: Sub-task
>Reporter: ramkrishna.s.vasudevan
>Assignee: ramkrishna.s.vasudevan
> Fix For: 2.0.0-alpha-4
>
> Attachments: 18945-addendum-branch-2.txt, HBASE-18495.patch, 
> HBASE-18945_2.patch, HBASE-18945_3.patch, HBASE-18945_4.patch, 
> HBASE-18945_5.patch, HBASE-18945_6.patch, HBASE-18945_6.patch, 
> HBASE-18945_7.patch
>
>
> Based on discussions over in HBASE-18826 and HBASE-18183 it is better we 
> expose CellComparator as a public interface so that it could be used in 
> Region/Store interfaces to be exposed to CPs.
> Currently the Comparator is exposed in Region, STore and StoreFile. There is 
> another discussion whether to expose it at all layers or only at Region. 
> However since we are exposing this to CPs CellComparator being @Private is 
> not the ideal way to do it. We have to change it to LimitedPrivate. But 
> CellComparator has lot of additional methods which are internal (like where a 
> Cell is compared with an incoming byte[] used in index comparsions etc).
> One way to expose is that as being done now in HBASE-18826 - by exposing the 
> return type as Comparator. But this is not powerful. It only allows to 
> compare cells. So we try to expose an IA.LimitedPrivate interface that is 
> more powerful and allows comparing individual cell components also. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210548#comment-16210548
 ] 

Hadoop QA commented on HBASE-19042:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red} 12m  
0s{color} | {color:red} Docker failed to build yetus/hbase:5d60123. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-19042 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892975/HBASE-19042-v4.patch |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9201/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 

[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210547#comment-16210547
 ] 

Hadoop QA commented on HBASE-19042:
---

(!) A patch to the testing environment has been detected. 
Re-executing against the patched versions to perform further tests. 
The console is at 
https://builds.apache.org/job/PreCommit-HBASE-Build/9201/console in case of 
problems.


> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (HBASE-19043) Purge TableWrapper and CoprocessorHConnnection

2017-10-18 Thread stack (JIRA)
stack created HBASE-19043:
-

 Summary: Purge TableWrapper and CoprocessorHConnnection
 Key: HBASE-19043
 URL: https://issues.apache.org/jira/browse/HBASE-19043
 Project: HBase
  Issue Type: Task
  Components: Coprocessors
Reporter: stack
Assignee: stack
 Fix For: 2.0.0-alpha-4


Repeating note from dev list today which had assent from [~apurtell] and 
[~appy]:

{code}
Subject: [DISCUSS] Punt the Coprocessor TableWrapper and CoprocessorHConnection?
To: HBase Dev List 

tl;dr I believe the original intent for TableWrapper and
CoprocessorHConnection can now be gotten elsewhere so we should purge these
classes.

In base CoprocessorEnvironment, there are methods to return a Table
instance. There are none to return an Admin. In our code base, the only
user is the AccessController. Phoenix uses it twice in its Indexer
implementation.

When you call CE#getTable, the default implementation in
BaseEnvironemnt calls HTableWrapper.createWrapper which takes a
BaseEnvironment List in which we keep all Table instances. On shutdown of
the coprocessor, the list is iterated and all tables are closed.

Going via TableWrapper, the class comment says:

* A wrapper for HTable. Can be used to restrict privilege.
*
* Currently it just helps to track tables opened by a Coprocessor and
* facilitate close of them if it is aborted.
*
* We also disallow row locking.
*
* There is nothing now that will stop a coprocessor from using HTable
* objects directly instead of this API, but in the future we intend to
* analyze coprocessor implementations as they are loaded and reject those
* which attempt to use objects and methods outside the Environment
* sandbox.


TableWrapper by my reading delegates all calls to a Table instance with no
interception (there is not rowlocking to override anymore). On open, we do
ensure the Table is up on a CoprocessorHConnection which does the following:

* Connection to an HTable from within a Coprocessor. We can do some
nice tricks since we know we
* are on a regionserver, for instance skipping the full
serialization/deserialization of objects
* when talking to the server.


The above 'trick' is now commonplace in servers as the Master and
RegionServer always make Connections that will short-circuit if an
opportunity.

As I read TableWrapper and CoprocessorHConnection, they were written at
another time when Table construction was heavyweight and Table#close was
not expected of clients and before the introduction of the general
Server-side short-circuit Connection facility.

Unless objection, I think we should purge them.

Writing here in case I'm missing some key facility they provide.

{code}

See 
http://search-hadoop.com/m/HBase/YGbb8uCtg26VkBy?subj=+DISCUSS+Punt+the+Coprocessor+TableWrapper+and+CoprocessorHConnection+


This issue is about removing these classes.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Duo Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-19042:
--
Attachment: HBASE-19042-v4.patch

Closer...

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042-v4.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210543#comment-16210543
 ] 

Hadoop QA commented on HBASE-19042:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red} 10m 
18s{color} | {color:red} Docker failed to build yetus/hbase:5d60123. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-19042 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892973/HBASE-19042-v3.patch |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9200/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 

[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210535#comment-16210535
 ] 

Hadoop QA commented on HBASE-19042:
---

(!) A patch to the testing environment has been detected. 
Re-executing against the patched versions to perform further tests. 
The console is at 
https://builds.apache.org/job/PreCommit-HBASE-Build/9200/console in case of 
problems.


> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-18090) Improve TableSnapshotInputFormat to allow more multiple mappers per region

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-18090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210533#comment-16210533
 ] 

Hadoop QA commented on HBASE-18090:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red}  0m 
19s{color} | {color:red} Docker failed to build yetus/hbase:6f1cc2c. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-18090 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12890637/HBASE-18090.branch-1.patch
 |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9199/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> Improve TableSnapshotInputFormat to allow more multiple mappers per region
> --
>
> Key: HBASE-18090
> URL: https://issues.apache.org/jira/browse/HBASE-18090
> Project: HBase
>  Issue Type: Improvement
>  Components: mapreduce
>Reporter: Mikhail Antonov
>Assignee: xinxin fan
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-18090-V3-master.patch, 
> HBASE-18090-V4-master.patch, HBASE-18090-V5-master.patch, 
> HBASE-18090-branch-1.3-v1.patch, HBASE-18090-branch-1.3-v2.patch, 
> HBASE-18090.branch-1.patch
>
>
> TableSnapshotInputFormat runs one map task per region in the table snapshot. 
> This places unnecessary restriction that the region layout of the original 
> table needs to take the processing resources available to MR job into 
> consideration. Allowing to run multiple mappers per region (assuming 
> reasonably even key distribution) would be useful.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-18090) Improve TableSnapshotInputFormat to allow more multiple mappers per region

2017-10-18 Thread Ashu Pachauri (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-18090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210531#comment-16210531
 ] 

Ashu Pachauri commented on HBASE-18090:
---

[~xinxin fan] Sorry for the delay in response, I have been travelling. The link 
for the test results seems to have expired. Let me trigger a build again.

> Improve TableSnapshotInputFormat to allow more multiple mappers per region
> --
>
> Key: HBASE-18090
> URL: https://issues.apache.org/jira/browse/HBASE-18090
> Project: HBase
>  Issue Type: Improvement
>  Components: mapreduce
>Reporter: Mikhail Antonov
>Assignee: xinxin fan
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-18090-V3-master.patch, 
> HBASE-18090-V4-master.patch, HBASE-18090-V5-master.patch, 
> HBASE-18090-branch-1.3-v1.patch, HBASE-18090-branch-1.3-v2.patch, 
> HBASE-18090.branch-1.patch
>
>
> TableSnapshotInputFormat runs one map task per region in the table snapshot. 
> This places unnecessary restriction that the region layout of the original 
> table needs to take the processing resources available to MR job into 
> consideration. Allowing to run multiple mappers per region (assuming 
> reasonably even key distribution) would be useful.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18090) Improve TableSnapshotInputFormat to allow more multiple mappers per region

2017-10-18 Thread Ashu Pachauri (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashu Pachauri updated HBASE-18090:
--
Affects Version/s: (was: 3.0.0)

> Improve TableSnapshotInputFormat to allow more multiple mappers per region
> --
>
> Key: HBASE-18090
> URL: https://issues.apache.org/jira/browse/HBASE-18090
> Project: HBase
>  Issue Type: Improvement
>  Components: mapreduce
>Reporter: Mikhail Antonov
>Assignee: xinxin fan
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-18090-V3-master.patch, 
> HBASE-18090-V4-master.patch, HBASE-18090-V5-master.patch, 
> HBASE-18090-branch-1.3-v1.patch, HBASE-18090-branch-1.3-v2.patch, 
> HBASE-18090.branch-1.patch
>
>
> TableSnapshotInputFormat runs one map task per region in the table snapshot. 
> This places unnecessary restriction that the region layout of the original 
> table needs to take the processing resources available to MR job into 
> consideration. Allowing to run multiple mappers per region (assuming 
> reasonably even key distribution) would be useful.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Duo Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-19042:
--
Attachment: HBASE-19042-v3.patch

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042-v3.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Duo Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210528#comment-16210528
 ] 

Duo Zhang commented on HBASE-19042:
---

Seems I've removed too many stuffs...

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210526#comment-16210526
 ] 

Hadoop QA commented on HBASE-19042:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red} 12m  
0s{color} | {color:red} Docker failed to build yetus/hbase:5d60123. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-19042 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892972/HBASE-19042-v2.patch |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9198/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  

[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210525#comment-16210525
 ] 

Hadoop QA commented on HBASE-19042:
---

(!) A patch to the testing environment has been detected. 
Re-executing against the patched versions to perform further tests. 
The console is at 
https://builds.apache.org/job/PreCommit-HBASE-Build/9198/console in case of 
problems.


> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Duo Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-19042:
--
Attachment: HBASE-19042-v2.patch

Try upgrading to 16.04.

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042-v2.patch, 
> HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19010) Reimplement getMasterInfoPort for Admin

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210522#comment-16210522
 ] 

Hadoop QA commented on HBASE-19010:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red}  0m 
18s{color} | {color:red} Docker failed to build yetus/hbase:5d60123. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-19010 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892969/HBASE-19010.master.003.patch
 |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9197/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> Reimplement getMasterInfoPort for Admin
> ---
>
> Key: HBASE-19010
> URL: https://issues.apache.org/jira/browse/HBASE-19010
> Project: HBase
>  Issue Type: Sub-task
>  Components: Client
>Reporter: Guanghao Zhang
>Assignee: Guanghao Zhang
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-19010.master.001.patch, 
> HBASE-19010.master.002.patch, HBASE-19010.master.002.patch, 
> HBASE-19010.master.002.patch, HBASE-19010.master.002.patch, 
> HBASE-19010.master.003.patch
>
>
> Current implementation.
> {code}
>   public int getMasterInfoPort() throws IOException {
> // TODO: Fix!  Reaching into internal implementation
> ConnectionImplementation connection = 
> (ConnectionImplementation)this.connection;
> ZooKeeperKeepAliveConnection zkw = 
> connection.getKeepAliveZooKeeperWatcher();
> try {
>   return MasterAddressTracker.getMasterInfoPort(zkw);
> } catch (KeeperException e) {
>   throw new IOException("Failed to get master info port from 
> MasterAddressTracker", e);
> }
>   }
> {code}
> Open this issue to fix TODO.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210521#comment-16210521
 ] 

Hadoop QA commented on HBASE-19042:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red}  0m 
13s{color} | {color:red} Docker failed to build yetus/hbase:5d60123. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-19042 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892970/HBASE-19042-v1.patch |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9196/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 

[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210520#comment-16210520
 ] 

Hadoop QA commented on HBASE-19042:
---

(!) A patch to the testing environment has been detected. 
Re-executing against the patched versions to perform further tests. 
The console is at 
https://builds.apache.org/job/PreCommit-HBASE-Build/9196/console in case of 
problems.


> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19010) Reimplement getMasterInfoPort for Admin

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210515#comment-16210515
 ] 

Hadoop QA commented on HBASE-19010:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red}  0m 
19s{color} | {color:red} Docker failed to build yetus/hbase:5d60123. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-19010 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892969/HBASE-19010.master.003.patch
 |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9195/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> Reimplement getMasterInfoPort for Admin
> ---
>
> Key: HBASE-19010
> URL: https://issues.apache.org/jira/browse/HBASE-19010
> Project: HBase
>  Issue Type: Sub-task
>  Components: Client
>Reporter: Guanghao Zhang
>Assignee: Guanghao Zhang
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-19010.master.001.patch, 
> HBASE-19010.master.002.patch, HBASE-19010.master.002.patch, 
> HBASE-19010.master.002.patch, HBASE-19010.master.002.patch, 
> HBASE-19010.master.003.patch
>
>
> Current implementation.
> {code}
>   public int getMasterInfoPort() throws IOException {
> // TODO: Fix!  Reaching into internal implementation
> ConnectionImplementation connection = 
> (ConnectionImplementation)this.connection;
> ZooKeeperKeepAliveConnection zkw = 
> connection.getKeepAliveZooKeeperWatcher();
> try {
>   return MasterAddressTracker.getMasterInfoPort(zkw);
> } catch (KeeperException e) {
>   throw new IOException("Failed to get master info port from 
> MasterAddressTracker", e);
> }
>   }
> {code}
> Open this issue to fix TODO.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Mike Drob (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210514#comment-16210514
 ] 

Mike Drob commented on HBASE-19042:
---

+1 on master patch pending QA, [~Apache9]

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Duo Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-19042:
--
Attachment: HBASE-19042-v1.patch

Switch to use openjdk8.

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19014) surefire fails; When writing xml report stdout/stderr ... No such file or directory

2017-10-18 Thread Yu Li (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210504#comment-16210504
 ] 

Yu Li commented on HBASE-19014:
---

Pending HBASE-19042

> surefire fails; When writing xml report stdout/stderr ... No such file or 
> directory
> ---
>
> Key: HBASE-19014
> URL: https://issues.apache.org/jira/browse/HBASE-19014
> Project: HBase
>  Issue Type: Bug
>Reporter: Chia-Ping Tsai
>Assignee: Chia-Ping Tsai
> Fix For: 2.0.0, 1.4.0, 1.3.2, 1.5.0, 1.2.7
>
> Attachments: HBASE-19014.branch-1.v0.patch, 
> HBASE-19014.branch-1.v0.patch, HBASE-19014.v0.patch
>
>
> {code}
> 17:22:33 [ERROR] Failed to execute goal 
> org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test 
> (secondPartTestsExecution) on project hbase-server: ExecutionException: 
> java.lang.RuntimeException: java.lang.RuntimeException: 
> org.apache.maven.surefire.report.ReporterException: When writing xml report 
> stdout/stderr: /tmp/stderr1114622923250399196deferred (No such file or 
> directory) -> [Help 1]
> {code}
> It happens frequently on my jenkins...I update the surefire to 2.20.1, and 
> then the failure doesn't happen again. see SUREFIRE-1239.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Duo Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210510#comment-16210510
 ] 

Duo Zhang commented on HBASE-19042:
---

Let's see whether the pre commit job can build a docker image successfully and 
also the mvn install. If it works then I will upload patches for other branches.

Thanks.

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042-v1.patch, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-18233) We shouldn't wait for readlock in doMiniBatchMutation in case of deadlock

2017-10-18 Thread Yu Li (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-18233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210505#comment-16210505
 ] 

Yu Li commented on HBASE-18233:
---

Pending HBASE-19042

> We shouldn't wait for readlock in doMiniBatchMutation in case of deadlock
> -
>
> Key: HBASE-18233
> URL: https://issues.apache.org/jira/browse/HBASE-18233
> Project: HBase
>  Issue Type: Bug
>Affects Versions: 1.2.7
>Reporter: Allan Yang
>Assignee: Allan Yang
>Priority: Blocker
> Fix For: 2.0.0, 1.4.0, 1.3.2, 1.2.7
>
> Attachments: HBASE-18233-branch-1.2.patch, 
> HBASE-18233-branch-1.2.v2.patch, HBASE-18233-branch-1.2.v3.patch, 
> HBASE-18233-branch-1.2.v4 (1).patch, HBASE-18233-branch-1.2.v4 (1).patch, 
> HBASE-18233-branch-1.2.v4.patch, HBASE-18233-branch-1.2.v4.patch, 
> HBASE-18233-branch-1.2.v4.patch, HBASE-18233-branch-1.2.v4.patch, 
> HBASE-18233-branch-1.2.v4.patch, HBASE-18233-branch-1.2.v4.patch
>
>
> Please refer to the discuss in HBASE-18144
> https://issues.apache.org/jira/browse/HBASE-18144?focusedCommentId=16051701=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16051701



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Mike Drob (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210500#comment-16210500
 ] 

Mike Drob commented on HBASE-19042:
---

Sounds good. If it worked the first time I would have said to make the big 
jump, but since it didn't let's get the quick fix in. [~Apache9] [~psomogyi] do 
either of you want to take this over and put up a patch? It is getting pretty 
late in my timezone, but I will be happy to review anything in the morning.

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-17852) Add Fault tolerance to HBASE-14417 (Support bulk loaded files in incremental backup)

2017-10-18 Thread Ted Yu (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-17852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210497#comment-16210497
 ] 

Ted Yu commented on HBASE-17852:


Can you put patch v1 on review board, followed by patch v2 ?
This way, it is easier to see the changes.

> Add Fault tolerance to HBASE-14417 (Support bulk loaded files in incremental 
> backup)
> 
>
> Key: HBASE-17852
> URL: https://issues.apache.org/jira/browse/HBASE-17852
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-17852-v1.patch, HBASE-17852-v2.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Duo Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210496#comment-16210496
 ] 

Duo Zhang commented on HBASE-19042:
---

Let's change to use openjdk 8 first to fix the pre commit? We can open another 
issue to simplify the docker image. [~mdrob]

Thanks.

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-19010) Reimplement getMasterInfoPort for Admin

2017-10-18 Thread Guanghao Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guanghao Zhang updated HBASE-19010:
---
Attachment: HBASE-19010.master.003.patch

Attach a 003 patch to address [~chia7712]'s review comment. Seems it missed 
clusterId in equals and hashcode method, too. Add it back.

> Reimplement getMasterInfoPort for Admin
> ---
>
> Key: HBASE-19010
> URL: https://issues.apache.org/jira/browse/HBASE-19010
> Project: HBase
>  Issue Type: Sub-task
>  Components: Client
>Reporter: Guanghao Zhang
>Assignee: Guanghao Zhang
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-19010.master.001.patch, 
> HBASE-19010.master.002.patch, HBASE-19010.master.002.patch, 
> HBASE-19010.master.002.patch, HBASE-19010.master.002.patch, 
> HBASE-19010.master.003.patch
>
>
> Current implementation.
> {code}
>   public int getMasterInfoPort() throws IOException {
> // TODO: Fix!  Reaching into internal implementation
> ConnectionImplementation connection = 
> (ConnectionImplementation)this.connection;
> ZooKeeperKeepAliveConnection zkw = 
> connection.getKeepAliveZooKeeperWatcher();
> try {
>   return MasterAddressTracker.getMasterInfoPort(zkw);
> } catch (KeeperException e) {
>   throw new IOException("Failed to get master info port from 
> MasterAddressTracker", e);
> }
>   }
> {code}
> Open this issue to fix TODO.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-18233) We shouldn't wait for readlock in doMiniBatchMutation in case of deadlock

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-18233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210492#comment-16210492
 ] 

Hadoop QA commented on HBASE-18233:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red}  0m 
19s{color} | {color:red} Docker failed to build yetus/hbase:933f4b3. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-18233 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892968/HBASE-18233-branch-1.2.v4.patch
 |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9194/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> We shouldn't wait for readlock in doMiniBatchMutation in case of deadlock
> -
>
> Key: HBASE-18233
> URL: https://issues.apache.org/jira/browse/HBASE-18233
> Project: HBase
>  Issue Type: Bug
>Affects Versions: 1.2.7
>Reporter: Allan Yang
>Assignee: Allan Yang
>Priority: Blocker
> Fix For: 2.0.0, 1.4.0, 1.3.2, 1.2.7
>
> Attachments: HBASE-18233-branch-1.2.patch, 
> HBASE-18233-branch-1.2.v2.patch, HBASE-18233-branch-1.2.v3.patch, 
> HBASE-18233-branch-1.2.v4 (1).patch, HBASE-18233-branch-1.2.v4 (1).patch, 
> HBASE-18233-branch-1.2.v4.patch, HBASE-18233-branch-1.2.v4.patch, 
> HBASE-18233-branch-1.2.v4.patch, HBASE-18233-branch-1.2.v4.patch, 
> HBASE-18233-branch-1.2.v4.patch, HBASE-18233-branch-1.2.v4.patch
>
>
> Please refer to the discuss in HBASE-18144
> https://issues.apache.org/jira/browse/HBASE-18144?focusedCommentId=16051701=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16051701



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Mike Drob (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210491#comment-16210491
 ] 

Mike Drob commented on HBASE-19042:
---

Hmmm...

{noformat}
02:23:20 Successfully built 8549bfd1b815
02:23:20 Successfully tagged yetus/hbase:tp-30526
02:23:20 
02:23:20 Total Elapsed time:   0m  2s
02:23:20 
02:23:20 /usr/bin/docker: invalid reference format: repository name must be 
lowercase.
02:23:20 See '/usr/bin/docker run --help'.
02:23:21 Build step 'Execute shell' marked build as failure
{noformat}

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-18824) Add meaningful comment to HConstants.LATEST_TIMESTAMP to explain why it is MAX_VALUE

2017-10-18 Thread Xiang Li (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-18824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210490#comment-16210490
 ] 

Xiang Li commented on HBASE-18824:
--

[~chia7712], thanks for your time for the review!
Regarding
bq. equal to -> greater than or equal to
I might get your idea to make the comment to cover all conditions (>, < and =), 
so as to avoid confusion. But the condition of result.size() > count, that is 
"great than", is invalid. I might prefer the current comment (only talking 
about the conditions of less than and equal). How do you feel about it?

> Add meaningful comment to HConstants.LATEST_TIMESTAMP to explain why it is 
> MAX_VALUE
> 
>
> Key: HBASE-18824
> URL: https://issues.apache.org/jira/browse/HBASE-18824
> Project: HBase
>  Issue Type: Improvement
>Reporter: Xiang Li
>Assignee: Xiang Li
>Priority: Minor
> Attachments: HBASE-18824.master.000.patch, 
> HBASE-18824.master.001.patch, HBASE-18824.master.002.patch, 
> HBASE-18824.master.003.patch
>
>
> Thanks to [Jerry and Chia-Ping Tsai's 
> comments|https://issues.apache.org/jira/browse/HBASE-18824?focusedCommentId=16167392=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16167392]
>  to correct my wrong understanding. 
> The following documentation says that by default(when the timestamp is not 
> specified for Put or Delete), system uses the server's {{currentTimeMillis}}.
> 1. In chapter 27.2.4 Put 
> bq. Doing a put always creates a new version of a cell, at a certain 
> timestamp. {color:#205081}By default the system uses the server’s 
> currentTimeMillis{color}, ...
> 2. In chapter 27.2.5 Delete
> bq. Deletes work by creating tombstone markers. For example, let’s suppose we 
> want to delete a row. For this you can specify a version, or else 
> {color:#205081}by default the currentTimeMillis is used.{color}...
> It seems not consistent with the code. Because in the client side's code, 
> when timestamp is not specified, HConstants.LATEST_TIMESTAMP is used, which 
> is Long.MAX_VALUE, rather than {{System.currentTimeMillis()}}.
> However, the documentation is correct, because on the server side,  timestamp 
> of Put cell with HConstants.LATEST_TIMESTAMP will be replaced with server's 
> {{currentTimeMillis}}.
> So we decide to add more comments to HConstants.LATEST_TIMESTAMP to help the 
> new comers steer clear of the confusion.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19016) Coordinate storage policy property name for table schema and bulkload

2017-10-18 Thread Yu Li (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210489#comment-16210489
 ] 

Yu Li commented on HBASE-19016:
---

Release notes already updated in HBASE-15172 before marking this jira fixed. 
Please check there and let me know if any comments, thanks. [~anoop.hbase]

> Coordinate storage policy property name for table schema and bulkload
> -
>
> Key: HBASE-19016
> URL: https://issues.apache.org/jira/browse/HBASE-19016
> Project: HBase
>  Issue Type: Bug
>Affects Versions: 2.0.0-alpha-3
>Reporter: Yu Li
>Assignee: Yu Li
>Priority: Minor
> Fix For: 3.0.0, 2.0.0-alpha-4
>
> Attachments: HBASE-19016.patch
>
>
> As pointed out in this [email|https://s.apache.org/Rp2J] in our user mailing 
> list, the property name for specifying storage policy in table schema 
> (HBASE-14061) and bulkload (HBASE-15172) are different. Since these two 
> features are all for 2.0 only and not yet released, it would be better to 
> align the name.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18233) We shouldn't wait for readlock in doMiniBatchMutation in case of deadlock

2017-10-18 Thread Yu Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yu Li updated HBASE-18233:
--
Attachment: HBASE-18233-branch-1.2.v4.patch

Retry HadoopQA

> We shouldn't wait for readlock in doMiniBatchMutation in case of deadlock
> -
>
> Key: HBASE-18233
> URL: https://issues.apache.org/jira/browse/HBASE-18233
> Project: HBase
>  Issue Type: Bug
>Affects Versions: 1.2.7
>Reporter: Allan Yang
>Assignee: Allan Yang
>Priority: Blocker
> Fix For: 2.0.0, 1.4.0, 1.3.2, 1.2.7
>
> Attachments: HBASE-18233-branch-1.2.patch, 
> HBASE-18233-branch-1.2.v2.patch, HBASE-18233-branch-1.2.v3.patch, 
> HBASE-18233-branch-1.2.v4 (1).patch, HBASE-18233-branch-1.2.v4 (1).patch, 
> HBASE-18233-branch-1.2.v4.patch, HBASE-18233-branch-1.2.v4.patch, 
> HBASE-18233-branch-1.2.v4.patch, HBASE-18233-branch-1.2.v4.patch, 
> HBASE-18233-branch-1.2.v4.patch, HBASE-18233-branch-1.2.v4.patch
>
>
> Please refer to the discuss in HBASE-18144
> https://issues.apache.org/jira/browse/HBASE-18144?focusedCommentId=16051701=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16051701



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210477#comment-16210477
 ] 

Hadoop QA commented on HBASE-19042:
---

(!) A patch to the testing environment has been detected. 
Re-executing against the patched versions to perform further tests. 
The console is at 
https://builds.apache.org/job/PreCommit-HBASE-Build/9193/console in case of 
problems.


> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-18418) Remove apache_hbase_topology from dev-support

2017-10-18 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-18418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210473#comment-16210473
 ] 

Hudson commented on HBASE-18418:


FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #3912 (See 
[https://builds.apache.org/job/HBase-Trunk_matrix/3912/])
HBASE-18418 Remove apache_hbase_topology from dev-support (dimaspivak: rev 
3acb081787a4289d86d977db26bedaf6a42172ce)
* (delete) dev-support/apache_hbase_topology/__init__.py
* (delete) dev-support/apache_hbase_topology/configurations.cfg
* (delete) dev-support/apache_hbase_topology/profile.cfg
* (delete) dev-support/apache_hbase_topology/ssh/id_rsa.pub
* (delete) dev-support/apache_hbase_topology/actions.py
* (delete) dev-support/apache_hbase_topology/ssh/id_rsa
* (delete) dev-support/apache_hbase_topology/Dockerfile
* (delete) dev-support/apache_hbase_topology/README.md


> Remove apache_hbase_topology from dev-support
> -
>
> Key: HBASE-18418
> URL: https://issues.apache.org/jira/browse/HBASE-18418
> Project: HBase
>  Issue Type: Task
>Reporter: Dima Spivak
>Assignee: Dima Spivak
>Priority: Minor
> Attachments: HBASE-18418_v1.patch
>
>
> As [~misty] noted on dev@, we still keep a folder containing the Apache HBase 
> topology for [clusterdock|https://github.com/clusterdock/framework] in 
> dev-support. Since the {{clusterdock}} org on GitHub will likely always have 
> a more up-to-date iteration of this code (and since I plan on showing it some 
> love there in the next few weeks), we'd probably be better off removing it 
> from HBase. Any objections?



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Mike Drob (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mike Drob updated HBASE-19042:
--
Attachment: HBASE-19042.patch

Attaching your work as a patch so that precommit can run it. Thanks, [~misty]!

A few errors that I've noticed while running test-patch with this locally:

{noformat}
executable for 'shelldocs' was not specified.
executable for 'rubocop' was not specified.
executable for 'Perl::Critic' was not specified.
{noformat}

{noformat}
Running ruby-lint against identified ruby scripts.
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:688:in
 `top_scope': stack level too deep (SystemStackError)
from 
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope'
from 
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope'
from 
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope'
from 
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope'
from 
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope'
from 
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope'
from 
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope'
from 
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope'
 ... 10904 levels...
from /var/lib/gems/2.3.0/gems/slop-3.6.0/lib/slop.rb:211:in `parse'
from /var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/bin/ruby-lint:95:in `'
from /usr/local/bin/ruby-lint:22:in `load'
from /usr/local/bin/ruby-lint:22:in `'
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope': stack level too deep (SystemStackError)
from 
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope'
from 
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope'
from 
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope'
from 
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope'
from 
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope'
from 
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope'
from 
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope'
from 
/var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/lib/ruby-lint/definition/ruby_object.rb:689:in
 `top_scope'
 ... 10903 levels...
from /var/lib/gems/2.3.0/gems/slop-3.6.0/lib/slop.rb:211:in `parse'
from /var/lib/gems/2.3.0/gems/ruby-lint-2.3.1/bin/ruby-lint:95:in `'
from /usr/local/bin/ruby-lint:22:in `load'
from /usr/local/bin/ruby-lint:22:in `'
{noformat}

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 

[jira] [Updated] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Mike Drob (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mike Drob updated HBASE-19042:
--
Assignee: Misty Stanley-Jones
  Status: Patch Available  (was: Open)

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Assignee: Misty Stanley-Jones
>Priority: Blocker
> Attachments: Dockerfile, HBASE-19042.patch
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Misty Stanley-Jones (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210461#comment-16210461
 ] 

Misty Stanley-Jones commented on HBASE-19042:
-

It actually intentionally pegs the Maven version, and you'd need to change the 
{{FROM}} line to move to a different Maven version.

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Priority: Blocker
> Attachments: Dockerfile
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Mike Drob (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210459#comment-16210459
 ] 

Mike Drob commented on HBASE-19042:
---

bq. Does installing multiple jdks work on the official image? We need jdk7 and 
jdk8 for branches-1*
Will investigate. It probably does, but might require some gymnastics. Will 
still be tone simpler than what we have currently, I imagine.
bq. Worth noting that this would also change our maven version, I think?
Nope, we're on 3.5

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Priority: Blocker
> Attachments: Dockerfile
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Sean Busbey (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210455#comment-16210455
 ] 

Sean Busbey commented on HBASE-19042:
-

Worth noting that this would also change our maven version, I think?

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Priority: Blocker
> Attachments: Dockerfile
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Sean Busbey (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210453#comment-16210453
 ] 

Sean Busbey commented on HBASE-19042:
-

Does installing multiple jdks work on the official image? We need jdk7 and jdk8 
for branches-1*

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Priority: Blocker
> Attachments: Dockerfile
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Misty Stanley-Jones (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Misty Stanley-Jones updated HBASE-19042:

Attachment: Dockerfile

It is definitely possible that this could be improved, but here's a start.

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Priority: Blocker
> Attachments: Dockerfile
>
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-19042) Oracle Java 8u144 downloader broken in precommit check

2017-10-18 Thread Mike Drob (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mike Drob updated HBASE-19042:
--
Summary: Oracle Java 8u144 downloader broken in precommit check  (was: 
Change Oracle JDK8 version to 8u151)

> Oracle Java 8u144 downloader broken in precommit check
> --
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Priority: Blocker
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19042) Change Oracle JDK8 version to 8u151

2017-10-18 Thread Mike Drob (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210430#comment-16210430
 ] 

Mike Drob commented on HBASE-19042:
---

Yea, I've been learning how Docker works in general and when I started asking 
questions about our current 90-step Dockerfile, Misty made a new one for me to 
play with that is much shorter and appears to be working so far. It's based on 
the maven:3.5.0-jdk-8 image mentioned above, which is in turn based on openjdk. 
I think we should switch to it, the research I've done indicates that OpenJDK 
and Oracle JDK only differ in the non-free extra add-ons that Oracle adds, 
which we don't use anyway here (stuff like Flight Recorder and Mission Control)

[~misty] - can you attach the file that you made, since I'm not sure of the 
license and copyright status of it and wouldn't feel comfortable posting it 
myself. 

> Change Oracle JDK8 version to 8u151
> ---
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Priority: Blocker
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  

[jira] [Commented] (HBASE-19042) Change Oracle JDK8 version to 8u151

2017-10-18 Thread Duo Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210421#comment-16210421
 ] 

Duo Zhang commented on HBASE-19042:
---

I believe there is another option is to use openJDK. The PPA installer failed 
on JDK7 once in the past IIRC.

> Change Oracle JDK8 version to 8u151
> ---
>
> Key: HBASE-19042
> URL: https://issues.apache.org/jira/browse/HBASE-19042
> Project: HBase
>  Issue Type: Bug
>  Components: build
>Reporter: Peter Somogyi
>Priority: Blocker
>
> Precommit job fails to install Oracle Java 8 to docker image which is due to 
> Oracle's new Java version, 8u151.
> As this thread point out we probably need to upgrade to latest java 8 
> version: https://ubuntuforums.org/showthread.php?t=2374686
> {code}
> 06:45:14 Setting up java-common (0.51) ...
> 06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
> 06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
> 06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
> 06:45:14 using default oracle-java8-installer wgetrc settings for it.
> 06:45:14 Downloading Oracle Java 8...
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving download.oracle.com (download.oracle.com)... 
> 23.59.189.81, 23.59.189.91
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
> 06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 
> 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
> 06:45:14 Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... connected.
> 06:45:14 HTTP request sent, awaiting response... 302 Moved 
> Temporarily
> 06:45:14 Location: 
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
>  [following]
> 06:45:14 --2017-10-18 13:45:14--  
> http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
> 06:45:14 Connecting to download.oracle.com 
> (download.oracle.com)|23.59.189.81|:80... connected.
> 06:45:14 HTTP request sent, awaiting response... 404 Not Found
> 06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
> 06:45:14 
> 06:45:14 download failed
> 06:45:14 Oracle JDK 8 is NOT installed.
> 06:45:14 dpkg: error processing package oracle-java8-installer 
> (--configure):
> 06:45:14  subprocess installed post-installation script returned error exit 
> status 1
> 06:45:14 Errors were encountered while processing:
> 06:45:14  oracle-java8-installer
> 06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
> 06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install 
> --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 
> 100
> 06:45:29 
> 06:45:29 Total Elapsed time:   3m 19s
> 06:45:29 
> 06:45:29 ERROR: Docker failed to build image.
> {code}
> Workaround mentioned in the forum post:
> {code}
> sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' 
> oracle-java8-installer.*
> sudo sed -i 
> 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|'
>  oracle-java8-installer.*
> sudo sed -i 
> 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|'
>  oracle-java8-installer.*
> sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' 
> oracle-java8-installer.*
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-17852) Add Fault tolerance to HBASE-14417 (Support bulk loaded files in incremental backup)

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-17852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210420#comment-16210420
 ] 

Hadoop QA commented on HBASE-17852:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red}  3m 
12s{color} | {color:red} Docker failed to build yetus/hbase:5d60123. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-17852 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892947/HBASE-17852-v2.patch |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9192/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> Add Fault tolerance to HBASE-14417 (Support bulk loaded files in incremental 
> backup)
> 
>
> Key: HBASE-17852
> URL: https://issues.apache.org/jira/browse/HBASE-17852
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-17852-v1.patch, HBASE-17852-v2.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-18989) Polish the compaction related CP hooks

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-18989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210419#comment-16210419
 ] 

Hadoop QA commented on HBASE-18989:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red}  0m 
19s{color} | {color:red} Docker failed to build yetus/hbase:5d60123. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-18989 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892957/HBASE-18989.patch |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9191/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> Polish the compaction related CP hooks
> --
>
> Key: HBASE-18989
> URL: https://issues.apache.org/jira/browse/HBASE-18989
> Project: HBase
>  Issue Type: Sub-task
>  Components: Compaction, Coprocessors
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0-alpha-4
>
> Attachments: HBASE-18989.patch, HBASE-18989.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18989) Polish the compaction related CP hooks

2017-10-18 Thread Duo Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-18989:
--
Attachment: HBASE-18989.patch

Seems the pre commit didn't catch us. Retry.

> Polish the compaction related CP hooks
> --
>
> Key: HBASE-18989
> URL: https://issues.apache.org/jira/browse/HBASE-18989
> Project: HBase
>  Issue Type: Sub-task
>  Components: Compaction, Coprocessors
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0-alpha-4
>
> Attachments: HBASE-18989.patch, HBASE-18989.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-17852) Add Fault tolerance to HBASE-14417 (Support bulk loaded files in incremental backup)

2017-10-18 Thread Vladimir Rodionov (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-17852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210414#comment-16210414
 ] 

Vladimir Rodionov commented on HBASE-17852:
---

{quote}
 guess v2 shouldn't be run on top hadoop3 beta1 where 'java.io.IOException: 
Inconsistent sequence file' appears.
{quote}
Your guess is correct, [~te...@apache.org] :)

> Add Fault tolerance to HBASE-14417 (Support bulk loaded files in incremental 
> backup)
> 
>
> Key: HBASE-17852
> URL: https://issues.apache.org/jira/browse/HBASE-17852
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-17852-v1.patch, HBASE-17852-v2.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-17852) Add Fault tolerance to HBASE-14417 (Support bulk loaded files in incremental backup)

2017-10-18 Thread Vladimir Rodionov (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-17852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Rodionov updated HBASE-17852:
--
Status: Patch Available  (was: In Progress)

> Add Fault tolerance to HBASE-14417 (Support bulk loaded files in incremental 
> backup)
> 
>
> Key: HBASE-17852
> URL: https://issues.apache.org/jira/browse/HBASE-17852
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-17852-v1.patch, HBASE-17852-v2.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-17852) Add Fault tolerance to HBASE-14417 (Support bulk loaded files in incremental backup)

2017-10-18 Thread Ted Yu (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-17852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210382#comment-16210382
 ] 

Ted Yu commented on HBASE-17852:


I guess v2 shouldn't be run on top hadoop3 beta1 where 'java.io.IOException: 
Inconsistent sequence file' appears.

> Add Fault tolerance to HBASE-14417 (Support bulk loaded files in incremental 
> backup)
> 
>
> Key: HBASE-17852
> URL: https://issues.apache.org/jira/browse/HBASE-17852
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-17852-v1.patch, HBASE-17852-v2.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-17852) Add Fault tolerance to HBASE-14417 (Support bulk loaded files in incremental backup)

2017-10-18 Thread Ted Yu (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-17852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210381#comment-16210381
 ] 

Ted Yu commented on HBASE-17852:


Can you put the JIRA in 'Patch Available' state ?

> Add Fault tolerance to HBASE-14417 (Support bulk loaded files in incremental 
> backup)
> 
>
> Key: HBASE-17852
> URL: https://issues.apache.org/jira/browse/HBASE-17852
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-17852-v1.patch, HBASE-17852-v2.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-17852) Add Fault tolerance to HBASE-14417 (Support bulk loaded files in incremental backup)

2017-10-18 Thread Vladimir Rodionov (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-17852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Rodionov updated HBASE-17852:
--
Attachment: HBASE-17852-v2.patch

Patch v2.cc: [~te...@apache.org], [~elserj]

> Add Fault tolerance to HBASE-14417 (Support bulk loaded files in incremental 
> backup)
> 
>
> Key: HBASE-17852
> URL: https://issues.apache.org/jira/browse/HBASE-17852
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-17852-v1.patch, HBASE-17852-v2.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Work started] (HBASE-18962) Support atomic BatchOperations

2017-10-18 Thread Umesh Agashe (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on HBASE-18962 started by Umesh Agashe.

> Support atomic BatchOperations
> --
>
> Key: HBASE-18962
> URL: https://issues.apache.org/jira/browse/HBASE-18962
> Project: HBase
>  Issue Type: Sub-task
>  Components: regionserver
>Affects Versions: 2.0.0-alpha-3
>Reporter: Umesh Agashe
>Assignee: Umesh Agashe
> Fix For: 2.0.0-beta-1
>
>
> Support all mutations in BatchOperations to be applied atomically (all or 
> none) by locking all rows corresponding to mutations exclusively.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18961) doMiniBatchMutate() is big, split it into smaller methods

2017-10-18 Thread Umesh Agashe (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Umesh Agashe updated HBASE-18961:
-
Attachment: (was: hbase-18961.master.001.patch)

> doMiniBatchMutate() is big, split it into smaller methods
> -
>
> Key: HBASE-18961
> URL: https://issues.apache.org/jira/browse/HBASE-18961
> Project: HBase
>  Issue Type: Sub-task
>  Components: regionserver
>Affects Versions: 2.0.0-alpha-3
>Reporter: Umesh Agashe
>Assignee: Umesh Agashe
> Fix For: 2.0.0-beta-1
>
> Attachments: hbase-18961.master.001.patch
>
>
> Split doMiniBatchMutate() and improve readability.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-18961) doMiniBatchMutate() is big, split it into smaller methods

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-18961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210310#comment-16210310
 ] 

Hadoop QA commented on HBASE-18961:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red}  0m 
18s{color} | {color:red} Docker failed to build yetus/hbase:5d60123. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-18961 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892939/hbase-18961.master.001.patch
 |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9190/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> doMiniBatchMutate() is big, split it into smaller methods
> -
>
> Key: HBASE-18961
> URL: https://issues.apache.org/jira/browse/HBASE-18961
> Project: HBase
>  Issue Type: Sub-task
>  Components: regionserver
>Affects Versions: 2.0.0-alpha-3
>Reporter: Umesh Agashe
>Assignee: Umesh Agashe
> Fix For: 2.0.0-beta-1
>
> Attachments: hbase-18961.master.001.patch, 
> hbase-18961.master.001.patch
>
>
> Split doMiniBatchMutate() and improve readability.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18961) doMiniBatchMutate() is big, split it into smaller methods

2017-10-18 Thread Umesh Agashe (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Umesh Agashe updated HBASE-18961:
-
Attachment: hbase-18961.master.001.patch

retry

> doMiniBatchMutate() is big, split it into smaller methods
> -
>
> Key: HBASE-18961
> URL: https://issues.apache.org/jira/browse/HBASE-18961
> Project: HBase
>  Issue Type: Sub-task
>  Components: regionserver
>Affects Versions: 2.0.0-alpha-3
>Reporter: Umesh Agashe
>Assignee: Umesh Agashe
> Fix For: 2.0.0-beta-1
>
> Attachments: hbase-18961.master.001.patch, 
> hbase-18961.master.001.patch
>
>
> Split doMiniBatchMutate() and improve readability.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19007) Align Services Interfaces in Master and RegionServer

2017-10-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210255#comment-16210255
 ] 

Hadoop QA commented on HBASE-19007:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} docker {color} | {color:red}  0m 
19s{color} | {color:red} Docker failed to build yetus/hbase:5d60123. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HBASE-19007 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12892931/HBASE-19007.master.006.patch
 |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/9189/console |
| Powered by | Apache Yetus 0.4.0   http://yetus.apache.org |


This message was automatically generated.



> Align Services Interfaces in Master and RegionServer
> 
>
> Key: HBASE-19007
> URL: https://issues.apache.org/jira/browse/HBASE-19007
> Project: HBase
>  Issue Type: Task
>Reporter: stack
>Assignee: stack
>Priority: Blocker
>  Labels: coprocessor
> Fix For: 2.0.0-alpha-4
>
> Attachments: HBASE-19007.master.001.patch, 
> HBASE-19007.master.002.patch, HBASE-19007.master.003.patch, 
> HBASE-19007.master.004.patch, HBASE-19007.master.005.patch, 
> HBASE-19007.master.006.patch
>
>
> HBASE-18183 adds a CoprocessorRegionServerService to give a view on 
> RegionServiceServices that is safe to expose to Coprocessors.
> On the Master-side, MasterServices becomes an Interface for exposing to 
> Coprocessors.
> We need to align the two.
> For background, see 
> https://issues.apache.org/jira/browse/HBASE-12260?focusedCommentId=16203820=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16203820
>  



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19007) Align Services Interfaces in Master and RegionServer

2017-10-18 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210253#comment-16210253
 ] 

stack commented on HBASE-19007:
---

Rebase.

> Align Services Interfaces in Master and RegionServer
> 
>
> Key: HBASE-19007
> URL: https://issues.apache.org/jira/browse/HBASE-19007
> Project: HBase
>  Issue Type: Task
>Reporter: stack
>Assignee: stack
>Priority: Blocker
>  Labels: coprocessor
> Fix For: 2.0.0-alpha-4
>
> Attachments: HBASE-19007.master.001.patch, 
> HBASE-19007.master.002.patch, HBASE-19007.master.003.patch, 
> HBASE-19007.master.004.patch, HBASE-19007.master.005.patch, 
> HBASE-19007.master.006.patch
>
>
> HBASE-18183 adds a CoprocessorRegionServerService to give a view on 
> RegionServiceServices that is safe to expose to Coprocessors.
> On the Master-side, MasterServices becomes an Interface for exposing to 
> Coprocessors.
> We need to align the two.
> For background, see 
> https://issues.apache.org/jira/browse/HBASE-12260?focusedCommentId=16203820=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16203820
>  



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-19007) Align Services Interfaces in Master and RegionServer

2017-10-18 Thread stack (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-19007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-19007:
--
Attachment: HBASE-19007.master.006.patch

> Align Services Interfaces in Master and RegionServer
> 
>
> Key: HBASE-19007
> URL: https://issues.apache.org/jira/browse/HBASE-19007
> Project: HBase
>  Issue Type: Task
>Reporter: stack
>Assignee: stack
>Priority: Blocker
>  Labels: coprocessor
> Fix For: 2.0.0-alpha-4
>
> Attachments: HBASE-19007.master.001.patch, 
> HBASE-19007.master.002.patch, HBASE-19007.master.003.patch, 
> HBASE-19007.master.004.patch, HBASE-19007.master.005.patch, 
> HBASE-19007.master.006.patch
>
>
> HBASE-18183 adds a CoprocessorRegionServerService to give a view on 
> RegionServiceServices that is safe to expose to Coprocessors.
> On the Master-side, MasterServices becomes an Interface for exposing to 
> Coprocessors.
> We need to align the two.
> For background, see 
> https://issues.apache.org/jira/browse/HBASE-12260?focusedCommentId=16203820=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16203820
>  



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-18945) Make a IA.LimitedPrivate interface for CellComparator

2017-10-18 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-18945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210243#comment-16210243
 ] 

stack commented on HBASE-18945:
---

I took a look at the patch. Seems good. What is the philosophy regards when 
CellComparator vs CellComparatorImpl vs CellUtils? Can you stick it in release 
note?

It seems like its use CCI internally which is fine. Also it seems like 
CellUtils methods take a CellComparator which seems good too. Main concern is 
that we have different CellComparator implemenations -- one for Meta Table Rows 
and another for user-table Rows -- and you have to use the right one else you 
get wonky results. Seems like you are doing right thing but just checking.

Thanks [~ram_krish]

> Make a IA.LimitedPrivate interface for CellComparator
> -
>
> Key: HBASE-18945
> URL: https://issues.apache.org/jira/browse/HBASE-18945
> Project: HBase
>  Issue Type: Sub-task
>Reporter: ramkrishna.s.vasudevan
>Assignee: ramkrishna.s.vasudevan
> Fix For: 2.0.0-alpha-4
>
> Attachments: 18945-addendum-branch-2.txt, HBASE-18495.patch, 
> HBASE-18945_2.patch, HBASE-18945_3.patch, HBASE-18945_4.patch, 
> HBASE-18945_5.patch, HBASE-18945_6.patch, HBASE-18945_6.patch, 
> HBASE-18945_7.patch
>
>
> Based on discussions over in HBASE-18826 and HBASE-18183 it is better we 
> expose CellComparator as a public interface so that it could be used in 
> Region/Store interfaces to be exposed to CPs.
> Currently the Comparator is exposed in Region, STore and StoreFile. There is 
> another discussion whether to expose it at all layers or only at Region. 
> However since we are exposing this to CPs CellComparator being @Private is 
> not the ideal way to do it. We have to change it to LimitedPrivate. But 
> CellComparator has lot of additional methods which are internal (like where a 
> Cell is compared with an incoming byte[] used in index comparsions etc).
> One way to expose is that as being done now in HBASE-18826 - by exposing the 
> return type as Comparator. But this is not powerful. It only allows to 
> compare cells. So we try to expose an IA.LimitedPrivate interface that is 
> more powerful and allows comparing individual cell components also. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HBASE-19010) Reimplement getMasterInfoPort for Admin

2017-10-18 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-19010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210224#comment-16210224
 ] 

stack commented on HBASE-19010:
---

+1 up on rb carried-over here. [~chia7712] had an issue to resolve up on rb.

> Reimplement getMasterInfoPort for Admin
> ---
>
> Key: HBASE-19010
> URL: https://issues.apache.org/jira/browse/HBASE-19010
> Project: HBase
>  Issue Type: Sub-task
>  Components: Client
>Reporter: Guanghao Zhang
>Assignee: Guanghao Zhang
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-19010.master.001.patch, 
> HBASE-19010.master.002.patch, HBASE-19010.master.002.patch, 
> HBASE-19010.master.002.patch, HBASE-19010.master.002.patch
>
>
> Current implementation.
> {code}
>   public int getMasterInfoPort() throws IOException {
> // TODO: Fix!  Reaching into internal implementation
> ConnectionImplementation connection = 
> (ConnectionImplementation)this.connection;
> ZooKeeperKeepAliveConnection zkw = 
> connection.getKeepAliveZooKeeperWatcher();
> try {
>   return MasterAddressTracker.getMasterInfoPort(zkw);
> } catch (KeeperException e) {
>   throw new IOException("Failed to get master info port from 
> MasterAddressTracker", e);
> }
>   }
> {code}
> Open this issue to fix TODO.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


  1   2   3   >