[
https://issues.apache.org/jira/browse/HBASE-19848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345013#comment-16345013
]
Hadoop QA commented on HBASE-19848:
-----------------------------------
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 1m
54s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
16s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
56s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} scaladoc {color} | {color:green} 0m
29s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
26s{color} | {color:red} hbase-spark in the patch failed. {color} |
| {color:red}-1{color} | {color:red} scalac {color} | {color:red} 0m
26s{color} | {color:red} hbase-spark in the patch failed. {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 1 line(s) that end in whitespace. Use git
apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
{color} |
| {color:red}-1{color} | {color:red} scaladoc {color} | {color:red} 0m
29s{color} | {color:red} hbase-spark generated 9 new + 0 unchanged - 0 fixed =
9 total (was 0) {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 0m 26s{color}
| {color:red} hbase-spark in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
9s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 9m 18s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:eee3b01 |
| JIRA Issue | HBASE-19848 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12908326/HBaseContext.patch |
| Optional Tests | asflicense scalac scaladoc unit compile |
| uname | Linux fabae75c577f 3.13.0-139-generic #188-Ubuntu SMP Tue Jan 9
14:43:09 UTC 2018 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
|
| git revision | master / 67f91f1282 |
| maven | version: Apache Maven 3.5.2
(138edd61fd100ec658bfa2d307c43b76940a5d7d; 2017-10-18T07:58:13Z) |
| compile |
https://builds.apache.org/job/PreCommit-HBASE-Build/11253/artifact/patchprocess/patch-compile-hbase-spark.txt
|
| scalac |
https://builds.apache.org/job/PreCommit-HBASE-Build/11253/artifact/patchprocess/patch-compile-hbase-spark.txt
|
| whitespace |
https://builds.apache.org/job/PreCommit-HBASE-Build/11253/artifact/patchprocess/whitespace-eol.txt
|
| scaladoc |
https://builds.apache.org/job/PreCommit-HBASE-Build/11253/artifact/patchprocess/diff-scaladoc-scaladoc-hbase-spark.txt
|
| unit |
https://builds.apache.org/job/PreCommit-HBASE-Build/11253/artifact/patchprocess/patch-unit-hbase-spark.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HBASE-Build/11253/testReport/ |
| Max. process+thread count | 83 (vs. ulimit of 1000) |
| modules | C: hbase-spark U: hbase-spark |
| Console output |
https://builds.apache.org/job/PreCommit-HBASE-Build/11253/console |
| Powered by | Apache Yetus 0.7.0 http://yetus.apache.org |
This message was automatically generated.
> Zookeeper thread leaks in hbase-spark bulkLoad method
> -----------------------------------------------------
>
> Key: HBASE-19848
> URL: https://issues.apache.org/jira/browse/HBASE-19848
> Project: HBase
> Issue Type: Bug
> Components: spark, Zookeeper
> Affects Versions: 1.2.0
> Environment: hbase-spark-1.2.0-cdh5.12.1 version
> spark 1.6
> Reporter: Key Hutu
> Assignee: Key Hutu
> Priority: Major
> Labels: performance
> Fix For: 1.2.0
>
> Attachments: HBaseContext.patch, HBaseContext.scala
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> In hbase-spark project, HBaseContext provides bulkload methond for loading
> spark rdd data to hbase easily.But when i using it frequently， the program
> will throw "cannot create native thread" exception.
> using pstack command in spark driver process , the thread num is increasing
> using jstack, named "main-SendThread" and "main-EventThread" thread so many
> It seems like that , connection created before bulkload ,but close method
> uninvoked at last
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
