Jenkins build is back to normal : carbondata-master-spark-2.4 » Apache CarbonData :: Hive #2425

2020-08-10 Thread Apache Jenkins Server 
See

[carbondata] branch master updated: [CARBONDATA-3948] Fix for Bloom Index create failure

2020-08-10 Thread kunalkapoor 
This is an automated email from the ASF dual-hosted git repository.

kunalkapoor pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/carbondata.git


The following commit(s) were added to refs/heads/master by this push:
 new d4466fd  [CARBONDATA-3948] Fix for Bloom Index create failure
d4466fd is described below

commit d4466fd3692f819b31192abccd1c95c67ddfb35d
Author: Vikram Ahuja 
AuthorDate: Wed May 27 01:35:47 2020 +0530

[CARBONDATA-3948] Fix for Bloom Index create failure

Why is this PR needed?
In the case when the whole flow goes to fallback mode in the
index server, the parent table retrieved again in the processData
function of carboncreateIndexCommand does not contain the serialized
IndexMetaData. This issue is only seen in spark-sql because the same
jvm is used between driver and executor

What changes were proposed in this PR?
Setting the index information in parent table after the table is
retrieved again and creating it if it is null

This closes #3775
---
 .../execution/command/index/CarbonCreateIndexCommand.scala | 14 --
 1 file changed, 12 insertions(+), 2 deletions(-)

diff --git 
a/integration/spark/src/main/scala/org/apache/spark/sql/execution/command/index/CarbonCreateIndexCommand.scala
 
b/integration/spark/src/main/scala/org/apache/spark/sql/execution/command/index/CarbonCreateIndexCommand.scala
index 8ecf107..5d52ed7 100644
--- 
a/integration/spark/src/main/scala/org/apache/spark/sql/execution/command/index/CarbonCreateIndexCommand.scala
+++ 
b/integration/spark/src/main/scala/org/apache/spark/sql/execution/command/index/CarbonCreateIndexCommand.scala
@@ -238,8 +238,18 @@ case class CarbonCreateIndexCommand(
   false)
 val enabledIndexInfo = IndexTableInfo.enableIndex(indexInfo, 
indexModel.indexName)
 
-// set index information in parent table
-val parentIndexMetadata = parentTable.getIndexMetadata
+// set index information in parent table. Create it if it is null.
+val parentIndexMetadata = if (
+  parentTable.getTableInfo.getFactTable.getTableProperties
+.get(parentTable.getCarbonTableIdentifier.getTableId) != null) 
{
+  parentTable.getIndexMetadata
+} else {
+  val tempIndexMetaData = new IndexMetadata(false)
+  tempIndexMetaData.addIndexTableInfo(indexProviderName,
+indexModel.indexName,
+indexSchema.getProperties)
+  tempIndexMetaData
+}
 parentIndexMetadata.updateIndexStatus(indexProviderName,
   indexModel.indexName,
   IndexStatus.ENABLED.name())

Build failed in Jenkins: carbondata-master-spark-2.4 » Apache CarbonData :: Hive #2424

2020-08-10 Thread Apache Jenkins Server 
See 


Changes:


--
[INFO] 
[INFO] 
[INFO] Building Apache CarbonData :: Hive 2.1.0-SNAPSHOT
[INFO] 
[INFO] Downloading: 
http://repository.apache.org/snapshots/org/glassfish/javax.el/maven-metadata.xml
[INFO] Downloading: 
http://www.datanucleus.org/downloads/maven2/org/glassfish/javax.el/maven-metadata.xml
[INFO] Downloading: 
file:${project.basedir}/src/main/site/resources/repo/org/glassfish/javax.el/maven-metadata.xml
[INFO] Downloading: 
https://repo1.maven.org/maven2/org/glassfish/javax.el/maven-metadata.xml
[INFO] Downloading: 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/maven-metadata.xml
[INFO] Downloaded: 
https://repo1.maven.org/maven2/org/glassfish/javax.el/maven-metadata.xml (952 B 
at 21.6 KB/sec)
[WARNING] Could not validate integrity of download from 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/maven-metadata.xml:
 Checksum validation failed, no checksums available
[WARNING] Checksum validation failed, no checksums available for 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/maven-metadata.xml
[INFO] Downloaded: 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/maven-metadata.xml
 (417 B at 0.0 KB/sec)
[INFO] Downloading: 
http://repository.apache.org/snapshots/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/maven-metadata.xml
[INFO] Downloading: 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/maven-metadata.xml
[INFO] Downloading: 
https://repo1.maven.org/maven2/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/maven-metadata.xml
[INFO] Downloading: 
file:${project.basedir}/src/main/site/resources/repo/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/maven-metadata.xml
[WARNING] Could not transfer metadata 
org.glassfish:javax.el:3.0.1-b06-SNAPSHOT/maven-metadata.xml from/to 
jvnet-nexus-snapshots (https://maven.java.net/content/repositories/snapshots): 
Failed to transfer file: 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/maven-metadata.xml.
 Return code is: 503 , ReasonPhrase:Service Unavailable: Back-end server is at 
capacity.
[WARNING] Failure to transfer 
org.glassfish:javax.el:3.0.1-b06-SNAPSHOT/maven-metadata.xml from 
https://maven.java.net/content/repositories/snapshots was cached in the local 
repository, resolution will not be reattempted until the update interval of 
jvnet-nexus-snapshots has elapsed or updates are forced. Original error: Could 
not transfer metadata 
org.glassfish:javax.el:3.0.1-b06-SNAPSHOT/maven-metadata.xml from/to 
jvnet-nexus-snapshots (https://maven.java.net/content/repositories/snapshots): 
Failed to transfer file: 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/maven-metadata.xml.
 Return code is: 503 , ReasonPhrase:Service Unavailable: Back-end server is at 
capacity.
[INFO] Downloading: 
https://repo1.maven.org/maven2/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/javax.el-3.0.1-b06-SNAPSHOT.pom
[INFO] Downloading: 
http://repository.apache.org/snapshots/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/javax.el-3.0.1-b06-SNAPSHOT.pom
[INFO] Downloading: 
file:${project.basedir}/src/main/site/resources/repo/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/javax.el-3.0.1-b06-SNAPSHOT.pom
[INFO] Downloading: 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/javax.el-3.0.1-b06-SNAPSHOT.pom
[INFO] Downloading: 
http://repository.apache.org/snapshots/org/glassfish/javax.el/3.0.1-b07-SNAPSHOT/maven-metadata.xml
[INFO] Downloading: 
https://repo1.maven.org/maven2/org/glassfish/javax.el/3.0.1-b07-SNAPSHOT/maven-metadata.xml
[INFO] Downloading: 
file:${project.basedir}/src/main/site/resources/repo/org/glassfish/javax.el/3.0.1-b07-SNAPSHOT/maven-metadata.xml
[INFO] Downloading: 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/3.0.1-b07-SNAPSHOT/maven-metadata.xml
[WARNING] Could not transfer metadata 
org.glassfish:javax.el:3.0.1-b07-SNAPSHOT/maven-metadata.xml from/to 
jvnet-nexus-snapshots (https://maven.java.net/content/repositories/snapshots): 
Failed to transfer file: 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/3.0.1-b07-SNAPSHOT/maven-metadata.xml.
 Return code is: 503 , ReasonPhrase:Service Unavailable: Back-end server is at 
capacity.
[WARNING] Failure to transfer 
org.glassfish:javax.el:3.0.1-b07-SNAPSHOT/maven-metadata.xml from 
https://maven.java.net/content/repositories/snapshots was cached in the local 
repository, resolution will not be

Build failed in Jenkins: carbondata-master-spark-2.4 #2424

2020-08-10 Thread Apache Jenkins Server 
See 


Changes:


--
[...truncated 53.23 KB...]
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ 
carbondata-mv-plan_2.4 ---
[INFO] 
[INFO] 
[INFO] Building Apache CarbonData :: Hive 2.1.0-SNAPSHOT
[INFO] 
[INFO] Downloading: 
http://repository.apache.org/snapshots/org/glassfish/javax.el/maven-metadata.xml
[INFO] Downloading: 
http://www.datanucleus.org/downloads/maven2/org/glassfish/javax.el/maven-metadata.xml
[INFO] Downloading: 
file:${project.basedir}/src/main/site/resources/repo/org/glassfish/javax.el/maven-metadata.xml
[INFO] Downloading: 
https://repo1.maven.org/maven2/org/glassfish/javax.el/maven-metadata.xml
[INFO] Downloading: 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/maven-metadata.xml
[INFO] Downloaded: 
https://repo1.maven.org/maven2/org/glassfish/javax.el/maven-metadata.xml (952 B 
at 21.6 KB/sec)
[WARNING] Could not validate integrity of download from 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/maven-metadata.xml:
 Checksum validation failed, no checksums available
[WARNING] Checksum validation failed, no checksums available for 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/maven-metadata.xml
[INFO] Downloaded: 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/maven-metadata.xml
 (417 B at 0.0 KB/sec)
[INFO] Downloading: 
http://repository.apache.org/snapshots/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/maven-metadata.xml
[INFO] Downloading: 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/maven-metadata.xml
[INFO] Downloading: 
https://repo1.maven.org/maven2/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/maven-metadata.xml
[INFO] Downloading: 
file:${project.basedir}/src/main/site/resources/repo/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/maven-metadata.xml
[WARNING] Could not transfer metadata 
org.glassfish:javax.el:3.0.1-b06-SNAPSHOT/maven-metadata.xml from/to 
jvnet-nexus-snapshots (https://maven.java.net/content/repositories/snapshots): 
Failed to transfer file: 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/maven-metadata.xml.
 Return code is: 503 , ReasonPhrase:Service Unavailable: Back-end server is at 
capacity.
[WARNING] Failure to transfer 
org.glassfish:javax.el:3.0.1-b06-SNAPSHOT/maven-metadata.xml from 
https://maven.java.net/content/repositories/snapshots was cached in the local 
repository, resolution will not be reattempted until the update interval of 
jvnet-nexus-snapshots has elapsed or updates are forced. Original error: Could 
not transfer metadata 
org.glassfish:javax.el:3.0.1-b06-SNAPSHOT/maven-metadata.xml from/to 
jvnet-nexus-snapshots (https://maven.java.net/content/repositories/snapshots): 
Failed to transfer file: 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/maven-metadata.xml.
 Return code is: 503 , ReasonPhrase:Service Unavailable: Back-end server is at 
capacity.
[INFO] Downloading: 
https://repo1.maven.org/maven2/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/javax.el-3.0.1-b06-SNAPSHOT.pom
[INFO] Downloading: 
http://repository.apache.org/snapshots/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/javax.el-3.0.1-b06-SNAPSHOT.pom
[INFO] Downloading: 
file:${project.basedir}/src/main/site/resources/repo/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/javax.el-3.0.1-b06-SNAPSHOT.pom
[INFO] Downloading: 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/javax.el-3.0.1-b06-SNAPSHOT.pom
[INFO] Downloading: 
http://repository.apache.org/snapshots/org/glassfish/javax.el/3.0.1-b07-SNAPSHOT/maven-metadata.xml
[INFO] Downloading: 
https://repo1.maven.org/maven2/org/glassfish/javax.el/3.0.1-b07-SNAPSHOT/maven-metadata.xml
[INFO] Downloading: 
file:${project.basedir}/src/main/site/resources/repo/org/glassfish/javax.el/3.0.1-b07-SNAPSHOT/maven-metadata.xml
[INFO] Downloading: 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/3.0.1-b07-SNAPSHOT/maven-metadata.xml
[WARNING] Could not transfer metadata 
org.glassfish:javax.el:3.0.1-b07-SNAPSHOT/maven-metadata.xml from/to 
jvnet-nexus-snapshots (https://maven.java.net/content/repositories/snapshots): 
Failed to transfer file: 
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/3.0.1-b07-SNAPSHOT/maven-metadata.xml.
 Return code is: 503 , ReasonPhrase:Service Unavailable: