Nigel Savage created HIVE-6336: ---------------------------------- Summary: Issue is hive 12 datanucleus incompatability with org.apache.hadoop.hive.contrib.serde2.RegexSerDe Key: HIVE-6336 URL: https://issues.apache.org/jira/browse/HIVE-6336 Project: Hive Issue Type: Wish Components: HiveServer2 Affects Versions: 0.12.0 Environment: Hadoop 2.2 local derby Meatastore embedded Reporter: Nigel Savage Priority: Blocker
Issue is hive 12 datanucleus incompatability with org.apache.hadoop.hive.contrib.serde2.RegexSerDe I have hadoop and hive running as a pseudo cluster local mode and derby as the metastore I have the following environment variables HADOOP_HOME=/home/ubu/hadoop JAVA_HOME=/usr/lib/jvm/java-7-oracle I have the RegexSerDe declared in thew hive-site.xml <property> <name>hive.aux.jars.path</name> <value>file:///home/ubu/hadoop/lib/hive-contrib-0.12.0.jar </value> <description>This JAR file available to all users for alljobs</description> </property> If I run with <datanucleus.version>3.0.2</datanucleus.version> I get the following exception java.lang.ClassNotFoundException: org.datanucleus.store.types.backed.Map If I run with <datanucleus.version>3.2.0-release</datanucleus.version> I get the following exception java.lang.ClassNotFoundException: org/apache/hadoop/hive/contrib/serde2/RegexSerDe basically the RegexSerDe class is picked up at run time but the datanucleus Map class is not available, I have checked in the datanucleus-core 3.0.2 jar and it is missing upgrading to the first datanucleus above 3.0.2 that incluse the Map class throws the ClassNotFoundException for RegexSerDe what is the version of datanucleus I should be using with Hive 12 and Hadoop 2.2, thanks for your time and effort here are the dependencies from the pom <dependency> <groupId>javax.jdo</groupId> <artifactId>jdo-api</artifactId> <version>3.0.1</version> </dependency> <dependency> <groupId>org.datanucleus</groupId> <artifactId>datanucleus-core</artifactId> <version>${datanucleus.version}</version> <scope>runtime</scope> </dependency> <dependency> <groupId>org.datanucleus</groupId> <artifactId>datanucleus-rdbms</artifactId> <version>${datanucleus.version}</version> <scope>runtime</scope> </dependency> <dependency> <groupId>org.datanucleus</groupId> <artifactId>datanucleus-api-jdo</artifactId> <version>${datanucleus.version}</version> </dependency> <!-- hadoop --> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-client</artifactId> <version>${hadoop.version}</version> </dependency> <!-- hive --> <dependency> <groupId>org.apache.hive</groupId> <artifactId>hive-common</artifactId> <version>${hive.version}</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.hive</groupId> <artifactId>hive-serde</artifactId> <version>${hive.version}</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.hive</groupId> <artifactId>hive-exec</artifactId> <version>${hive.version}</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.hive</groupId> <artifactId>hive-jdbc</artifactId> <version>${hive.version}</version> </dependency> <dependency> <groupId>org.apache.hive</groupId> <artifactId>hive-contrib</artifactId> <version>${hive.version}</version> </dependency> <dependency> <groupId>com.jolbox</groupId> <artifactId>bonecp</artifactId> <version>${bonecp.version}</version> </dependency> -- This message was sent by Atlassian JIRA (v6.1.5#6160)