Maninda,
The build seems to be broken from this commit. I believe there is no
PortOffsetFetcher file. Did you compile this before committing?
This is the error I'm getting:
rg.apache.hive-hive-cassandra-handler-default.html
ivy-retrieve:
[echo] Project: cassandra-handler
compile:
[echo] Project: cassandra-handler
[javac] Compiling 31 source files to
/Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/build/cassandra-handler/classes
[javac]
/Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java:22:
cannot find symbol
[javac] symbol : class PortOffsetFetcher
[javac] location: package org.apache.hadoop.hive.cassandra
[javac] import org.apache.hadoop.hive.cassandra.PortOffsetFetcher;
[javac] ^
[javac]
/Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java:87:
cannot find symbol
[javac] symbol : variable PortOffsetFetcher
[javac] location: class
org.apache.hadoop.hive.cassandra.CassandraManager
[javac] tempPort = Integer.parseInt(cassandraPortStr) +
PortOffsetFetcher.getPortOffset() + 1;
[javac] ^
[javac]
/Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java:87:
operator + cannot be applied to int,PortOffsetFetcher.getPortOffset
[javac] tempPort = Integer.parseInt(cassandraPortStr) +
PortOffsetFetcher.getPortOffset() + 1;
[javac] ^
[javac]
/Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java:87:
operator + cannot be applied to <nulltype>,int
[javac] tempPort = Integer.parseInt(cassandraPortStr) +
PortOffsetFetcher.getPortOffset() + 1;
[javac] ^
[javac]
/Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java:87:
incompatible types
[javac] found : <nulltype>
[javac] required: int
[javac] tempPort = Integer.parseInt(cassandraPortStr) +
PortOffsetFetcher.getPortOffset() + 1;
[javac]
^
[javac]
/Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java:157:
cannot find symbol
[javac] symbol : variable PortOffsetFetcher
[javac] location: class
org.apache.hadoop.hive.cassandra.input.HiveCassandraStandardColumnInputFormat
[javac] rpcPort =
jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, 9160) +
PortOffsetFetcher.getPortOffset() + 1;
[javac]
^
[javac]
/Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java:157:
operator + cannot be applied to int,PortOffsetFetcher.getPortOffset
[javac] rpcPort =
jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, 9160) +
PortOffsetFetcher.getPortOffset() + 1;
[javac] ^
[javac]
/Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java:157:
operator + cannot be applied to <nulltype>,int
[javac] rpcPort =
jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, 9160) +
PortOffsetFetcher.getPortOffset() + 1;
[javac]
^
[javac]
/Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java:157:
incompatible types
[javac] found : <nulltype>
[javac] required: int
[javac] rpcPort =
jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, 9160) +
PortOffsetFetcher.getPortOffset() + 1;
[javac]
^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 9 errors
[INFO]
------------------------------------------------------------------------
On Wed, Apr 17, 2013 at 6:40 PM, <[email protected]> wrote:
> Author: [email protected]
> Date: Wed Apr 17 18:40:40 2013
> New Revision: 170526
> URL: http://wso2.org/svn/browse/wso2?view=rev&revision=170526
>
> Log:
> Fixed pulic JIRA BAM-1138 with patch from Ayashkantha
>
> Modified:
>
>
> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java
>
>
> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraStorageHandler.java
>
>
> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java
>
>
> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/serde/AbstractColumnSerDe.java
>
> Modified:
> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java
> URL:
> http://wso2.org/svn/browse/wso2/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java?rev=170526&r1=170525&r2=170526&view=diff
>
> ==============================================================================
> ---
> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java
> (original)
> +++
> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java
> Wed Apr 17 18:40:40 2013
> @@ -78,8 +78,18 @@
> this.password = password;
> }
>
> + String portOffsetEnabled =
> serdeParam.get(AbstractColumnSerDe.CARBON_PORT_OFFSET);
> +
> +
> try {
> - port = Integer.parseInt(cassandraPortStr);
> + int tempPort = 0;
> + if( portOffsetEnabled.equals("true")) {
> + tempPort = Integer.parseInt(cassandraPortStr) +
> PortOffsetFetcher.getPortOffset() + 1;
> + }
> + else {
> + tempPort = Integer.parseInt(cassandraPortStr);
> + }
> + port = tempPort;
> } catch (NumberFormatException e) {
> throw new MetaException(AbstractColumnSerDe.CASSANDRA_PORT + " must
> be a number");
> }
>
> Modified:
> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraStorageHandler.java
> URL:
> http://wso2.org/svn/browse/wso2/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraStorageHandler.java?rev=170526&r1=170525&r2=170526&view=diff
>
> ==============================================================================
> ---
> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraStorageHandler.java
> (original)
> +++
> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraStorageHandler.java
> Wed Apr 17 18:40:40 2013
> @@ -60,6 +60,9 @@
>
> jobProperties.put(AbstractColumnSerDe.CASSANDRA_COL_MAPPING,
> columnInfo);
>
> + jobProperties.put(AbstractColumnSerDe.CARBON_PORT_OFFSET,
> + tableProperties.getProperty(
> AbstractColumnSerDe.CARBON_PORT_OFFSET, "true" ) );
> +
> jobProperties.put(AbstractColumnSerDe.CASSANDRA_HOST,
> tableProperties.getProperty(AbstractColumnSerDe.CASSANDRA_HOST,
> AbstractColumnSerDe.DEFAULT_CASSANDRA_HOST));
>
>
> Modified:
> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java
> URL:
> http://wso2.org/svn/browse/wso2/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java?rev=170526&r1=170525&r2=170526&view=diff
>
> ==============================================================================
> ---
> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java
> (original)
> +++
> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java
> Wed Apr 17 18:40:40 2013
> @@ -19,8 +19,10 @@
> import org.apache.commons.logging.Log;
> import org.apache.commons.logging.LogFactory;
> import org.apache.hadoop.fs.Path;
> +import org.apache.hadoop.hive.cassandra.PortOffsetFetcher;
> import org.apache.hadoop.hive.cassandra.serde.AbstractColumnSerDe;
> import org.apache.hadoop.hive.serde2.ColumnProjectionUtils;
> +import org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe;
> import org.apache.hadoop.io.BytesWritable;
> import org.apache.hadoop.io.MapWritable;
> import org.apache.hadoop.mapred.InputSplit;
> @@ -149,7 +151,14 @@
> AbstractColumnSerDe.CASSANDRA_SPLIT_SIZE,
> AbstractColumnSerDe.DEFAULT_SPLIT_SIZE);
> String cassandraColumnMapping =
> jobConf.get(AbstractColumnSerDe.CASSANDRA_COL_MAPPING);
> - int rpcPort = jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT,
> 9160);
> + int rpcPort = 0;
> + String portOffsetEnabled =
> jobConf.get(AbstractColumnSerDe.CARBON_PORT_OFFSET);
> + if( portOffsetEnabled.equals("true")) {
> + rpcPort = jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT,
> 9160) + PortOffsetFetcher.getPortOffset() + 1;
> + }
> + else {
> + rpcPort = jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT,
> 9160);
> + }
> String host = jobConf.get(AbstractColumnSerDe.CASSANDRA_HOST);
> String partitioner =
> jobConf.get(AbstractColumnSerDe.CASSANDRA_PARTITIONER);
>
>
> Modified:
> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/serde/AbstractColumnSerDe.java
> URL:
> http://wso2.org/svn/browse/wso2/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/serde/AbstractColumnSerDe.java?rev=170526&r1=170525&r2=170526&view=diff
>
> ==============================================================================
> ---
> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/serde/AbstractColumnSerDe.java
> (original)
> +++
> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/serde/AbstractColumnSerDe.java
> Wed Apr 17 18:40:40 2013
> @@ -57,6 +57,8 @@
> public static final String CASSANDRA_SLICE_PREDICATE_RANGE_COUNT =
> "cassandra.slice.predicate.range.count";
> public static final String CASSANDRA_ENABLE_WIDEROW_ITERATOR =
> "cassandra.enable.widerow.iterator";
>
> + public static final String CARBON_PORT_OFFSET = "carbon.port.offset";
> +
> public static final String CASSANDRA_SPECIAL_COLUMN_KEY = "row_key";
> public static final String CASSANDRA_SPECIAL_COLUMN_COL = "column_name";
> public static final String CASSANDRA_SPECIAL_COLUMN_SCOL=
> "sub_column_name";
> _______________________________________________
> Commits mailing list
> [email protected]
> http://wso2.org/cgi-bin/mailman/listinfo/commits
>
--
Regards,
Tharindu Mathew
Associate Technical Lead, WSO2 BAM
Member - Data Mgmt. Committee
blog: http://tharindumathew.com/
M: +94777759908
_______________________________________________
Dev mailing list
[email protected]
http://wso2.org/cgi-bin/mailman/listinfo/dev
