I added the missing class. Maninda please always do svn status before committing patches, otherwise you might miss newly added classes.
Thanks, KasunW. On Wed, Apr 17, 2013 at 10:43 PM, Tharindu Mathew <[email protected]> wrote: > Maninda, > > The build seems to be broken from this commit. I believe there is no > PortOffsetFetcher file. Did you compile this before committing? > > This is the error I'm getting: > > rg.apache.hive-hive-cassandra-handler-default.html > > ivy-retrieve: > [echo] Project: cassandra-handler > > compile: > [echo] Project: cassandra-handler > [javac] Compiling 31 source files to > /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/build/cassandra-handler/classes > [javac] > /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java:22: > cannot find symbol > [javac] symbol : class PortOffsetFetcher > [javac] location: package org.apache.hadoop.hive.cassandra > [javac] import org.apache.hadoop.hive.cassandra.PortOffsetFetcher; > [javac] ^ > [javac] > /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java:87: > cannot find symbol > [javac] symbol : variable PortOffsetFetcher > [javac] location: class > org.apache.hadoop.hive.cassandra.CassandraManager > [javac] tempPort = Integer.parseInt(cassandraPortStr) + > PortOffsetFetcher.getPortOffset() + 1; > [javac] ^ > [javac] > /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java:87: > operator + cannot be applied to int,PortOffsetFetcher.getPortOffset > [javac] tempPort = Integer.parseInt(cassandraPortStr) + > PortOffsetFetcher.getPortOffset() + 1; > [javac] ^ > [javac] > /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java:87: > operator + cannot be applied to <nulltype>,int > [javac] tempPort = Integer.parseInt(cassandraPortStr) + > PortOffsetFetcher.getPortOffset() + 1; > [javac] ^ > [javac] > /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java:87: > incompatible types > [javac] found : <nulltype> > [javac] required: int > [javac] tempPort = Integer.parseInt(cassandraPortStr) + > PortOffsetFetcher.getPortOffset() + 1; > > [javac] > ^ > [javac] > /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java:157: > cannot find symbol > [javac] symbol : variable PortOffsetFetcher > [javac] location: class > org.apache.hadoop.hive.cassandra.input.HiveCassandraStandardColumnInputFormat > [javac] rpcPort = > jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, 9160) + > PortOffsetFetcher.getPortOffset() + 1; > > [javac] > ^ > [javac] > /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java:157: > operator + cannot be applied to int,PortOffsetFetcher.getPortOffset > [javac] rpcPort = > jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, 9160) + > PortOffsetFetcher.getPortOffset() + 1; > [javac] ^ > [javac] > /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java:157: > operator + cannot be applied to <nulltype>,int > [javac] rpcPort = > jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, 9160) + > PortOffsetFetcher.getPortOffset() + 1; > > [javac] > ^ > [javac] > /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java:157: > incompatible types > [javac] found : <nulltype> > [javac] required: int > [javac] rpcPort = > jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, 9160) + > PortOffsetFetcher.getPortOffset() + 1; > > [javac] > ^ > [javac] Note: Some input files use or override a deprecated API. > [javac] Note: Recompile with -Xlint:deprecation for details. > [javac] Note: Some input files use unchecked or unsafe operations. > [javac] Note: Recompile with -Xlint:unchecked for details. > [javac] 9 errors > [INFO] > ------------------------------------------------------------------------ > > On Wed, Apr 17, 2013 at 6:40 PM, <[email protected]> wrote: > >> Author: [email protected] >> Date: Wed Apr 17 18:40:40 2013 >> New Revision: 170526 >> URL: http://wso2.org/svn/browse/wso2?view=rev&revision=170526 >> >> Log: >> Fixed pulic JIRA BAM-1138 with patch from Ayashkantha >> >> Modified: >> >> >> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java >> >> >> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraStorageHandler.java >> >> >> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java >> >> >> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/serde/AbstractColumnSerDe.java >> >> Modified: >> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java >> URL: >> http://wso2.org/svn/browse/wso2/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java?rev=170526&r1=170525&r2=170526&view=diff >> >> ============================================================================== >> --- >> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java >> (original) >> +++ >> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java >> Wed Apr 17 18:40:40 2013 >> @@ -78,8 +78,18 @@ >> this.password = password; >> } >> >> + String portOffsetEnabled = >> serdeParam.get(AbstractColumnSerDe.CARBON_PORT_OFFSET); >> + >> + >> try { >> - port = Integer.parseInt(cassandraPortStr); >> + int tempPort = 0; >> + if( portOffsetEnabled.equals("true")) { >> + tempPort = Integer.parseInt(cassandraPortStr) + >> PortOffsetFetcher.getPortOffset() + 1; >> + } >> + else { >> + tempPort = Integer.parseInt(cassandraPortStr); >> + } >> + port = tempPort; >> } catch (NumberFormatException e) { >> throw new MetaException(AbstractColumnSerDe.CASSANDRA_PORT + " >> must be a number"); >> } >> >> Modified: >> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraStorageHandler.java >> URL: >> http://wso2.org/svn/browse/wso2/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraStorageHandler.java?rev=170526&r1=170525&r2=170526&view=diff >> >> ============================================================================== >> --- >> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraStorageHandler.java >> (original) >> +++ >> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraStorageHandler.java >> Wed Apr 17 18:40:40 2013 >> @@ -60,6 +60,9 @@ >> >> jobProperties.put(AbstractColumnSerDe.CASSANDRA_COL_MAPPING, >> columnInfo); >> >> + jobProperties.put(AbstractColumnSerDe.CARBON_PORT_OFFSET, >> + tableProperties.getProperty( >> AbstractColumnSerDe.CARBON_PORT_OFFSET, "true" ) ); >> + >> jobProperties.put(AbstractColumnSerDe.CASSANDRA_HOST, >> tableProperties.getProperty(AbstractColumnSerDe.CASSANDRA_HOST, >> AbstractColumnSerDe.DEFAULT_CASSANDRA_HOST)); >> >> >> Modified: >> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java >> URL: >> http://wso2.org/svn/browse/wso2/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java?rev=170526&r1=170525&r2=170526&view=diff >> >> ============================================================================== >> --- >> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java >> (original) >> +++ >> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java >> Wed Apr 17 18:40:40 2013 >> @@ -19,8 +19,10 @@ >> import org.apache.commons.logging.Log; >> import org.apache.commons.logging.LogFactory; >> import org.apache.hadoop.fs.Path; >> +import org.apache.hadoop.hive.cassandra.PortOffsetFetcher; >> import org.apache.hadoop.hive.cassandra.serde.AbstractColumnSerDe; >> import org.apache.hadoop.hive.serde2.ColumnProjectionUtils; >> +import org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe; >> import org.apache.hadoop.io.BytesWritable; >> import org.apache.hadoop.io.MapWritable; >> import org.apache.hadoop.mapred.InputSplit; >> @@ -149,7 +151,14 @@ >> AbstractColumnSerDe.CASSANDRA_SPLIT_SIZE, >> AbstractColumnSerDe.DEFAULT_SPLIT_SIZE); >> String cassandraColumnMapping = >> jobConf.get(AbstractColumnSerDe.CASSANDRA_COL_MAPPING); >> - int rpcPort = jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, >> 9160); >> + int rpcPort = 0; >> + String portOffsetEnabled = >> jobConf.get(AbstractColumnSerDe.CARBON_PORT_OFFSET); >> + if( portOffsetEnabled.equals("true")) { >> + rpcPort = jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, >> 9160) + PortOffsetFetcher.getPortOffset() + 1; >> + } >> + else { >> + rpcPort = jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, >> 9160); >> + } >> String host = jobConf.get(AbstractColumnSerDe.CASSANDRA_HOST); >> String partitioner = >> jobConf.get(AbstractColumnSerDe.CASSANDRA_PARTITIONER); >> >> >> Modified: >> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/serde/AbstractColumnSerDe.java >> URL: >> http://wso2.org/svn/browse/wso2/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/serde/AbstractColumnSerDe.java?rev=170526&r1=170525&r2=170526&view=diff >> >> ============================================================================== >> --- >> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/serde/AbstractColumnSerDe.java >> (original) >> +++ >> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/serde/AbstractColumnSerDe.java >> Wed Apr 17 18:40:40 2013 >> @@ -57,6 +57,8 @@ >> public static final String CASSANDRA_SLICE_PREDICATE_RANGE_COUNT = >> "cassandra.slice.predicate.range.count"; >> public static final String CASSANDRA_ENABLE_WIDEROW_ITERATOR = >> "cassandra.enable.widerow.iterator"; >> >> + public static final String CARBON_PORT_OFFSET = "carbon.port.offset"; >> + >> public static final String CASSANDRA_SPECIAL_COLUMN_KEY = "row_key"; >> public static final String CASSANDRA_SPECIAL_COLUMN_COL = >> "column_name"; >> public static final String CASSANDRA_SPECIAL_COLUMN_SCOL= >> "sub_column_name"; >> _______________________________________________ >> Commits mailing list >> [email protected] >> http://wso2.org/cgi-bin/mailman/listinfo/commits >> > > > > -- > Regards, > > Tharindu Mathew > > Associate Technical Lead, WSO2 BAM > Member - Data Mgmt. Committee > > blog: http://tharindumathew.com/ > M: +94777759908 > > _______________________________________________ > Commits mailing list > [email protected] > http://wso2.org/cgi-bin/mailman/listinfo/commits > > -- *Kasun Weranga* ** Member, Management Committee - Data Technologies Software Engineer *WSO2, Inc. *lean.enterprise.middleware. mobile : +94 772314602 <http://sanjeewamalalgoda.blogspot.com/>blog : http://kasunweranga.blogspot.com/
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
