Thanks Kasun. It's building now. On Wed, Apr 17, 2013 at 11:57 PM, Kasun Weranga <[email protected]> wrote:
> I added the missing class. Maninda please always do svn status before > committing patches, otherwise you might miss newly added classes. > > Thanks, > KasunW. > > > On Wed, Apr 17, 2013 at 10:43 PM, Tharindu Mathew <[email protected]>wrote: > >> Maninda, >> >> The build seems to be broken from this commit. I believe there is no >> PortOffsetFetcher file. Did you compile this before committing? >> >> This is the error I'm getting: >> >> rg.apache.hive-hive-cassandra-handler-default.html >> >> ivy-retrieve: >> [echo] Project: cassandra-handler >> >> compile: >> [echo] Project: cassandra-handler >> [javac] Compiling 31 source files to >> /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/build/cassandra-handler/classes >> [javac] >> /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java:22: >> cannot find symbol >> [javac] symbol : class PortOffsetFetcher >> [javac] location: package org.apache.hadoop.hive.cassandra >> [javac] import org.apache.hadoop.hive.cassandra.PortOffsetFetcher; >> [javac] ^ >> [javac] >> /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java:87: >> cannot find symbol >> [javac] symbol : variable PortOffsetFetcher >> [javac] location: class >> org.apache.hadoop.hive.cassandra.CassandraManager >> [javac] tempPort = Integer.parseInt(cassandraPortStr) + >> PortOffsetFetcher.getPortOffset() + 1; >> [javac] ^ >> [javac] >> /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java:87: >> operator + cannot be applied to int,PortOffsetFetcher.getPortOffset >> [javac] tempPort = Integer.parseInt(cassandraPortStr) + >> PortOffsetFetcher.getPortOffset() + 1; >> [javac] ^ >> [javac] >> /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java:87: >> operator + cannot be applied to <nulltype>,int >> [javac] tempPort = Integer.parseInt(cassandraPortStr) + >> PortOffsetFetcher.getPortOffset() + 1; >> [javac] ^ >> [javac] >> /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java:87: >> incompatible types >> [javac] found : <nulltype> >> [javac] required: int >> [javac] tempPort = Integer.parseInt(cassandraPortStr) + >> PortOffsetFetcher.getPortOffset() + 1; >> >> [javac] >> ^ >> [javac] >> /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java:157: >> cannot find symbol >> [javac] symbol : variable PortOffsetFetcher >> [javac] location: class >> org.apache.hadoop.hive.cassandra.input.HiveCassandraStandardColumnInputFormat >> [javac] rpcPort = >> jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, 9160) + >> PortOffsetFetcher.getPortOffset() + 1; >> >> [javac] >> ^ >> [javac] >> /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java:157: >> operator + cannot be applied to int,PortOffsetFetcher.getPortOffset >> [javac] rpcPort = >> jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, 9160) + >> PortOffsetFetcher.getPortOffset() + 1; >> [javac] ^ >> [javac] >> /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java:157: >> operator + cannot be applied to <nulltype>,int >> [javac] rpcPort = >> jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, 9160) + >> PortOffsetFetcher.getPortOffset() + 1; >> >> [javac] >> ^ >> [javac] >> /Users/mackie/source-checkouts/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java:157: >> incompatible types >> [javac] found : <nulltype> >> [javac] required: int >> [javac] rpcPort = >> jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, 9160) + >> PortOffsetFetcher.getPortOffset() + 1; >> >> [javac] >> ^ >> [javac] Note: Some input files use or override a deprecated API. >> [javac] Note: Recompile with -Xlint:deprecation for details. >> [javac] Note: Some input files use unchecked or unsafe operations. >> [javac] Note: Recompile with -Xlint:unchecked for details. >> [javac] 9 errors >> [INFO] >> ------------------------------------------------------------------------ >> >> On Wed, Apr 17, 2013 at 6:40 PM, <[email protected]> wrote: >> >>> Author: [email protected] >>> Date: Wed Apr 17 18:40:40 2013 >>> New Revision: 170526 >>> URL: http://wso2.org/svn/browse/wso2?view=rev&revision=170526 >>> >>> Log: >>> Fixed pulic JIRA BAM-1138 with patch from Ayashkantha >>> >>> Modified: >>> >>> >>> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java >>> >>> >>> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraStorageHandler.java >>> >>> >>> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java >>> >>> >>> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/serde/AbstractColumnSerDe.java >>> >>> Modified: >>> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java >>> URL: >>> http://wso2.org/svn/browse/wso2/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java?rev=170526&r1=170525&r2=170526&view=diff >>> >>> ============================================================================== >>> --- >>> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java >>> (original) >>> +++ >>> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraManager.java >>> Wed Apr 17 18:40:40 2013 >>> @@ -78,8 +78,18 @@ >>> this.password = password; >>> } >>> >>> + String portOffsetEnabled = >>> serdeParam.get(AbstractColumnSerDe.CARBON_PORT_OFFSET); >>> + >>> + >>> try { >>> - port = Integer.parseInt(cassandraPortStr); >>> + int tempPort = 0; >>> + if( portOffsetEnabled.equals("true")) { >>> + tempPort = Integer.parseInt(cassandraPortStr) + >>> PortOffsetFetcher.getPortOffset() + 1; >>> + } >>> + else { >>> + tempPort = Integer.parseInt(cassandraPortStr); >>> + } >>> + port = tempPort; >>> } catch (NumberFormatException e) { >>> throw new MetaException(AbstractColumnSerDe.CASSANDRA_PORT + " >>> must be a number"); >>> } >>> >>> Modified: >>> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraStorageHandler.java >>> URL: >>> http://wso2.org/svn/browse/wso2/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraStorageHandler.java?rev=170526&r1=170525&r2=170526&view=diff >>> >>> ============================================================================== >>> --- >>> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraStorageHandler.java >>> (original) >>> +++ >>> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/CassandraStorageHandler.java >>> Wed Apr 17 18:40:40 2013 >>> @@ -60,6 +60,9 @@ >>> >>> jobProperties.put(AbstractColumnSerDe.CASSANDRA_COL_MAPPING, >>> columnInfo); >>> >>> + jobProperties.put(AbstractColumnSerDe.CARBON_PORT_OFFSET, >>> + tableProperties.getProperty( >>> AbstractColumnSerDe.CARBON_PORT_OFFSET, "true" ) ); >>> + >>> jobProperties.put(AbstractColumnSerDe.CASSANDRA_HOST, >>> tableProperties.getProperty(AbstractColumnSerDe.CASSANDRA_HOST, >>> AbstractColumnSerDe.DEFAULT_CASSANDRA_HOST)); >>> >>> >>> Modified: >>> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java >>> URL: >>> http://wso2.org/svn/browse/wso2/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java?rev=170526&r1=170525&r2=170526&view=diff >>> >>> ============================================================================== >>> --- >>> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java >>> (original) >>> +++ >>> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/input/HiveCassandraStandardColumnInputFormat.java >>> Wed Apr 17 18:40:40 2013 >>> @@ -19,8 +19,10 @@ >>> import org.apache.commons.logging.Log; >>> import org.apache.commons.logging.LogFactory; >>> import org.apache.hadoop.fs.Path; >>> +import org.apache.hadoop.hive.cassandra.PortOffsetFetcher; >>> import org.apache.hadoop.hive.cassandra.serde.AbstractColumnSerDe; >>> import org.apache.hadoop.hive.serde2.ColumnProjectionUtils; >>> +import org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe; >>> import org.apache.hadoop.io.BytesWritable; >>> import org.apache.hadoop.io.MapWritable; >>> import org.apache.hadoop.mapred.InputSplit; >>> @@ -149,7 +151,14 @@ >>> AbstractColumnSerDe.CASSANDRA_SPLIT_SIZE, >>> AbstractColumnSerDe.DEFAULT_SPLIT_SIZE); >>> String cassandraColumnMapping = >>> jobConf.get(AbstractColumnSerDe.CASSANDRA_COL_MAPPING); >>> - int rpcPort = jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, >>> 9160); >>> + int rpcPort = 0; >>> + String portOffsetEnabled = >>> jobConf.get(AbstractColumnSerDe.CARBON_PORT_OFFSET); >>> + if( portOffsetEnabled.equals("true")) { >>> + rpcPort = jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, >>> 9160) + PortOffsetFetcher.getPortOffset() + 1; >>> + } >>> + else { >>> + rpcPort = jobConf.getInt(AbstractColumnSerDe.CASSANDRA_PORT, >>> 9160); >>> + } >>> String host = jobConf.get(AbstractColumnSerDe.CASSANDRA_HOST); >>> String partitioner = >>> jobConf.get(AbstractColumnSerDe.CASSANDRA_PARTITIONER); >>> >>> >>> Modified: >>> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/serde/AbstractColumnSerDe.java >>> URL: >>> http://wso2.org/svn/browse/wso2/carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/serde/AbstractColumnSerDe.java?rev=170526&r1=170525&r2=170526&view=diff >>> >>> ============================================================================== >>> --- >>> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/serde/AbstractColumnSerDe.java >>> (original) >>> +++ >>> carbon/platform/branches/4.1.0/dependencies/hive/0.8.1-wso2v7/cassandra-handler/src/java/org/apache/hadoop/hive/cassandra/serde/AbstractColumnSerDe.java >>> Wed Apr 17 18:40:40 2013 >>> @@ -57,6 +57,8 @@ >>> public static final String CASSANDRA_SLICE_PREDICATE_RANGE_COUNT = >>> "cassandra.slice.predicate.range.count"; >>> public static final String CASSANDRA_ENABLE_WIDEROW_ITERATOR = >>> "cassandra.enable.widerow.iterator"; >>> >>> + public static final String CARBON_PORT_OFFSET = "carbon.port.offset"; >>> + >>> public static final String CASSANDRA_SPECIAL_COLUMN_KEY = "row_key"; >>> public static final String CASSANDRA_SPECIAL_COLUMN_COL = >>> "column_name"; >>> public static final String CASSANDRA_SPECIAL_COLUMN_SCOL= >>> "sub_column_name"; >>> _______________________________________________ >>> Commits mailing list >>> [email protected] >>> http://wso2.org/cgi-bin/mailman/listinfo/commits >>> >> >> >> >> -- >> Regards, >> >> Tharindu Mathew >> >> Associate Technical Lead, WSO2 BAM >> Member - Data Mgmt. Committee >> >> blog: http://tharindumathew.com/ >> M: +94777759908 >> >> _______________________________________________ >> Commits mailing list >> [email protected] >> http://wso2.org/cgi-bin/mailman/listinfo/commits >> >> > > > -- > *Kasun Weranga* > ** > Member, Management Committee - Data Technologies > Software Engineer > *WSO2, Inc. > *lean.enterprise.middleware. > mobile : +94 772314602 > <http://sanjeewamalalgoda.blogspot.com/>blog : > http://kasunweranga.blogspot.com/ > -- Regards, Tharindu Mathew Associate Technical Lead, WSO2 BAM Member - Data Mgmt. Committee blog: http://tharindumathew.com/ M: +94777759908
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
