[
https://issues.apache.org/jira/browse/BIGTOP-1244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006501#comment-14006501
]
Konstantin Boudnik commented on BIGTOP-1244:
--------------------------------------------
Ok, I've tried the patch and I see that comment meant to say. Flume doesn't
reflect the singularity point of HBase. E.g. Flume still expect
{{org.apache.hbase:hbase:jar}} to be present in 0.98.2. Hence, I don't think
the later patch is adequate as it will be pulling in incorrect version of the
flume.
I can do in the flight-mod of the flume poms to start using hbase-client
artifact instead, but then the whole bunch of compile errors is kicking in.
E.g.
{noformat}
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:2.3.2:compile (default-compile)
on project flume-ng-hbase-sink: Compilation failure: Compilation failure:
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/AsyncHBaseSink.java:[44,30]
cannot find symbol
[ERROR] symbol : class HBaseConfiguration
[ERROR] location: package org.apache.hadoop.hbase
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/AsyncHBaseSink.java:[45,30]
cannot find symbol
[ERROR] symbol : class HConstants
[ERROR] location: package org.apache.hadoop.hbase
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java:[43,30]
cannot find symbol
[ERROR] symbol : class HBaseConfiguration
[ERROR] location: package org.apache.hadoop.hbase
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java:[44,30]
cannot find symbol
[ERROR] symbol : class HConstants
[ERROR] location: package org.apache.hadoop.hbase
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java:[49,35]
cannot find symbol
[ERROR] symbol : class Bytes
[ERROR] location: package org.apache.hadoop.hbase.util
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java:[57,39]
cannot find symbol
[ERROR] symbol : class User
[ERROR] location: package org.apache.hadoop.hbase.security
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java:[106,10]
cannot find symbol
[ERROR] symbol : class User
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSink
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSinkConfigurationConstants.java:[21,30]
cannot find symbol
[ERROR] symbol : class HConstants
[ERROR] location: package org.apache.hadoop.hbase
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSinkSecurityManager.java:[27,39]
cannot find symbol
[ERROR] symbol : class User
[ERROR] location: package org.apache.hadoop.hbase.security
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSinkSecurityManager.java:[71,29]
cannot find symbol
[ERROR] symbol : class User
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSinkSecurityManager
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/RegexHbaseEventSerializer.java:[193,13]
cannot access org.apache.hadoop.hbase.Cell
[ERROR] class file for org.apache.hadoop.hbase.Cell not found
[ERROR] put.add(cf, colNames.get(i), m.group(i + 1).getBytes(Charsets.UTF_8));
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSinkConfigurationConstants.java:[67,6]
cannot find symbol
[ERROR] symbol : variable HConstants
[ERROR] location: class
org.apache.flume.sink.hbase.HBaseSinkConfigurationConstants
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/AsyncHBaseSink.java:[368,15]
cannot find symbol
[ERROR] symbol : variable HBaseConfiguration
[ERROR] location: class org.apache.flume.sink.hbase.AsyncHBaseSink
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/AsyncHBaseSink.java:[371,27]
cannot find symbol
[ERROR] symbol : variable HConstants
[ERROR] location: class org.apache.flume.sink.hbase.AsyncHBaseSink
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/AsyncHBaseSink.java:[372,8]
cannot find symbol
[ERROR] symbol : variable HConstants
[ERROR] location: class org.apache.flume.sink.hbase.AsyncHBaseSink
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java:[116,9]
cannot find symbol
[ERROR] symbol : variable HBaseConfiguration
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSink
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java:[148,25]
cannot access org.apache.hadoop.hbase.TableName
[ERROR] class file for org.apache.hadoop.hbase.TableName not found
[ERROR] HTable table = new HTable(config, tableName);
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java:[170,50]
cannot find symbol
[ERROR] symbol : variable Bytes
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSink
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java:[178,16]
cannot find symbol
[ERROR] symbol : variable Bytes
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSink
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java:[291,15]
cannot find symbol
[ERROR] symbol : variable HConstants
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSink
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java:[293,22]
cannot find symbol
[ERROR] symbol : variable HConstants
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSink
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java:[294,25]
cannot find symbol
[ERROR] symbol : variable HConstants
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSink
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java:[299,22]
cannot find symbol
[ERROR] symbol : variable HConstants
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSink
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java:[491,24]
cannot find symbol
[ERROR] symbol : variable Bytes
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSink
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java:[542,33]
cannot find symbol
[ERROR] symbol : variable Bytes
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSink
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java:[548,35]
cannot find symbol
[ERROR] symbol : variable Bytes
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSink
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSinkSecurityManager.java:[56,11]
cannot find symbol
[ERROR] symbol : variable User
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSinkSecurityManager
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSinkSecurityManager.java:[56,39]
cannot find symbol
[ERROR] symbol : variable User
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSinkSecurityManager
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSinkSecurityManager.java:[106,4]
cannot find symbol
[ERROR] symbol : class User
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSinkSecurityManager
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSinkSecurityManager.java:[113,20]
cannot find symbol
[ERROR] symbol : variable User
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSinkSecurityManager
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSinkSecurityManager.java:[126,6]
cannot find symbol
[ERROR] symbol : variable User
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSinkSecurityManager
[ERROR]
/home/cos/work/bigtop/build/flume/rpm/BUILD/apache-flume-1.5.0-src/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSinkSecurityManager.java:[127,18]
cannot find symbol
[ERROR] symbol : variable User
[ERROR] location: class org.apache.flume.sink.hbase.HBaseSinkSecurityManager
[ERROR] -> [Help 1]
[ERROR]
{noformat}
Is it me or Flume 1.5 isn't ready for HBase 0.98?
> bump flume to 1.5.0
> -------------------
>
> Key: BIGTOP-1244
> URL: https://issues.apache.org/jira/browse/BIGTOP-1244
> Project: Bigtop
> Issue Type: Sub-task
> Components: Build
> Affects Versions: 0.8.0
> Reporter: Guo Ruijing
> Fix For: 0.8.0
>
> Attachments: BIGTOP-1244.1.patch, BIGTOP-1244.patch
>
>
> flume 1.4.0 build fails with protobuf 2.5.0. I propose to bump flume to 1.4.0
> + Flume-2172 or new version of flume
> solution: Flume-2172 can be placed in bigtop-packages/src/common/flume/
> Renaming the ticket as Flume 1.5 is planned to be release around right now
--
This message was sent by Atlassian JIRA
(v6.2#6252)
