[jira] [Created] (ORC-400) Support Hadoop3 in C++ lib

[Quanlong Huang (JIRA)]

Quanlong Huang created ORC-400:
--

 Summary: Support Hadoop3 in C++ lib
 Key: ORC-400
 URL: https://issues.apache.org/jira/browse/ORC-400
 Project: ORC
  Issue Type: New Feature
Reporter: Quanlong Huang


After ORC-17, we now depends on hadoop c++ lib. When linking liborc into 
Impala-3.x which depends on hadoop3, we found the following errors:
{code}
../../../toolchain/openldap-2.4.25/lib/libldap.a(os-ip.o):os-ip.c:function 
ldap_int_poll: warning: `sys_nerr' is deprecated; use `strerror' or 
`strerror_r' instead
../../../toolchain/openldap-2.4.25/lib/libldap.a(os-ip.o):os-ip.c:function 
ldap_int_poll: warning: `sys_errlist' is deprecated; use `strerror' or 
`strerror_r' instead
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::read(void*, unsigned long, unsigned long): error: 
undefined reference to 'hdfs::Status::ToString() const'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::URI::URI()'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::URI::parse_from_string(std::string const&)'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::ConfigParser::ConfigParser()'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::ConfigParser::LoadDefaultResources()'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::ConfigParser::ValidateResources() const'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::Options::Options()'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::ConfigParser::get_options(hdfs::Options&) const'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::IoService::New()'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::FileSystem::New(hdfs::IoService*&, std::string const&, 
hdfs::Options const&)'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::URI::get_host(bool) const'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::URI::get_path(bool) const'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::StatInfo::StatInfo()'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::URI::get_path(bool) const'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::ConfigParser::~ConfigParser()'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::URI::has_port() const'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::URI::get_port() const'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::URI::get_host(bool) const'
../../../toolchain/orc-1.5.2-p1/lib/liborc.a(OrcHdfsFile.cc.o):OrcHdfsFile.cc:function
 orc::HdfsFileInputStream::HdfsFileInputStream(std::string): error: undefined 
reference to 'hdfs::URI::get_host(bool) const'

Speakers needed for Apache DC Roadshow

[Rich Bowen]

We need your help to make the Apache Washington DC Roadshow on Dec 4th a 
success.


What do we need most? Speakers!

We're bringing a unique DC flavor to this event by mixing Open Source 
Software with talks about Apache projects as well as OSS CyberSecurity, 
OSS in Government and and OSS Career advice.


Please take a look at: http://www.apachecon.com/usroadshow18/

(Note: You are receiving this message because you are subscribed to one 
or more mailing lists at The Apache Software Foundation.)


Rich, for the ApacheCon Planners

--
rbo...@apache.org
http://apachecon.com
@ApacheCon

[GitHub] orc issue #299: ORC-203 - Update StringStatistics to trim long strings to 10...

[omalley]

Github user omalley commented on the issue:

https://github.com/apache/orc/pull/299
  
I simplified the code to get the upper bound. I also added 4 test cases to 
test the different number of bytes in the utf-8 characters.
See https://github.com/omalley/orc/tree/orc-203



---