[jira] [Created] (HBASE-15313) Error compiling hbase with Java8 and Hadoop2
Kshitij Shukla created HBASE-15313:
--
Summary: Error compiling hbase with Java8 and Hadoop2
Key: HBASE-15313
URL: https://issues.apache.org/jira/browse/HBASE-15313
Project: HBase
Issue Type: Bug
Components: API
Affects Versions: 0.98.8
Environment: Apache Maven 3.3.9
Maven home: /home/c1/apache-maven-3.3.9
Java version: jdk1.8.0_25, vendor: Oracle Corporation
Java home: /usr/lib/jvm/jdk1.8.0_25/jre
Default locale: en_IN, platform encoding: UTF-8
OS name: "linux/centos", version: "2.6.32-573.12.1.el6.x86_64", arch: "amd64",
family: "unix"
Hbase : hbase-0.98.8-hadoop2
Hadoop: 2.5.2
Reporter: Kshitij Shukla
Priority: Minor
Getting this error while compiling hbase-0.98.8 using this command *mvn package
-DskipTests"* with JAVA8.
{quote} PoolMap.java error: name clash: remove(K,V) in PoolMap and
remove(Object,Object) in Map have the same erasure, yet neither overrides the
other {quote}
However its working when tried Java7. Sorry If I sound less informative about
error. I am a newbie and not very familiar with the issue posting practice :)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[CIS-CMMI-3] HBASE_CLIENT_PREFETCH_LIMIT
Hello everyone, I am having this error when I tried to run ./crawl command. I am using following software stack : *apache-nutch-2.3.1** **hadoop-2.6.2** **hbase-1.1.3* Starts ERROR *** [root@ns613 bin]# ./crawl /seeds 1 http://ns613.mycyberhosting.com:8983/solr/ddcds 2 Injecting seed URLs /home/cluster/apache-nutch-2.3.1/runtime/deploy/bin/nutch inject /seeds -crawlId 1 16/02/01 14:31:15 INFO crawl.InjectorJob: InjectorJob: starting at 2016-02-01 14:31:15 16/02/01 14:31:15 INFO crawl.InjectorJob: InjectorJob: Injecting urlDir: /seeds 16/02/01 14:31:15 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Exception in thread "main" java.lang.NoSuchFieldError: HBASE_CLIENT_PREFETCH_LIMIT at org.apache.hadoop.hbase.client.HConnectionKey.(HConnectionKey.java:43) at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:267) at org.apache.hadoop.hbase.client.HBaseAdmin.(HBaseAdmin.java:194) at org.apache.gora.hbase.store.HBaseStore.initialize(HBaseStore.java:115) at org.apache.gora.store.DataStoreFactory.initializeDataStore(DataStoreFactory.java:102) at org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:161) at org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:135) at org.apache.nutch.storage.StorageUtils.createWebStore(StorageUtils.java:78) at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:218) at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:252) at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:275) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:284) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) Error running: /home/cluster/apache-nutch-2.3.1/runtime/deploy/bin/nutch inject /seeds -crawlId 1 Failed with exit value 1. END ERROR *** -- Please let me know if you have any questions , concerns or updates. Have a great day ahead :) Thanks and Regards, Kshitij Shukla Software developer *Cyber Infrastructure(CIS) **/The RightSourcing Specialists with 1250 man years of experience!/* DISCLAIMER: INFORMATION PRIVACY is important for us, If you are not the intended recipient, you should delete this message and are notified that any disclosure, copying or distribution of this message, or taking any action based on it, is strictly prohibited by Law. Please don't print this e-mail unless you really need to. -- -- *Cyber Infrastructure (P) Limited, [CIS] **(CMMI Level 3 Certified)* Central India's largest Technology company. *Ensuring the success of our clients and partners through our highly optimized Technology solutions.* www.cisin.com | +Cisin <https://plus.google.com/+Cisin/> | Linkedin <https://www.linkedin.com/company/cyber-infrastructure-private-limited> | Offices: *Indore, India.* *Singapore. Silicon Valley, USA*. DISCLAIMER: INFORMATION PRIVACY is important for us, If you are not the intended recipient, you should delete this message and are notified that any disclosure, copying or distribution of this message, or taking any action based on it, is strictly prohibited by Law.
[CIS-CMMI-3] IllegalArgumentException: Row length 41221 is > 32767
Hello everyone, Software stack is *nutch-branch-2.3.1, gora-hbase 0.6.1 Hadoop 2.5.2, hbase-0.98.8-hadoop2 * I have added a set of seeds to crawl using this command * ./bin/crawl /largeSeeds 1 http://localhost:8983/solr/ddcd 4* For first iteration all of the commands(*inject, **generate, **fetch, **parse, **update-table, **Indexer & delete duplicates.*) got executed successfully. For second iteration, *"CrawlDB update" *command got failed (please see error log for reference), because of failure of this command the whole process gets terminated. LOG START 16/01/20 02:45:19 INFO parse.ParserJob: ParserJob: finished at 2016-01-20 02:45:19, time elapsed: 00:06:57 CrawlDB update for 1 /usr/share/searchEngine/nutch-branch-2.3.1/runtime/deploy/bin/nutch updatedb -D mapred.reduce.tasks=2 -D mapred.child.java.opts=-Xmx1000m -D mapred.reduce.tasks.speculative.execution=false -D mapred.map.tasks.speculative.execution=false -D mapred.compress.map.output=true 1453230757-13191 -crawlId 1 16/01/20 02:45:27 INFO crawl.DbUpdaterJob: DbUpdaterJob: starting at 2016-01-20 02:45:27 16/01/20 02:45:27 INFO crawl.DbUpdaterJob: DbUpdaterJob: batchId: 1453230757-13191 16/01/20 02:45:27 INFO plugin.PluginRepository: Plugins: looking in: /tmp/hadoop-root/hadoop-unjar5654418190157422003/classes/plugins 16/01/20 02:45:28 INFO plugin.PluginRepository: Plugin Auto-activation mode: [true] 16/01/20 02:45:28 INFO plugin.PluginRepository: Registered Plugins: 16/01/20 02:45:28 INFO plugin.PluginRepository: HTTP Framework (lib-http) 16/01/20 02:45:28 INFO plugin.PluginRepository: Html Parse Plug-in (parse-html) 16/01/20 02:45:28 INFO plugin.PluginRepository: MetaTags (parse-metatags) 16/01/20 02:45:28 INFO plugin.PluginRepository: the nutch core extension points (nutch-extensionpoints) 16/01/20 02:45:28 INFO plugin.PluginRepository: Basic Indexing Filter (index-basic) 16/01/20 02:45:28 INFO plugin.PluginRepository: XML Libraries (lib-xml) 16/01/20 02:45:28 INFO plugin.PluginRepository: Anchor Indexing Filter (index-anchor) 16/01/20 02:45:28 INFO plugin.PluginRepository: Basic URL Normalizer (urlnormalizer-basic) 16/01/20 02:45:28 INFO plugin.PluginRepository: Language Identification Parser/Filter (language-identifier) 16/01/20 02:45:28 INFO plugin.PluginRepository: Metadata Indexing Filter (index-metadata) 16/01/20 02:45:28 INFO plugin.PluginRepository: CyberNeko HTML Parser (lib-nekohtml) 16/01/20 02:45:28 INFO plugin.PluginRepository: Subcollection indexing and query filter (subcollection) 16/01/20 02:45:28 INFO plugin.PluginRepository: SOLRIndexWriter (indexer-solr) 16/01/20 02:45:28 INFO plugin.PluginRepository: Rel-Tag microformat Parser/Indexer/Querier (microformats-reltag) 16/01/20 02:45:28 INFO plugin.PluginRepository: Http / Https Protocol Plug-in (protocol-httpclient) 16/01/20 02:45:28 INFO plugin.PluginRepository: JavaScript Parser (parse-js) 16/01/20 02:45:28 INFO plugin.PluginRepository: Tika Parser Plug-in (parse-tika) 16/01/20 02:45:28 INFO plugin.PluginRepository: Top Level Domain Plugin (tld) 16/01/20 02:45:28 INFO plugin.PluginRepository: Regex URL Filter Framework (lib-regex-filter) 16/01/20 02:45:28 INFO plugin.PluginRepository: Regex URL Normalizer (urlnormalizer-regex) 16/01/20 02:45:28 INFO plugin.PluginRepository: Link Analysis Scoring Plug-in (scoring-link) 16/01/20 02:45:28 INFO plugin.PluginRepository: OPIC Scoring Plug-in (scoring-opic) 16/01/20 02:45:28 INFO plugin.PluginRepository: More Indexing Filter (index-more) 16/01/20 02:45:28 INFO plugin.PluginRepository: Http Protocol Plug-in (protocol-http) 16/01/20 02:45:28 INFO plugin.PluginRepository: Creative Commons Plugins (creativecommons) 16/01/20 02:45:28 INFO plugin.PluginRepository: Registered Extension-Points: 16/01/20 02:45:28 INFO plugin.PluginRepository: Parse Filter (org.apache.nutch.parse.ParseFilter) 16/01/20 02:45:28 INFO plugin.PluginRepository: Nutch Index Cleaning Filter (org.apache.nutch.indexer.IndexCleaningFilter) 16/01/20 02:45:28 INFO plugin.PluginRepository: Nutch Content Parser (org.apache.nutch.parse.Parser) 16/01/20 02:45:28 INFO plugin.PluginRepository: Nutch URL Filter (org.apache.nutch.net.URLFilter) 16/01/20 02:45:28 INFO plugin.PluginRepository: Nutch Scoring (org.apache.nutch.scoring.ScoringFilter) 16/01/20 02:45:28 INFO plugin.PluginRepository: Nutch URL Normalizer (org.apache.nutch.net.URLNormalizer) 16/01/20 02:45:28 INFO plugin.PluginRepository: Nutch Protocol (org.apache.nutch.protocol.Protocol) 16/01/20 02:45:28 INFO plugin.PluginRepository: Nutch Index Writer (org.apache.nutch.indexer.IndexWriter) 16/01/20 02:45:28 INFO plugin.PluginRepository: Nutch Indexing Filter
