Re: HBase master WebUI is not responding

Did the exception lead to hbase:meta assignment failure ? Please check region server log on 10.10.8.53 On Thu, Sep 3, 2015 at 7:15 AM, Akmal Abbasov wrote: > Hi Ted, > I’m getting a lot of > 2015-09-03 14:08:20,651 WARN

Problem MapReduce Total Sort, Word Count example

I want to do a total sort in mapreduce Word Count. public int run(String[] args) throws Exception { Job job = Job.getInstance(getConf(), "wordcount"); job.setJarByClass(this.getClass()); FileInputFormat.addInputPath(job, new Path(args[0])); FileOutputFormat.setOutputPath(job, new

Re: HBase master WebUI is not responding

Hi Ted, I’m getting a lot of 2015-09-03 14:08:20,651 WARN [1865504699@qtp-838397579-13] client.HConnectionManager$HConnectionImplementation: Checking master connection com.google.protobuf.ServiceException: java.net.SocketTimeoutException: Call to test-m/10.10.8.53:6 failed because

Re: HBase master WebUI is not responding

Can you log into the master node and check master log ? Pastebin snippet of master log if you need more help. Cheers > On Sep 3, 2015, at 6:24 AM, Akmal Abbasov wrote: > > Hi, > I’m having problems with accessing HBase master webui. when I try to access > it, it

Re: High iowait in idle hbase cluster

I’ve started HDFS balancer, but then stopped it immediately after knowing that it is not a good idea. but it was around 3 weeks ago, is it possible that it had an influence on the cluster behaviour I’m having now? Thanks. > On 03 Sep 2015, at 14:23, Akmal Abbasov

Re: High iowait in idle hbase cluster

Hi Adrien, I’ve tried to run hdfs fsck and hbase hbck, and hdfs is healthy, also hbase is consistent. I’m using default value of the replication, so it is 3. There are some under replicated HBase master(node 10.10.8.55) is reading constantly from regionservers. Only today, it send >150.000

Re: High iowait in idle hbase cluster

Is your HDFS healthy (fsck /)? Same for hbase hbck? What's your replication level? Can you see constant network use as well? Anything than might be triggered by the hbasemaster? (something like a virtually dead RS, due to ZK race-condition, etc.) Your 3-weeks-ago balancer shouldn't have any

Re: High iowait in idle hbase cluster

Is the uptime of RS "normal"? No quick and global reboot that could lead into a regiongi-reallocation-storm? On 3 September 2015 at 18:42, Akmal Abbasov wrote: > Hi Adrien, > I’ve tried to run hdfs fsck and hbase hbck, and hdfs is healthy, also > hbase is consistent. >

RE: Interface expected in the map definition?

Hi The MyMap class extends and implements the same classes as the ones defined in the original wordcount example, but in my case I get the error of “Interface expected here”. I really don’t understand why I get this error. See my example below [1]. Any help here? Can you please share the

Re: High iowait in idle hbase cluster

Hi Ted, No there is no short-circuit read configured. The logs of datanode of the 10.10.8.55 are full of following messages 2015-09-03 12:03:56,324 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: /10.10.8.55:50010, dest: /10.10.8.53:58622, bytes: 77, op: HDFS_READ, cliID:

Re: processing data evenly

Static only makes sense in the same JVM and classloader. In a distributed setting it is not useful On Sep 2, 2015 5:08 PM, "Arni Sumarlidason" wrote: > I'm having problems getting my data reduced evenly across nodes. > > -> map a 200,000 line single text file and output

Re: processing data evenly

Evening all, I ended up doing a map using the hashCode of the host's ip address; giving me reductions by machine. However, I am now experiencing memory problems processing sequence files of large TwoDWritableArrays; specifically it seems to process normally until its about to write the result --

HBase master WebUI is not responding

Hi, I’m having problems with accessing HBase master webui. when I try to access it, it returns redirect page /master-status, and then it is freezes. I’ve tried to wait for a long time, but still it didn’t work. I am using hbase hbase-0.98.7-hadoop2, hadoop hadoop-2.5.1 Any suggestions? Thanks.