Re: [ANNOUNCE] New HBase committer Guanghao Zhang

2016-12-19 Thread 宾莉金 or binlijin
Congratulations and welcome!

2016-12-20 12:54 GMT+08:00 Nick Dimiduk :

> Congratulations Guanghao and thank you for all your contributions!
>
> On Mon, Dec 19, 2016 at 5:37 PM Duo Zhang  wrote:
>
> > On behalf of the Apache HBase PMC, I am pleased to announce that Guanghao
> >
> > Zhang has accepted the PMC's invitation to become a committer on the
> >
> > project. We appreciate all of Guanghao's generous contributions thus far
> >
> > and look forward to his continued involvement.
> >
> >
> >
> > Congratulations and welcome, Guanghao!
> >
> >
>



-- 
*Best Regards,*
 lijin bin


Re: [ANNOUNCE] New HBase committer Guanghao Zhang

2016-12-19 Thread Nick Dimiduk
Congratulations Guanghao and thank you for all your contributions!

On Mon, Dec 19, 2016 at 5:37 PM Duo Zhang  wrote:

> On behalf of the Apache HBase PMC, I am pleased to announce that Guanghao
>
> Zhang has accepted the PMC's invitation to become a committer on the
>
> project. We appreciate all of Guanghao's generous contributions thus far
>
> and look forward to his continued involvement.
>
>
>
> Congratulations and welcome, Guanghao!
>
>


Re: [ANNOUNCE] New HBase committer Guanghao Zhang

2016-12-19 Thread Andrew Purtell
Congratulations and welcome!


On Mon, Dec 19, 2016 at 5:37 PM, Duo Zhang  wrote:

> On behalf of the Apache HBase PMC, I am pleased to announce that Guanghao
> Zhang has accepted the PMC's invitation to become a committer on the
> project. We appreciate all of Guanghao's generous contributions thus far
> and look forward to his continued involvement.
>
> Congratulations and welcome, Guanghao!
>



-- 
Best regards,

   - Andy

If you are given a choice, you believe you have acted freely. - Raymond
Teller (via Peter Watts)


RE: [ANNOUNCE] New HBase committer Guanghao Zhang

2016-12-19 Thread Pankaj kr
Congratulations Guanghao..!! :) 

-Original Message-
From: Duo Zhang [mailto:zhang...@apache.org] 
Sent: Tuesday, December 20, 2016 9:38 AM
To: d...@hbase.apache.org; hbase-user
Subject: [ANNOUNCE] New HBase committer Guanghao Zhang

On behalf of the Apache HBase PMC, I am pleased to announce that Guanghao Zhang 
has accepted the PMC's invitation to become a committer on the project. We 
appreciate all of Guanghao's generous contributions thus far and look forward 
to his continued involvement.

Congratulations and welcome, Guanghao!


RE: [ANNOUNCE] New HBase committer Lijin Bin

2016-12-19 Thread Pankaj kr
Congratulations Lijin..!! :)

-Original Message-
From: Duo Zhang [mailto:zhang...@apache.org] 
Sent: Tuesday, November 29, 2016 5:48 PM
To: d...@hbase.apache.org; user@hbase.apache.org
Subject: [ANNOUNCE] New HBase committer Lijin Bin

On behalf of the Apache HBase PMC, I am pleased to announce that Lijin
Bin(binlijin) has accepted the PMC's invitation to become a committer on the 
project. We appreciate all of Lijin's generous contributions thus far and look 
forward to his continued involvement.

Congratulations and welcome, Lijin!


RE: [ANNOUNCE] New HBase Committer Josh Elser

2016-12-19 Thread Pankaj kr
Congratulations Josh..!! :)

-Original Message-
From: Nick Dimiduk [mailto:ndimi...@apache.org] 
Sent: Sunday, December 11, 2016 3:48 AM
To: hbase-user; hbase-dev
Subject: [ANNOUNCE] New HBase Committer Josh Elser

On behalf of the Apache HBase PMC, I am pleased to announce that Josh Elser has 
accepted the PMC's invitation to become a committer on the project. We 
appreciate all of Josh's generous contributions thus far and look forward to 
his continued involvement.

Allow me to be the first to congratulate and welcome Josh into his new role!


RE: [ANNOUNCE] New HBase committer Phil Yang

2016-12-19 Thread Pankaj kr
Congratulations Phil..!! :)

-Original Message-
From: Duo Zhang [mailto:zhang...@apache.org] 
Sent: Tuesday, November 29, 2016 5:49 PM
To: d...@hbase.apache.org; user@hbase.apache.org
Subject: [ANNOUNCE] New HBase committer Phil Yang

On behalf of the Apache HBase PMC, I am pleased to announce that Phil Yang has 
accepted the PMC's invitation to become a committer on the project. We 
appreciate all of Phil's generous contributions thus far and look forward to 
his continued involvement.

Congratulations and welcome, Phil!


[ANNOUNCE] New HBase committer Guanghao Zhang

2016-12-19 Thread Duo Zhang
On behalf of the Apache HBase PMC, I am pleased to announce that Guanghao
Zhang has accepted the PMC's invitation to become a committer on the
project. We appreciate all of Guanghao's generous contributions thus far
and look forward to his continued involvement.

Congratulations and welcome, Guanghao!


Re: How to set NameSpace while storing from Spark to HBase using saveAsNewAPIHadoopDataSet

2016-12-19 Thread Dhaval Modi
Replace  with ":"

Regards,
Dhaval Modi

On 19 December 2016 at 13:10, Rabin Banerjee 
wrote:

> HI All,
>
>   I am trying to save data from Spark into HBase using saveHadoopDataSet
> API . Please refer the below code . Code is working fine .But the table is
> getting stored in the default namespace.how to set the NameSpace in the
> below code?
>
>
>
>
> wordCounts.foreachRDD ( rdd = {
>   val conf = HBaseConfiguration.create()
>   conf.set(TableOutputFormat.OUTPUT_TABLE, "stream_count")
>   conf.set("hbase.zookeeper.quorum", "localhost:2181")
>   conf.set("hbase.master", "localhost:6");
>   conf.set("hbase.rootdir", "file:///tmp/hbase")
>
>   val jobConf = new Configuration(conf)
>   jobConf.set("mapreduce.job.output.key.class", classOf[Text].getName)
>   jobConf.set("mapreduce.job.output.value.class", classOf[LongWritable].
> getName)
>   jobConf.set("mapreduce.outputformat.class", classOf[TableOutputFormat[
> Text]].getName)
>
>   rdd.saveAsNewAPIHadoopDataset(jobConf)
> })
>
> Regards,
> R Banerjee
>


[ANNOUNCE] Apache HBase 1.1.8 is now available for download

2016-12-19 Thread Nick Dimiduk
The HBase team is happy to announce the immediate availability of HBase
1.1.8! Download it from an Apache mirror near you,
http://www.apache.org/dyn/closer.lua/hbase/, or wire up through the maven
repo.

HBase 1.1.8 is the eighth patch release in the HBase 1.1 line, continuing
on the theme of bringing a stable, reliable database to the Hadoop and
NoSQL communities. This much anticipated release includes over 30 bug fixes
since the 1.1.7 release. Notable correctness fixes include:

HBASE-16886 hbase-client: scanner with reversed=true and small=true gets no
result
HBASE-16931 Setting cell's seqId to zero in compaction flow might cause RS
down
HBASE-16960 RegionServer hang when aborting
HBASE-17023 Region left unassigned due to AM and SSH each thinking others
would do the assignment work
HBASE-17044 Fix merge failed before creating merged region leaves meta
inconsistent
HBASE-17206 FSHLog may roll a new writer successfully with unflushed entries

The full list of fixes included in this release is available at
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753=12338341
and and in the CHANGES.txt file included in the distribution.

Thanks to all the contributors who made this release possible!

Cheers,
The HBase Dev Team


Re: How to set NameSpace while storing from Spark to HBase using saveAsNewAPIHadoopDataSet

2016-12-19 Thread Rabin Banerjee
Thanks , It worked !!

On Mon, Dec 19, 2016 at 5:55 PM, Dhaval Modi  wrote:

>
> Replace  with ":"
>
> Regards,
> Dhaval Modi
>
> On 19 December 2016 at 13:10, Rabin Banerjee  > wrote:
>
>> HI All,
>>
>>   I am trying to save data from Spark into HBase using saveHadoopDataSet
>> API . Please refer the below code . Code is working fine .But the table is
>> getting stored in the default namespace.how to set the NameSpace in the
>> below code?
>>
>>
>>
>>
>> wordCounts.foreachRDD ( rdd = {
>>   val conf = HBaseConfiguration.create()
>>   conf.set(TableOutputFormat.OUTPUT_TABLE, "stream_count")
>>   conf.set("hbase.zookeeper.quorum", "localhost:2181")
>>   conf.set("hbase.master", "localhost:6");
>>   conf.set("hbase.rootdir", "file:///tmp/hbase")
>>
>>   val jobConf = new Configuration(conf)
>>   jobConf.set("mapreduce.job.output.key.class", classOf[Text].getName)
>>   jobConf.set("mapreduce.job.output.value.class", classOf[LongWritable].
>> getName)
>>   jobConf.set("mapreduce.outputformat.class", classOf[TableOutputFormat[
>> Text]].getName)
>>
>>   rdd.saveAsNewAPIHadoopDataset(jobConf)
>> })
>>
>> Regards,
>> R Banerjee
>>
>
>


How to set NameSpace while storing from Spark to HBase using saveAsNewAPIHadoopDataSet

2016-12-19 Thread Rabin Banerjee
HI All,

  I am trying to save data from Spark into HBase using saveHadoopDataSet
API . Please refer the below code . Code is working fine .But the table is
getting stored in the default namespace.how to set the NameSpace in the
below code?




wordCounts.foreachRDD ( rdd = {
  val conf = HBaseConfiguration.create()
  conf.set(TableOutputFormat.OUTPUT_TABLE, "stream_count")
  conf.set("hbase.zookeeper.quorum", "localhost:2181")
  conf.set("hbase.master", "localhost:6");
  conf.set("hbase.rootdir", "file:///tmp/hbase")

  val jobConf = new Configuration(conf)
  jobConf.set("mapreduce.job.output.key.class", classOf[Text].getName)
  jobConf.set("mapreduce.job.output.value.class", classOf[LongWritable].
getName)
  jobConf.set("mapreduce.outputformat.class", classOf[TableOutputFormat[Text
]].getName)

  rdd.saveAsNewAPIHadoopDataset(jobConf)
})

Regards,
R Banerjee


Re: RECEIVED SIGNAL 15: SIGTERM

2016-12-19 Thread Ted Yu
Have you checked region server logs around this time to see if there was some 
clue ?

Which hbase release are you using ?

You may turn on DEBUG log if current log level is INFO. 

Cheers

> On Dec 18, 2016, at 11:37 PM, 郭伟(GUOWEI)  wrote:
> 
> Hi all,
> 
> Spark streaming program will connect Hbase and ES to do some data 
> verification realtime. But my spark application always crash after one or two 
> days.  And I got the following error. Can anybody tell me how to identify the 
> reason ?
> 
> Thanks a lot.
> 
> 16/12/18 19:08:24 ERROR executor.CoarseGrainedExecutorBackend: RECEIVED 
> SIGNAL 15: SIGTERM
> 16/12/18 19:08:24 INFO common.GlobalHConnection: Closing the global HBase 
> connection
> 16/12/18 19:08:24 INFO client.ConnectionManager$HConnectionImplementation: 
> Closing zookeeper sessionid=0x458860dc3ec19c5
> 16/12/18 19:08:24 INFO storage.DiskBlockManager: Shutdown hook called
> 16/12/18 19:08:24 INFO zookeeper.ZooKeeper: Session: 0x458860dc3ec19c5 closed
> 16/12/18 19:08:24 INFO zookeeper.ClientCnxn: EventThread shut down
> 16/12/18 19:08:24 INFO common.GlobalHConnection: The global HBase connection 
> closed
> 
> - 
> Best Regards / 祝商祺
> 
>