Re: [ANNOUNCE] New HBase committer Guanghao Zhang
Congratulations and welcome! 2016-12-20 12:54 GMT+08:00 Nick Dimiduk: > Congratulations Guanghao and thank you for all your contributions! > > On Mon, Dec 19, 2016 at 5:37 PM Duo Zhang wrote: > > > On behalf of the Apache HBase PMC, I am pleased to announce that Guanghao > > > > Zhang has accepted the PMC's invitation to become a committer on the > > > > project. We appreciate all of Guanghao's generous contributions thus far > > > > and look forward to his continued involvement. > > > > > > > > Congratulations and welcome, Guanghao! > > > > > -- *Best Regards,* lijin bin
Re: [ANNOUNCE] New HBase committer Guanghao Zhang
Congratulations Guanghao and thank you for all your contributions! On Mon, Dec 19, 2016 at 5:37 PM Duo Zhangwrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Guanghao > > Zhang has accepted the PMC's invitation to become a committer on the > > project. We appreciate all of Guanghao's generous contributions thus far > > and look forward to his continued involvement. > > > > Congratulations and welcome, Guanghao! > >
Re: [ANNOUNCE] New HBase committer Guanghao Zhang
Congratulations and welcome! On Mon, Dec 19, 2016 at 5:37 PM, Duo Zhangwrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Guanghao > Zhang has accepted the PMC's invitation to become a committer on the > project. We appreciate all of Guanghao's generous contributions thus far > and look forward to his continued involvement. > > Congratulations and welcome, Guanghao! > -- Best regards, - Andy If you are given a choice, you believe you have acted freely. - Raymond Teller (via Peter Watts)
RE: [ANNOUNCE] New HBase committer Guanghao Zhang
Congratulations Guanghao..!! :) -Original Message- From: Duo Zhang [mailto:zhang...@apache.org] Sent: Tuesday, December 20, 2016 9:38 AM To: d...@hbase.apache.org; hbase-user Subject: [ANNOUNCE] New HBase committer Guanghao Zhang On behalf of the Apache HBase PMC, I am pleased to announce that Guanghao Zhang has accepted the PMC's invitation to become a committer on the project. We appreciate all of Guanghao's generous contributions thus far and look forward to his continued involvement. Congratulations and welcome, Guanghao!
RE: [ANNOUNCE] New HBase committer Lijin Bin
Congratulations Lijin..!! :) -Original Message- From: Duo Zhang [mailto:zhang...@apache.org] Sent: Tuesday, November 29, 2016 5:48 PM To: d...@hbase.apache.org; user@hbase.apache.org Subject: [ANNOUNCE] New HBase committer Lijin Bin On behalf of the Apache HBase PMC, I am pleased to announce that Lijin Bin(binlijin) has accepted the PMC's invitation to become a committer on the project. We appreciate all of Lijin's generous contributions thus far and look forward to his continued involvement. Congratulations and welcome, Lijin!
RE: [ANNOUNCE] New HBase Committer Josh Elser
Congratulations Josh..!! :) -Original Message- From: Nick Dimiduk [mailto:ndimi...@apache.org] Sent: Sunday, December 11, 2016 3:48 AM To: hbase-user; hbase-dev Subject: [ANNOUNCE] New HBase Committer Josh Elser On behalf of the Apache HBase PMC, I am pleased to announce that Josh Elser has accepted the PMC's invitation to become a committer on the project. We appreciate all of Josh's generous contributions thus far and look forward to his continued involvement. Allow me to be the first to congratulate and welcome Josh into his new role!
RE: [ANNOUNCE] New HBase committer Phil Yang
Congratulations Phil..!! :) -Original Message- From: Duo Zhang [mailto:zhang...@apache.org] Sent: Tuesday, November 29, 2016 5:49 PM To: d...@hbase.apache.org; user@hbase.apache.org Subject: [ANNOUNCE] New HBase committer Phil Yang On behalf of the Apache HBase PMC, I am pleased to announce that Phil Yang has accepted the PMC's invitation to become a committer on the project. We appreciate all of Phil's generous contributions thus far and look forward to his continued involvement. Congratulations and welcome, Phil!
[ANNOUNCE] New HBase committer Guanghao Zhang
On behalf of the Apache HBase PMC, I am pleased to announce that Guanghao Zhang has accepted the PMC's invitation to become a committer on the project. We appreciate all of Guanghao's generous contributions thus far and look forward to his continued involvement. Congratulations and welcome, Guanghao!
Re: How to set NameSpace while storing from Spark to HBase using saveAsNewAPIHadoopDataSet
Replace with ":" Regards, Dhaval Modi On 19 December 2016 at 13:10, Rabin Banerjeewrote: > HI All, > > I am trying to save data from Spark into HBase using saveHadoopDataSet > API . Please refer the below code . Code is working fine .But the table is > getting stored in the default namespace.how to set the NameSpace in the > below code? > > > > > wordCounts.foreachRDD ( rdd = { > val conf = HBaseConfiguration.create() > conf.set(TableOutputFormat.OUTPUT_TABLE, "stream_count") > conf.set("hbase.zookeeper.quorum", "localhost:2181") > conf.set("hbase.master", "localhost:6"); > conf.set("hbase.rootdir", "file:///tmp/hbase") > > val jobConf = new Configuration(conf) > jobConf.set("mapreduce.job.output.key.class", classOf[Text].getName) > jobConf.set("mapreduce.job.output.value.class", classOf[LongWritable]. > getName) > jobConf.set("mapreduce.outputformat.class", classOf[TableOutputFormat[ > Text]].getName) > > rdd.saveAsNewAPIHadoopDataset(jobConf) > }) > > Regards, > R Banerjee >
[ANNOUNCE] Apache HBase 1.1.8 is now available for download
The HBase team is happy to announce the immediate availability of HBase 1.1.8! Download it from an Apache mirror near you, http://www.apache.org/dyn/closer.lua/hbase/, or wire up through the maven repo. HBase 1.1.8 is the eighth patch release in the HBase 1.1 line, continuing on the theme of bringing a stable, reliable database to the Hadoop and NoSQL communities. This much anticipated release includes over 30 bug fixes since the 1.1.7 release. Notable correctness fixes include: HBASE-16886 hbase-client: scanner with reversed=true and small=true gets no result HBASE-16931 Setting cell's seqId to zero in compaction flow might cause RS down HBASE-16960 RegionServer hang when aborting HBASE-17023 Region left unassigned due to AM and SSH each thinking others would do the assignment work HBASE-17044 Fix merge failed before creating merged region leaves meta inconsistent HBASE-17206 FSHLog may roll a new writer successfully with unflushed entries The full list of fixes included in this release is available at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753=12338341 and and in the CHANGES.txt file included in the distribution. Thanks to all the contributors who made this release possible! Cheers, The HBase Dev Team
Re: How to set NameSpace while storing from Spark to HBase using saveAsNewAPIHadoopDataSet
Thanks , It worked !! On Mon, Dec 19, 2016 at 5:55 PM, Dhaval Modiwrote: > > Replace with ":" > > Regards, > Dhaval Modi > > On 19 December 2016 at 13:10, Rabin Banerjee > wrote: > >> HI All, >> >> I am trying to save data from Spark into HBase using saveHadoopDataSet >> API . Please refer the below code . Code is working fine .But the table is >> getting stored in the default namespace.how to set the NameSpace in the >> below code? >> >> >> >> >> wordCounts.foreachRDD ( rdd = { >> val conf = HBaseConfiguration.create() >> conf.set(TableOutputFormat.OUTPUT_TABLE, "stream_count") >> conf.set("hbase.zookeeper.quorum", "localhost:2181") >> conf.set("hbase.master", "localhost:6"); >> conf.set("hbase.rootdir", "file:///tmp/hbase") >> >> val jobConf = new Configuration(conf) >> jobConf.set("mapreduce.job.output.key.class", classOf[Text].getName) >> jobConf.set("mapreduce.job.output.value.class", classOf[LongWritable]. >> getName) >> jobConf.set("mapreduce.outputformat.class", classOf[TableOutputFormat[ >> Text]].getName) >> >> rdd.saveAsNewAPIHadoopDataset(jobConf) >> }) >> >> Regards, >> R Banerjee >> > >
How to set NameSpace while storing from Spark to HBase using saveAsNewAPIHadoopDataSet
HI All, I am trying to save data from Spark into HBase using saveHadoopDataSet API . Please refer the below code . Code is working fine .But the table is getting stored in the default namespace.how to set the NameSpace in the below code? wordCounts.foreachRDD ( rdd = { val conf = HBaseConfiguration.create() conf.set(TableOutputFormat.OUTPUT_TABLE, "stream_count") conf.set("hbase.zookeeper.quorum", "localhost:2181") conf.set("hbase.master", "localhost:6"); conf.set("hbase.rootdir", "file:///tmp/hbase") val jobConf = new Configuration(conf) jobConf.set("mapreduce.job.output.key.class", classOf[Text].getName) jobConf.set("mapreduce.job.output.value.class", classOf[LongWritable]. getName) jobConf.set("mapreduce.outputformat.class", classOf[TableOutputFormat[Text ]].getName) rdd.saveAsNewAPIHadoopDataset(jobConf) }) Regards, R Banerjee
Re: RECEIVED SIGNAL 15: SIGTERM
Have you checked region server logs around this time to see if there was some clue ? Which hbase release are you using ? You may turn on DEBUG log if current log level is INFO. Cheers > On Dec 18, 2016, at 11:37 PM, 郭伟(GUOWEI)wrote: > > Hi all, > > Spark streaming program will connect Hbase and ES to do some data > verification realtime. But my spark application always crash after one or two > days. And I got the following error. Can anybody tell me how to identify the > reason ? > > Thanks a lot. > > 16/12/18 19:08:24 ERROR executor.CoarseGrainedExecutorBackend: RECEIVED > SIGNAL 15: SIGTERM > 16/12/18 19:08:24 INFO common.GlobalHConnection: Closing the global HBase > connection > 16/12/18 19:08:24 INFO client.ConnectionManager$HConnectionImplementation: > Closing zookeeper sessionid=0x458860dc3ec19c5 > 16/12/18 19:08:24 INFO storage.DiskBlockManager: Shutdown hook called > 16/12/18 19:08:24 INFO zookeeper.ZooKeeper: Session: 0x458860dc3ec19c5 closed > 16/12/18 19:08:24 INFO zookeeper.ClientCnxn: EventThread shut down > 16/12/18 19:08:24 INFO common.GlobalHConnection: The global HBase connection > closed > > - > Best Regards / 祝商祺 > >