Re: Writing visibility labels with HFileOutputFormat2

2016-06-29 Thread Huaxiang Sun
Hi Tom, Not sure if the following question has been answered. If not, you can use hfile tool to dump the hfile content. "HBASE-15707 - am I able to read the HFile manually to determine if Tags have been written properly?” ${HBASE_HOME}/bin/hbase org.apache.hadoop.hbase.io.hfile.HFile -f

Re: Writing visibility labels with HFileOutputFormat2

2016-06-22 Thread Anoop John
adIncrementalHFiles.doBulkLoad - so long as only the HBase user and the >> spark user can read/write to the file, I'm not sure what the risk is? >> >> HBASE-15707 - am I able to read the HFile manually to determine if Tags >> have been written properly? >> >> Cheer

RE: Writing visibility labels with HFileOutputFormat2

2016-06-16 Thread Ellis, Tom (Financial Markets IT)
anually to determine if Tags have been written properly? Cheers, Tom -Original Message- From: ramkrishna vasudevan [mailto:ramkrishna.s.vasude...@gmail.com] Sent: 16 June 2016 06:01 To: user@hbase.apache.org Subject: Re: Writing visibility labels with HFileOutputFormat2 -- This email

Re: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread ramkrishna vasudevan
t: www.lloydsbankinggroup-cr.com/downloads > > > -Original Message- > From: Ellis, Tom (Financial Markets IT) [mailto: > tom.el...@lloydsbanking.com.INVALID] > Sent: 15 June 2016 17:42 > To: user@hbase.apache.org > Subject: RE: Writing visibility labels with H

RE: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread Ellis, Tom (Financial Markets IT)
IT) [mailto:tom.el...@lloydsbanking.com.INVALID] Sent: 15 June 2016 17:42 To: user@hbase.apache.org Subject: RE: Writing visibility labels with HFileOutputFormat2 -- This email has reached the Bank via an external source -- Looking at the source for how DefaultCellLabelServiceImpl checks authorisation I noted

RE: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread Ellis, Tom (Financial Markets IT)
IT) [mailto:tom.el...@lloydsbanking.com.INVALID] Sent: 15 June 2016 16:56 To: user@hbase.apache.org Subject: RE: Writing visibility labels with HFileOutputFormat2 -- This email has reached the Bank via an external source -- I see now from some other examples I've found that actually this form

RE: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread Ellis, Tom (Financial Markets IT)
Responsibility Report: www.lloydsbankinggroup-cr.com/downloads -Original Message- From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: 15 June 2016 17:01 To: user@hbase.apache.org Subject: Re: Writing visibility labels with HFileOutputFormat2 -- This email has reached the Bank via an external source

RE: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread Ellis, Tom (Financial Markets IT)
...@lloydsbanking.com.INVALID] Sent: 15 June 2016 16:25 To: user@hbase.apache.org Subject: RE: Writing visibility labels with HFileOutputFormat2 -- This email has reached the Bank via an external source -- So I have a working prototype using just bulk puts on a table and using setCellVisibility as necessary

Re: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread Ted Yu
d the low carbon > economy. > Corporate Responsibility Report: www.lloydsbankinggroup-cr.com/downloads > > > -Original Message- > From: ramkrishna vasudevan [mailto:ramkrishna.s.vasude...@gmail.com] > Sent: 15 June 2016 12:31 > To: user@hbase.apache.org

RE: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread Ellis, Tom (Financial Markets IT)
oads -Original Message- From: ramkrishna vasudevan [mailto:ramkrishna.s.vasude...@gmail.com] Sent: 15 June 2016 12:31 To: user@hbase.apache.org Subject: Re: Writing visibility labels with HFileOutputFormat2 -- This email has reached the Bank via an external source -- >>We could I gu

Re: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread ramkrishna vasudevan
From: ramkrishna vasudevan [mailto:ramkrishna.s.vasude...@gmail.com] > Sent: 15 June 2016 11:24 > To: user@hbase.apache.org > Subject: Re: Writing visibility labels with HFileOutputFormat2 > > -- This email has reached the Bank via an external source -- > > > The visibi

RE: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread Ellis, Tom (Financial Markets IT)
vasudevan [mailto:ramkrishna.s.vasude...@gmail.com] Sent: 15 June 2016 11:24 To: user@hbase.apache.org Subject: Re: Writing visibility labels with HFileOutputFormat2 -- This email has reached the Bank via an external source -- The visibility expression resolver tries to scan the labels table an

Re: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread ramkrishna vasudevan
commercial.com > , , , > Reduce printing. Lloyds Banking Group is helping to build the low carbon > economy. > Corporate Responsibility Report: www.lloydsbankinggroup-cr.com/downloads > > -Original Message- > From: Anoop John [mailto:anoop.hb...@gmail.com] > Sent: 08 June 2016 11

RE: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread Ellis, Tom (Financial Markets IT)
Report: www.lloydsbankinggroup-cr.com/downloads -Original Message- From: Anoop John [mailto:anoop.hb...@gmail.com] Sent: 08 June 2016 11:58 To: user@hbase.apache.org Subject: Re: Writing visibility labels with HFileOutputFormat2 -- This email has reached the Bank via an external source -- Thanks Ra

Re: Writing visibility labels with HFileOutputFormat2

2016-06-08 Thread Anoop John
bviously @InterfaceAudience.Private) but it seems to be able to use that >> I'd need to know Label ordinality client side.. >> >> Thanks for your help, >> >> Tom >> >> -Original Message- >> From: ramkrishna vasudevan [mailto:ramkrishna.s.vasude...

Re: Writing visibility labels with HFileOutputFormat2

2016-06-08 Thread ramkrishna vasudevan
amkrishna vasudevan [mailto:ramkrishna.s.vasude...@gmail.com] > Sent: 07 June 2016 11:19 > To: user@hbase.apache.org > Subject: Re: Writing visibility labels with HFileOutputFormat2 > > -- This email has reached the Bank via an external source -- > > > Hi Ellis > &g

RE: Writing visibility labels with HFileOutputFormat2

2016-06-07 Thread Ellis, Tom (Financial Markets IT)
to be able to use that I'd need to know Label ordinality client side.. Thanks for your help, Tom -Original Message- From: ramkrishna vasudevan [mailto:ramkrishna.s.vasude...@gmail.com] Sent: 07 June 2016 11:19 To: user@hbase.apache.org Subject: Re: Writing visibility labels

Re: Writing visibility labels with HFileOutputFormat2

2016-06-07 Thread ramkrishna vasudevan
Hi Ellis How is the HFileOutputFormat2 files created? Are you using the ImportTsv tool? If you are using the ImportTsv tool then yes there is a way to specify visibility tags while loading from the ImportTsv tool and those visibility tags are also bulk loaded as HFile. There is an attribute