Hi Dawid, I am trying to do the same thing but I hit a wall while writing the Hfiles getting the following error:
java.io.IOException: Added a key not lexically larger than previous key=\x00\x168675230967GMP\x00\x00\x00\x01=\xF4h)\xE0\x010GEN\x00\x00\x01M\xDE.\xB4T\x04, lastkey=\x00\x168675230967GMP\x00\x00\x00\x01=\xF5\x0C\xF5`\x010_0\x00\x00\x01M\xDE.\xB4T\x04 You have reached the point where you are generating the HFiles, loading them but you dont see any rows in the table? Is that correct? Thanks On 8 June 2015 at 18:09, Dawid <[email protected]> wrote: > > Yes, I did. I also tried to execute some upserts using sqlline after > importing HFiles, and rows from upserts are visible both in sqlline and > hbase shell, but > the rows imported from HFile are only in hbase shell. > > > On 08.06.2015 19:06, James Taylor wrote: > >> Dawid, >> Perhaps a dumb question, but did you execute a CREATE TABLE statement >> in sqlline for the tables you're importing into? Phoenix needs to be >> told the schema of the table (i.e. it's not enough to just create the >> table in HBase). >> Thanks, >> James >> >> On Mon, Jun 8, 2015 at 10:02 AM, Dawid <[email protected]> >> wrote: >> >>> Any suggestions? Some clues what to check? >>> >>> >>> On 05.06.2015 23:21, Dawid wrote: >>> >>> Yes I can see it in hbase-shell. >>> >>> Sorry for the bad links, i haven't used private repositories on github. >>> So I >>> moved the files to a gist: >>> https://gist.github.com/dawidwys/3aba8ba618140756da7c >>> Hope this times it will work. >>> >>> On 05.06.2015 23:09, Ravi Kiran wrote: >>> >>> Hi Dawid, >>> Do you see the data when you run a simple scan or count of the table >>> in >>> Hbase shell ? >>> >>> FYI. The links lead me to a 404 : File not found. >>> >>> Regards >>> Ravi >>> >>> On Fri, Jun 5, 2015 at 1:17 PM, Dawid <[email protected]> >>> wrote: >>> >>>> Hi, >>>> I was trying to code some utilities to bulk load data through HFiles >>>> from >>>> Spark RDDs. >>>> I was trying to took the pattern of CSVBulkLoadTool. I managed to >>>> generate >>>> some HFiles and load them into HBase, but i can't see the rows using >>>> sqlline. I would be more than grateful for any suggestions. >>>> >>>> The classes can be accessed at: >>>> >>>> >>>> https://github.com/dawidwys/gate/blob/master/src/main/scala/pl/edu/pw/elka/phoenix/BulkPhoenixLoader.scala >>>> >>>> >>>> https://github.com/dawidwys/gate/blob/master/src/main/scala/pl/edu/pw/elka/phoenix/ExtendedProductRDDFunctions.scala >>>> >>>> Thanks in advance >>>> >>>> Dawid Wysakowicz >>>> >>>> >>>> >>> -- >>> Pozdrawiam >>> Dawid >>> >>> >>> -- >>> Pozdrawiam >>> Dawid >>> >> > -- > Pozdrawiam > Dawid > >
