Looks good. Thank you very much sir! Jarcec
On Fri, Jan 06, 2012 at 09:34:02AM +0100, Oliver Meyn wrote: > Hi Jarcec, > > doc jira: https://issues.apache.org/jira/browse/SQOOP-421 > > code jira: https://issues.apache.org/jira/browse/SQOOP-422 > > Please check that I got the components and versions right. > > Thanks, > Oliver > > On 2012-01-06, at 9:17 AM, Jarek Jarcec Cecho wrote: > > > Hi Oliver, > > I definitely agree that this should be mentioned in the docs. Can you > > please create JIRA for that? > > > > Could you also create second JIRA that will cover changes on sqoop source > > code side so that we stop silently ignoring --hbase* parameters and rise an > > exception in case that user will supply incompatible arguments? > > > > Thank, > > Jarcec > > > > On Fri, Jan 06, 2012 at 08:57:17AM +0100, Oliver Meyn wrote: > >> Thanks Arvind - though I guess you mean "transferred data into HBase" > >> below. In any case this should be in the docs, since it cost me half a > >> day and shouldn't cost anyone else that. I'm not sure how that might get > >> updated since the user guide looks to be part of the source, so should I > >> make a Jira issue? > >> > >> Thanks, > >> Oliver > >> > >> On 2012-01-05, at 7:18 PM, Arvind Prabhakar wrote: > >> > >>> Hi Oliver, > >>> > >>> This is a limitation of the direct MySQL connector. This connector > >>> uses the MySQL batch utilities (mysqldump/mysqlimport) to do the data > >>> transfer directly over to HDFS. It does not support populating the > >>> transferred data into HDFS. > >>> > >>> This is one of the areas of improvement in Sqoop 2. See [1] for more > >>> details. > >>> > >>> [1] > >>> https://cwiki.apache.org/confluence/display/SQOOP/Sqoop+2#Sqoop2-IntroducingaReducePhase > >>> > >>> Thanks, > >>> Arvind > >>> > >>> On Thu, Jan 5, 2012 at 7:22 AM, Oliver Meyn <oli...@mineallmeyn.com> > >>> wrote: > >>>> Hi all, > >>>> > >>>> I'm trying to sqoop from mysql into HBase. Everything works fine if I > >>>> don't use --direct. When I add --direct however the results get written > >>>> into hdfs, and no error messages are generated. It's as if the --hbase* > >>>> params are all being ignored. Is this by design? Or a bug? > >>>> > >>>> I'm using sqoop-1.3.0-cdh3u2, and all other hadoop-y pieces are cdh3u2. > >>>> Here's my options file (I've tried on the command line, and I've tried > >>>> moving the --direct option to the start, end, and middle of the options > >>>> list - all to no avail). > >>>> > >>>> import > >>>> # use mysqldump > >>>> --direct > >>>> --mysql-delimiters > >>>> > >>>> #connect to db > >>>> --connect > >>>> jdbc:mysql://xxx/portal > >>>> --username > >>>> xxx > >>>> --password > >>>> xxx > >>>> > >>>> # from table raw_occurrence_record > >>>> --table > >>>> raw_occurrence_record > >>>> --split-by > >>>> id > >>>> --where > >>>> 'id < 100000' > >>>> > >>>> # to hbase > >>>> --hbase-table > >>>> sqoop_ror_mini > >>>> --column-family > >>>> v > >>>> --hbase-create-table > >>>> > >>>> # code generation reuse > >>>> --jar-file > >>>> raw_occurrence_record.jar > >>>> --class-name > >>>> raw_occurrence_record > >>>> > >>>> Thanks, > >>>> Oliver > >>>> > >>>> > >>>> > >> > >> > >> -- > >> Oliver Meyn > >> Mine All Meyn, Inc. > >> Toronto: (416) 524-2240 > >> Copenhagen: +45 51 50 38 90 > >> "Things should be made as simple as possible, but no simpler." - Albert > >> Einstein > >> > >> > >> > >> > > > -- > Oliver Meyn > Mine All Meyn, Inc. > Toronto: (416) 524-2240 > Copenhagen: +45 51 50 38 90 > "Things should be made as simple as possible, but no simpler." - Albert > Einstein > > > >
signature.asc
Description: Digital signature
