Hi Ramakrishna, indeed your investigation is correct, the MySQL direct import/export do not supports file formats other than text. Please do not hesitate and open a feature request for it [1].
All emails sent to apache mailing are publicly archived so that people looking having questions can easily search the list if the question was already answered. As the subject field significantly helps during search, please do fill this field next time. Jarcec Links: 1: https://issues.apache.org/jira/browse/SQOOP On Fri, Jul 19, 2013 at 05:12:34PM +0530, Ramakrishna Nalam wrote: > Update: Did some more digging into the logic of sqoop, realized the avro > check happens only in JDBCExportJob, and DirectMySQLManager uses > MysqlExportJob that does not extend JDBCExportJob. > Guessing avro is supported only for record based inputs and not bulk import > of mysql. > > The mapper itself seems to iterate over the rows, though. Can anyone help > me out with why is the avro format not supported by MysqlExportJob? > > Regards, > Rama. > > > > On Fri, Jul 19, 2013 at 9:27 AM, Ramakrishna Nalam > <[email protected]>wrote: > > > > > (Pls ignore the --direct pasted twice, I'm using it only once, the problem > > still remains) > > > > > > On Fri, Jul 19, 2013 at 9:25 AM, Ramakrishna Nalam <[email protected] > > > wrote: > > > >> Hi, > >> > >> I'm trying to export a set of avro files to mysql using the > >> DirectMysqlManager, using the sqoop export command as follows: > >> > >> sqoop export --verbose --connect jdbc:mysql://<mysqluri>/<dbname> > >> --direct --username <username> --password <password> --direct > >> --export-dir <dir with avro files> --table <tablename> > >> > >> > >> On running this command, I see that the job's *mapred.inputformat.class* as > >> '*org.apache.sqoop.mapreduce.ExportInputFormat'* wheras I was expecting > >> it to set it to '*org.apache.sqoop.mapreduce.AvroInputFormat**'* > >> > >> I have also checked that* > >> org.apache.sqoop.mapreduce.ExportJobBase.getFileType(conf > >> , path ) *on the same path returns *AVRO_DATA_FILE* > >> > >> Please let me know if I'm missing something here? > >> > >> TIA, > >> Rama. > >> > > > >
signature.asc
Description: Digital signature
