Hi, I'm trying to export from a directory of Parquet files to MySQL and I'm getting an error about a ".metadata" file not existing in HDFS. Reading https://issues.apache.org/jira/browse/SQOOP-1394 I see that KiteSDK requires the ".metadata" file. How do I create this .metadata file?
Alternatively, is it possible for me to export the table from Hive instead of from HDFS? Error message below Thanks, Carlos ./sqoop-export -connect jdbc:mysql://10.228.151.58:3306/pi_viz -table offers --username piuser -P --export-dir /user/hadoopdev/testparquet Warning: /home/hadoopdev/sqoop/bin/../../hbase does not exist! HBase imports will fail. Please set $HBASE_HOME to the root of your HBase installation. Warning: /home/hadoopdev/sqoop/bin/../../hcatalog does not exist! HCatalog jobs will fail. Please set $HCAT_HOME to the root of your HCatalog installation. Warning: /home/hadoopdev/sqoop/bin/../../accumulo does not exist! Accumulo imports will fail. Please set $ACCUMULO_HOME to the root of your Accumulo installation. Warning: /home/hadoopdev/sqoop/bin/../../zookeeper does not exist! Accumulo imports will fail. Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation. 16/03/02 17:04:33 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6 Enter password: 16/03/02 17:04:36 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset. 16/03/02 17:04:36 INFO tool.CodeGenTool: Beginning code generation 16/03/02 17:04:36 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `offers` AS t LIMIT 1 16/03/02 17:04:36 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `offers` AS t LIMIT 1 16/03/02 17:04:36 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce Note: /tmp/sqoop-hadoopdev/compile/edb010c587691e7baa05aab7a5093066/offers.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. 16/03/02 17:04:37 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hadoopdev/compile/edb010c587691e7baa05aab7a5093066/offers.jar 16/03/02 17:04:37 INFO mapreduce.ExportJobBase: Beginning export of offers SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. 16/03/02 17:04:37 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar 16/03/02 17:04:38 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `offers` AS t LIMIT 1 16/03/02 17:04:38 ERROR sqoop.Sqoop: Got exception running Sqoop: org.kitesdk.data.DatasetNotFoundException: Descriptor location does not exist: hdfs://localhost.localdomain:8020/user/hadoopdev/testparquet/.metadata org.kitesdk.data.DatasetNotFoundException: Descriptor location does not exist: hdfs://localhost.localdomain:8020/user/hadoopdev/testparquet/.metadata at org.kitesdk.data.spi.filesystem.FileSystemMetadataProvider.checkExists(FileSystemMetadataProvider.java:562) at org.kitesdk.data.spi.filesystem.FileSystemMetadataProvider.find(FileSystemMetadataProvider.java:605) at org.kitesdk.data.spi.filesystem.FileSystemMetadataProvider.load(FileSystemMetadataProvider.java:114) at org.kitesdk.data.spi.filesystem.FileSystemDatasetRepository.load(FileSystemDatasetRepository.java:192) at org.kitesdk.data.Datasets.load(Datasets.java:108) at org.kitesdk.data.Datasets.load(Datasets.java:140) at org.kitesdk.data.mapreduce.DatasetKeyInputFormat$ConfigBuilder.readFrom(DatasetKeyInputFormat.java:86) at org.kitesdk.data.mapreduce.DatasetKeyInputFormat$ConfigBuilder.readFrom(DatasetKeyInputFormat.java:123) at org.apache.sqoop.mapreduce.JdbcExportJob.configureInputFormat(JdbcExportJob.java:84) at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:424) at org.apache.sqoop.manager.SqlManager.exportTable(SqlManager.java:912) at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:81) at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:100) at org.apache.sqoop.Sqoop.run(Sqoop.java:143) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227) at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
