Hello everyone, I saw in the past few months quite a few messages about Parquet support on Sqoop, all about importing. Some of them worked well.
But for exporting I'm receiving this error when trying to export from a Hive table stored as Parquet to Postgresql: [cloudera@quickstart ~]$ sqoop export --connect jdbc:postgresql://localhost/postgres --table test1 --export-dir /user/hive/warehouse/teste1 Warning: /usr/lib/sqoop/../accumulo does not exist! Accumulo imports will fail. Please set $ACCUMULO_HOME to the root of your Accumulo installation. 16/10/25 09:19:09 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.8.0 16/10/25 09:19:09 INFO manager.SqlManager: Using default fetchSize of 1000 16/10/25 09:19:09 INFO tool.CodeGenTool: Beginning code generation 16/10/25 09:19:10 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM "test1" AS t LIMIT 1 16/10/25 09:19:10 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/lib/hadoop-mapreduce Note: /tmp/sqoop-cloudera/compile/019c3435216213411e2de14c483af692/test1.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. 16/10/25 09:19:11 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-cloudera/compile/019c3435216213411e2de14c483af692/test1.jar 16/10/25 09:19:11 INFO mapreduce.ExportJobBase: Beginning export of test1 16/10/25 09:19:12 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar 16/10/25 09:19:12 INFO Configuration.deprecation: mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts 16/10/25 09:19:13 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM "test1" AS t LIMIT 1 16/10/25 09:19:13 ERROR sqoop.Sqoop: Got exception running Sqoop: org.kitesdk.data.DatasetNotFoundException: Descriptor location does not exist: hdfs://quickstart.cloudera:8020/user/hive/warehouse/teste1/.metadata org.kitesdk.data.DatasetNotFoundException: Descriptor location does not exist: hdfs://quickstart.cloudera:8020/user/hive/warehouse/teste1/.metadata at org.kitesdk.data.spi.filesystem.FileSystemMetadataProvider.checkExists(FileSystemMetadataProvider.java:562) at org.kitesdk.data.spi.filesystem.FileSystemMetadataProvider.find(FileSystemMetadataProvider.java:605) at org.kitesdk.data.spi.filesystem.FileSystemMetadataProvider.load(FileSystemMetadataProvider.java:114) at org.kitesdk.data.spi.filesystem.FileSystemDatasetRepository.load(FileSystemDatasetRepository.java:197) at org.kitesdk.data.Datasets.load(Datasets.java:108) at org.kitesdk.data.Datasets.load(Datasets.java:140) at org.kitesdk.data.mapreduce.DatasetKeyInputFormat$ConfigBuilder.readFrom(DatasetKeyInputFormat.java:92) at org.kitesdk.data.mapreduce.DatasetKeyInputFormat$ConfigBuilder.readFrom(DatasetKeyInputFormat.java:139) at org.apache.sqoop.mapreduce.JdbcExportJob.configureInputFormat(JdbcExportJob.java:84) at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:432) at org.apache.sqoop.manager.SqlManager.exportTable(SqlManager.java:931) at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:81) at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:100) at org.apache.sqoop.Sqoop.run(Sqoop.java:143) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227) at org.apache.sqoop.Sqoop.main(Sqoop.java:236) I saw a recent JIRA opened about this, https://issues.apache.org/jira/browse/SQOOP-2907, and am wondering if there is any workaround for this? Thanks in advance, Douglas -- Visite: http://canseidesercowboy.wordpress.com/ Siga: @dougspadotto ou @excowboys ----- Frodo: "I wish none of this had happened." Gandalf: "So do all who live to see such times, but that is not for them to decide. All we have to decide is what to do with the time that is given to us." -- Lord of the Rings: The Fellowship of the Ring (2001)
