[ https://issues.apache.org/jira/browse/HIVE-16292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jimmy Xiang reassigned HIVE-16292: ---------------------------------- > SparkUtilities upload to HDFS doesn't work with viewfs > ------------------------------------------------------ > > Key: HIVE-16292 > URL: https://issues.apache.org/jira/browse/HIVE-16292 > Project: Hive > Issue Type: Bug > Reporter: Jimmy Xiang > Assignee: Jimmy Xiang > Priority: Minor > > If scratchdir is set to viewfs, HoS fails with exception like > {noformt} > java.lang.IllegalArgumentException: Wrong FS: > viewfs://ns-default/tmp/hive_scratch/hive/hive/_spark_session_dir/f4031fca-2885-4e7a-9b05-764d25d0e488/hive-exec-1.1.0-cdh5.7.2.jar, > expected: hdfs://nameservice1 > at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:657) > at > org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:194) > at > org.apache.hadoop.hdfs.DistributedFileSystem.access$000(DistributedFileSystem.java:106) > at > org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:1215) > at > org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:1211) > at > org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) > at > org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1211) > at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1412) > at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:499) > at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:351) > at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:341) > at > org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1949) > at > org.apache.hadoop.hive.ql.exec.spark.SparkUtilities.uploadToHDFS(SparkUtilities.java:86) > {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)