[
https://issues.apache.org/jira/browse/HIVE-14972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sergey Shelukhin updated HIVE-14972:
------------------------------------
Description:
It appears that if one specifies "dfs -ls", or the file name VC column, in q
files, the results are removed from the out file via pattern masking (which is
probably correct, given that the base paths for those may be different
depending on the machine).
We should add a helper command (that would be test-specific, like some crypto
commands in use in q files) that would output the file lists in a consistent
manner (e.g. removing the warehouse directory path and only retaining the
tail), or change the dfs command to do so.
was:
It appears that if one specifies "dfs -ls", or the file name VC column, in q
files, the results just get masked by the pattern masking (which is probably
correct, given that the base paths for those may be different depending on the
machine).
We should add a helper command (that would be test-specific, like some crypto
commands in use in q files) that would output the file lists in a consistent
manner (e.g. removing the warehouse directory path and only retaining the
tail), or change the dfs command to do so.
> add a Hive command specific to q files to output HDFS file list without
> masking
> -------------------------------------------------------------------------------
>
> Key: HIVE-14972
> URL: https://issues.apache.org/jira/browse/HIVE-14972
> Project: Hive
> Issue Type: Bug
> Reporter: Sergey Shelukhin
>
> It appears that if one specifies "dfs -ls", or the file name VC column, in q
> files, the results are removed from the out file via pattern masking (which
> is probably correct, given that the base paths for those may be different
> depending on the machine).
> We should add a helper command (that would be test-specific, like some crypto
> commands in use in q files) that would output the file lists in a consistent
> manner (e.g. removing the warehouse directory path and only retaining the
> tail), or change the dfs command to do so.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
