[
https://issues.apache.org/jira/browse/PIG-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rohini Palaniswamy updated PIG-2783:
------------------------------------
Attachment: PIG-2783.patch
Comments from the hadoop team on Hadoop 23 copy command behaviour:
Many commands used to auto-create non-existent paths. This behavior is most
commonly relied upon in the copy commands. The target directory path will no
longer be created. Please use "mkdir" or "mkdir -p" to create the target
directory path prior to the copy. The "-p" flag will avoid an error if the
directory already exists. If other commands are still auto-creating paths, do
not rely upon that behavior.
> Fix Iterator_1 e2e test for Hadoop 23
> -------------------------------------
>
> Key: PIG-2783
> URL: https://issues.apache.org/jira/browse/PIG-2783
> Project: Pig
> Issue Type: Bug
> Components: e2e harness
> Affects Versions: 0.10.0
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Priority: Minor
> Attachments: PIG-2783.patch
>
>
> Iterator_1 e2e test is failing because the script tries to copy output to a
> directory that does not exist. From Hadoop 23, the copy commands do not
> auto-create non-existent paths anymore.
> +Pig.fs("-mkdir :OUTPATH:")
> Pig.fs("-copyFromLocal :TMP:/iterator_output.txt :OUTPATH:/part-m-00000")
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
