The pig script stored in the Hadoop History logs is stored as a concatenated
string without whitespace this causes problems when attempting to extract and
execute the script
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Key: PIG-1861
URL: https://issues.apache.org/jira/browse/PIG-1861
Project: Pig
Issue Type: Bug
Components: build
Affects Versions: 0.8.0, 0.9.0
Reporter: Araceli Henley
Fix For: 0.9.0, 0.8.0
a = load '$in' using com.yahoo.grid.sath.JobHistoryLoader() as
(job:map[],maps:bag{},reducers:bag{},other:bag{},conf:map[]);
The pig script stored in: conf#'pig.script' has the whitespace removed, this
makes it difficult to extract and run the
script. In particular, statements that terminate in ";" work correctly as
"statement1;statement2;statement99" but statements that do not end in ";"
result in
"statement1statement2statement3" and it's difficult to parse the pig script and
fix the concatenated string.
On a side note, I also noticed that in many of the scripts the last statement
is missing ";"
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
