[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-5210: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) +1. Patch looks good. Committed to trunk. Thans Lili! > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PIG-5210-new.patch, screenshot MR plan.png, screenshot > Tez Plan.png > > > For pig script, users need to use {{pig -e "explain -script test.pig"}} to > print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to > explain the plan automatically. This option can help to print out MR/Tez > plan automatically before implementing MapReduce. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Description: For pig script, users need to use {{pig -e "explain -script test.pig"}} to print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to explain the plan automatically. This option can help to print out MR/Tez plan automatically before implementing MapReduce. was: For pig script, users need to use {{pig -e "explain -script test.pig"}} to print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to explain the plan automatically. This option can help to print out MR/Tez plan automatically before implement of MapReduce. > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PIG-5210-new.patch, screenshot MR plan.png, screenshot > Tez Plan.png > > > For pig script, users need to use {{pig -e "explain -script test.pig"}} to > print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to > explain the plan automatically. This option can help to print out MR/Tez > plan automatically before implementing MapReduce. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Attachment: (was: test.pig) > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PIG-5210-new.patch, screenshot MR plan.png, screenshot > Tez Plan.png > > > For pig script, users need to use {{pig -e "explain -script test.pig"}} to > print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to > explain the plan automatically. This option can help to print out MR/Tez > plan automatically before implementing MapReduce. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Attachment: (was: screenshot-change.png) > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PIG-5210-new.patch, screenshot MR plan.png, screenshot > Tez Plan.png, test.pig > > > For pig script, users need to use {{pig -e "explain -script test.pig"}} to > print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to > explain the plan automatically. This option can help to print out MR/Tez > plan automatically before implement of MapReduce. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Attachment: (was: PrintPlan.patch) > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PIG-5210-new.patch, screenshot-change.png, screenshot MR > plan.png, screenshot Tez Plan.png, test.pig > > > For pig script, users need to use {{pig -e "explain -script test.pig"}} to > print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to > explain the plan automatically. This option can help to print out MR/Tez > plan automatically before implement of MapReduce. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Attachment: PIG-5210-new.patch > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PIG-5210-new.patch, screenshot-change.png, screenshot MR > plan.png, screenshot Tez Plan.png, test.pig > > > For pig script, users need to use {{pig -e "explain -script test.pig"}} to > print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to > explain the plan automatically. This option can help to print out MR/Tez > plan automatically before implement of MapReduce. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-5210: Description: For pig script, users need to use {{pig -e "explain -script test.pig"}} to print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to explain the plan automatically. This option can help to print out MR/Tez plan automatically before implement of MapReduce. was: h5. Adding an option to print out MR/Tez plan before launching For pig script, users need to use {{pig -e "explain -script test.pig"}} to print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to explain the plan automatically. This option can help to print out MR/Tez plan automatically before implement of MapReduce. Steps: - Get clone of 0.17.0 version PIG by git pull - Set up Eclipse - Import Pig src to Eclipse, and set pig.print.exec.plan "true" in file _JobControlCompiler.java_,_TezJobCompiler.java_ before Mapreduce starts - Check for compiling {{ant}} - After building successful, Start remote debugger in Eclipse {{export PIG_OPTS="- agentlib:jdwp=transport=dt_socket,server=y,suspend=y,address=8000"}} Or start to run pig only in terminal {{unset PIG_OPTS}} - Test cases: For MR engine {{-x local test.pig}}; For Tez engine {{-x tez_local test.pig}} - Get the plan and test results as expected > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PrintPlan.patch, screenshot-change.png, screenshot MR > plan.png, screenshot Tez Plan.png, test.pig > > > For pig script, users need to use {{pig -e "explain -script test.pig"}} to > print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to > explain the plan automatically. This option can help to print out MR/Tez > plan automatically before implement of MapReduce. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Description: h5. Adding an option to print out MR/Tez plan before launching For pig script, users need to use {{pig -e "explain -script test.pig"}} to print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to explain the plan automatically. This option can help to print out MR/Tez plan automatically before implement of MapReduce. Steps: - Get clone of 0.17.0 version PIG by git pull - Set up Eclipse - Import Pig src to Eclipse, and set pig.print.exec.plan "true" in file _JobControlCompiler.java_,_TezJobCompiler.java_ before Mapreduce starts - Check for compiling {{ant}} - After building successful, Start remote debugger in Eclipse {{export PIG_OPTS="- agentlib:jdwp=transport=dt_socket,server=y,suspend=y,address=8000"}} Or start to run pig only in terminal {{unset PIG_OPTS}} - Test cases: For MR engine {{-x local test.pig}}; For Tez engine {{-x tez_local test.pig}} - Get the plan and test results as expected was: Adding an option to print out MR/Tez plan before launching. - Without this option, users can use `pig -e "explain -script 1.pig"` > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PrintPlan.patch, screenshot-change.png, screenshot MR > plan.png, screenshot Tez Plan.png, test.pig > > > h5. Adding an option to print out MR/Tez plan before launching > For pig script, users need to use {{pig -e "explain -script test.pig"}} to > print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to > explain the plan automatically. This option can help to print out MR/Tez > plan automatically before implement of MapReduce. > Steps: > - Get clone of 0.17.0 version PIG by git pull > - Set up Eclipse > - Import Pig src to Eclipse, and set pig.print.exec.plan "true" in file > _JobControlCompiler.java_,_TezJobCompiler.java_ before Mapreduce starts > - Check for compiling {{ant}} > - After building successful, Start remote debugger in Eclipse {{export > PIG_OPTS="- > agentlib:jdwp=transport=dt_socket,server=y,suspend=y,address=8000"}} Or start > to run pig only in terminal {{unset PIG_OPTS}} > - Test cases: For MR engine {{-x local test.pig}}; For Tez engine {{-x > tez_local test.pig}} > - Get the plan and test results as expected -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Description: Adding an option to print out MR/Tez plan before launching. - Without this option, users can use ``` pig -e "explain -script 1.pig" ``` was:Adding an option to print out MR/Tez plan before launching. > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PrintPlan.patch, screenshot-change.png, screenshot MR > plan.png, screenshot Tez Plan.png, test.pig > > > Adding an option to print out MR/Tez plan before launching. > - Without this option, users can use > ``` > pig -e "explain -script 1.pig" > ``` -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Description: Adding an option to print out MR/Tez plan before launching. - Without this option, users can use `pig -e "explain -script 1.pig"` was: Adding an option to print out MR/Tez plan before launching. - Without this option, users can use ``` pig -e "explain -script 1.pig" ``` > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PrintPlan.patch, screenshot-change.png, screenshot MR > plan.png, screenshot Tez Plan.png, test.pig > > > Adding an option to print out MR/Tez plan before launching. > - Without this option, users can use `pig -e "explain -script 1.pig"` -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Attachment: screenshot-change.png > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PrintPlan.patch, screenshot-change.png, screenshot MR > plan.png, screenshot Tez Plan.png, test.pig > > > Adding an option to print out MR/Tez plan before launching. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Attachment: screenshot Tez Plan.png > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PrintPlan.patch, screenshot MR plan.png, screenshot Tez > Plan.png, test.pig > > > Adding an option to print out MR/Tez plan before launching. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Attachment: (was: screenshot-3.png) > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PrintPlan.patch, screenshot MR plan.png, test.pig > > > Adding an option to print out MR/Tez plan before launching. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Attachment: screenshot MR plan.png > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PrintPlan.patch, screenshot MR plan.png, test.pig > > > Adding an option to print out MR/Tez plan before launching. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Attachment: (was: screenshot-2.png) > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PrintPlan.patch, screenshot-3.png, test.pig > > > Adding an option to print out MR/Tez plan before launching. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Attachment: (was: screenshot-1.png) > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PrintPlan.patch, screenshot-3.png, test.pig > > > Adding an option to print out MR/Tez plan before launching. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Attachment: test.pig This is a test case for MR/Tez. For MR: bin/pig -x local test.pig For Tez: bin/pig -x tez_local test.pig > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PrintPlan.patch, screenshot-1.png, screenshot-2.png, > screenshot-3.png, test.pig > > > Adding an option to print out MR/Tez plan before launching. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Attachment: screenshot-3.png > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PrintPlan.patch, screenshot-1.png, screenshot-2.png, > screenshot-3.png > > > Adding an option to print out MR/Tez plan before launching. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Attachment: screenshot-2.png > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PrintPlan.patch, screenshot-1.png, screenshot-2.png > > > Adding an option to print out MR/Tez plan before launching. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Attachment: screenshot-1.png > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PrintPlan.patch, screenshot-1.png > > > Adding an option to print out MR/Tez plan before launching. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-5210: Summary: Option to print MR/Tez plan before launching (was: Print MR/Tez plan before launching) > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PrintPlan.patch > > > Set pig.print.exec.plan "true" in > src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java > > and > src/org/apache/pig/backend/hadoop/executionengine/tez/TezJobCompiler.java > Print out MR/Tez plan -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-5210: Description: Adding an option to print out MR/Tez plan before launching. (was: Set pig.print.exec.plan "true" in src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java and src/org/apache/pig/backend/hadoop/executionengine/tez/TezJobCompiler.java Print out MR/Tez plan) > Option to print MR/Tez plan before launching > > > Key: PIG-5210 > URL: https://issues.apache.org/jira/browse/PIG-5210 > Project: Pig > Issue Type: Improvement >Affects Versions: 0.17.0 >Reporter: Lili Yu >Assignee: Lili Yu > Fix For: 0.17.0 > > Attachments: PrintPlan.patch > > > Adding an option to print out MR/Tez plan before launching. -- This message was sent by Atlassian JIRA (v6.3.15#6346)