[jira] [Created] (BEAM-2368) one throw "Unable to find registrar for hdfs" with same code

2017-05-25 Thread liyuntian (JIRA)
liyuntian created BEAM-2368: --- Summary: one throw "Unable to find registrar for hdfs" with same code Key: BEAM-2368 URL: https://issues.apache.org/jira/browse/BEAM-2368 Project: Beam Issue Type: Te

[jira] [Closed] (BEAM-2368) one throw "Unable to find registrar for hdfs" with same code

2017-06-19 Thread liyuntian (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyuntian closed BEAM-2368. --- Resolution: Won't Fix Fix Version/s: 2.0.0 > one throw "Unable to find registrar for hdfs" with same cod

[jira] [Created] (BEAM-2479) get MAX value from PCollection .apply(Combine.globally(Max.ofDoubles()))

2017-06-19 Thread liyuntian (JIRA)
liyuntian created BEAM-2479: --- Summary: get MAX value from PCollection .apply(Combine.globally(Max.ofDoubles())) Key: BEAM-2479 URL: https://issues.apache.org/jira/browse/BEAM-2479 Project: Beam Is

[jira] [Commented] (BEAM-375) HadoopIO and runners-spark conflict with hadoop.version

2017-04-13 Thread liyuntian (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967528#comment-15967528 ] liyuntian commented on BEAM-375: Does HdfsIO must use hadoop2.7.0 or above? I use Hadoop2.6.

[jira] [Comment Edited] (BEAM-375) HadoopIO and runners-spark conflict with hadoop.version

2017-04-13 Thread liyuntian (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967528#comment-15967528 ] liyuntian edited comment on BEAM-375 at 4/13/17 12:45 PM: -- Does Hdf

[jira] [Commented] (BEAM-375) HadoopIO and runners-spark conflict with hadoop.version

2017-04-13 Thread liyuntian (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15968410#comment-15968410 ] liyuntian commented on BEAM-375: yes,I get state by "pipelineResult.getState().isTerminal()"

[jira] [Comment Edited] (BEAM-375) HadoopIO and runners-spark conflict with hadoop.version

2017-04-13 Thread liyuntian (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15968410#comment-15968410 ] liyuntian edited comment on BEAM-375 at 4/14/17 1:15 AM: - yes,I get

[jira] [Created] (BEAM-2027) get error sometimes while running the same code using beam0.6

2017-04-20 Thread liyuntian (JIRA)
liyuntian created BEAM-2027: --- Summary: get error sometimes while running the same code using beam0.6 Key: BEAM-2027 URL: https://issues.apache.org/jira/browse/BEAM-2027 Project: Beam Issue Type: B

[jira] [Commented] (BEAM-2027) get error sometimes while running the same code using beam0.6

2017-04-22 Thread liyuntian (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980245#comment-15980245 ] liyuntian commented on BEAM-2027: - my application's jar is a fat jar, I submit spark job on

[jira] [Created] (BEAM-2109) No Route to Host from etl-dev-05/xx.xx.xx.xx to bchcluster:8020

2017-04-27 Thread liyuntian (JIRA)
liyuntian created BEAM-2109: --- Summary: No Route to Host from etl-dev-05/xx.xx.xx.xx to bchcluster:8020 Key: BEAM-2109 URL: https://issues.apache.org/jira/browse/BEAM-2109 Project: Beam Issue Type

[jira] [Commented] (BEAM-2109) No Route to Host from etl-dev-05/xx.xx.xx.xx to bchcluster:8020

2017-04-27 Thread liyuntian (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15988128#comment-15988128 ] liyuntian commented on BEAM-2109: - I am sure that My hosts is right,the the firewall is clo

[jira] [Closed] (BEAM-2109) No Route to Host from etl-dev-05/xx.xx.xx.xx to bchcluster:8020

2017-04-28 Thread liyuntian (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyuntian closed BEAM-2109. --- Resolution: Not A Problem Fix Version/s: 0.6.0 > No Route to Host from etl-dev-05/xx.xx.xx.xx to bchclu

[jira] [Created] (BEAM-2274) beam on spark runner run much slower than using spark

2017-05-11 Thread liyuntian (JIRA)
liyuntian created BEAM-2274: --- Summary: beam on spark runner run much slower than using spark Key: BEAM-2274 URL: https://issues.apache.org/jira/browse/BEAM-2274 Project: Beam Issue Type: Test

[jira] [Commented] (BEAM-2274) beam on spark runner run much slower than using spark

2017-05-15 Thread liyuntian (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010175#comment-16010175 ] liyuntian commented on BEAM-2274: - this is my spark code: JavaRDD input = sc.textFile(hdfsI

[jira] [Comment Edited] (BEAM-2274) beam on spark runner run much slower than using spark

2017-05-15 Thread liyuntian (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010175#comment-16010175 ] liyuntian edited comment on BEAM-2274 at 5/15/17 8:45 AM: -- this is

[jira] [Created] (BEAM-2308) run beam on spark runner successfully with small data,but fail with a big data

2017-05-16 Thread liyuntian (JIRA)
liyuntian created BEAM-2308: --- Summary: run beam on spark runner successfully with small data,but fail with a big data Key: BEAM-2308 URL: https://issues.apache.org/jira/browse/BEAM-2308 Project: Beam