Re: Spark job hangs up at Evaluating ParMultiDo(ParseInput)

Hey Aviem, Thank you for noticing. You were right, I was able to run all my jobs in Spark 1.6.3. You are awesome!!! Regards, Sathish. J On 16-Aug-2017, at 3:23 PM, Aviem Zur > wrote: 2.0.0. I really doubt if its Spark setup issue. I wrote a

Re: Spark job hangs up at Evaluating ParMultiDo(ParseInput)

Hi, Thanks for trying it out. I was running the job in local single node setup. I also spawn a HDInsights cluster in Azure platform just to test the WordCount program. Its the same result there too, stuck at the Evaluating ParMultiDo step. It runs fine in mvn compile exec, but when bundled

Re: Spark job hangs up at Evaluating ParMultiDo(ParseInput)

(ExtractWords)’. Regards, Sathish. J On 01-Aug-2017, at 4:16 PM, Sathish Jayaraman <sath...@quartic.ai<mailto:sath...@quartic.ai>> wrote: Hi JB, Not when I submit is using the option —master local. But when I submit with with spark master’s port, The job executes and hangs at step

Spark job hangs up at Evaluating ParMultiDo(ParseInput)

Hi, I am trying to execute Beam example in local spark setup. When I try to submit the sample WordCount jar via spark-submit, the job just hangs at 'INFO SparkRunner$Evaluator: Evaluating ParMultiDo(ExtractWords)’. But it runs fine when executed directly. Below is the command I used to submit