Re: Two spark applications listen on same port on same machine

[Moein Hosseini]

I'm sure just the first one listen on port, but in master UI, both
application redirects to same machie, same port. Just as I checked url,
they redirects to application ui of first sumbitted one. So I think it
could be only problem in UI.

On Wed, Mar 6, 2019, 10:29 PM Sean Owen  wrote:

> Two drivers can't be listening on port 4040 at the same time -- on the
> same machine. The OS wouldn't allow it. Are they actually on different
> machines or somehow different interfaces? or are you saying the reported
> port is wrong?
>
> On Wed, Mar 6, 2019 at 12:23 PM Moein Hosseini  wrote:
>
>> I've submitted two spark applications in cluster of 3 standalone nodes in
>> near the same time (I have bash script to submit them one after one without
>> delay). But something goes wrong. In the master UI, Running applications
>> section show both of my job with true configuration (cores, memory and
>> different application-id) but both of redirect to port number 4040 which is
>> listen by second submitted job.
>> I think it could be race condition in UI but found nothing in logs. Could
>> you help me to investigate where should I look for reason?
>>
>> Best Regards
>> Moein
>>
>> --
>>
>> Moein Hosseini
>> Data Engineer
>> mobile: +98 912 468 1859 <+98+912+468+1859>
>> site: www.moein.xyz
>> email: moein...@gmail.com
>> [image: linkedin] 
>> [image: twitter] 
>>
>>

Re: Two spark applications listen on same port on same machine

[Sean Owen]

Two drivers can't be listening on port 4040 at the same time -- on the same
machine. The OS wouldn't allow it. Are they actually on different machines
or somehow different interfaces? or are you saying the reported port is
wrong?

On Wed, Mar 6, 2019 at 12:23 PM Moein Hosseini  wrote:

> I've submitted two spark applications in cluster of 3 standalone nodes in
> near the same time (I have bash script to submit them one after one without
> delay). But something goes wrong. In the master UI, Running applications
> section show both of my job with true configuration (cores, memory and
> different application-id) but both of redirect to port number 4040 which is
> listen by second submitted job.
> I think it could be race condition in UI but found nothing in logs. Could
> you help me to investigate where should I look for reason?
>
> Best Regards
> Moein
>
> --
>
> Moein Hosseini
> Data Engineer
> mobile: +98 912 468 1859 <+98+912+468+1859>
> site: www.moein.xyz
> email: moein...@gmail.com
> [image: linkedin] 
> [image: twitter] 
>
>

Two spark applications listen on same port on same machine

[Moein Hosseini]

I've submitted two spark applications in cluster of 3 standalone nodes in
near the same time (I have bash script to submit them one after one without
delay). But something goes wrong. In the master UI, Running applications
section show both of my job with true configuration (cores, memory and
different application-id) but both of redirect to port number 4040 which is
listen by second submitted job.
I think it could be race condition in UI but found nothing in logs. Could
you help me to investigate where should I look for reason?

Best Regards
Moein

-- 

Moein Hosseini
Data Engineer
mobile: +98 912 468 1859 <+98+912+468+1859>
site: www.moein.xyz
email: moein...@gmail.com
[image: linkedin] 
[image: twitter]