Re: The ports needed for ambari and hadoop installation

[Lian Jiang]

Thanks Aaron. This helps. But are the port list complete? I saw they do not
cover ambari blueprint components like LOGSEARCH_SERVER, INFRA_SOLR,
METRICS_COLLECTOR, SPARK2_JOBHISTORYSERVER. Is there another pointer for
the missing components? Without a complete list, it will be hard to
precisely configure the ports so that ambari can install hadoop and hadoop
can work correctly. Thanks very much!

On Mon, Mar 19, 2018 at 10:14 PM, Aaron Bossert 
wrote:

> Lian,
>
> Technically, you don’t need any internet access to run an HDP cluster.
> You will, however need to have the appropriate repos hosted on your
> internal network in order to get set up and do periodic updates.
>
> The ports required for every HDP component are in the Hortonworks
> documentation: https://docs.hortonworks.com/HDPDocuments/
> HDP2/HDP-2.6.4/bk_reference/content/reference_chap2.html
>
> Sent from my iPhone
>
> On Mar 20, 2018, at 00:52, Lian Jiang  wrote:
>
> I want to re-raise this question since I have not got satisfying answers.
> Is there any document for the required ports and internet access? Thanks a
> lot.
>
> On Mon, Mar 5, 2018 at 1:34 PM, Lian Jiang  wrote:
>
>> I need to setup a hadoop cluster (using HDP 2.6, ambari and blueprint) in
>> a secure environment which limits the ingress/egress ports and the
>> destinations/sources of internet traffic. For example, the hosts in this
>> environment only open 22, 443 ports and they can only access website A, B.
>>
>> To setup a hadoop cluster in such an environment, I need to know below so
>> that ambari can work:
>>
>> 1. which ports need to be open.
>> 2. which destinations/sources of internet traffic need to be permitted.
>>
>> Other than searching document online and try-fail-try, is there a way to
>> get such information reliably so that I can more confidently ask people to
>> relax the environment? Appreciate any clue.
>>
>
>

Re: The ports needed for ambari and hadoop installation

[Aaron Bossert]

Lian,

Technically, you don’t need any internet access to run an HDP cluster.  You 
will, however need to have the appropriate repos hosted on your internal 
network in order to get set up and do periodic updates.

The ports required for every HDP component are in the Hortonworks 
documentation: 
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_reference/content/reference_chap2.html

Sent from my iPhone

> On Mar 20, 2018, at 00:52, Lian Jiang  wrote:
> 
> I want to re-raise this question since I have not got satisfying answers. Is 
> there any document for the required ports and internet access? Thanks a lot.
> 
>> On Mon, Mar 5, 2018 at 1:34 PM, Lian Jiang  wrote:
>> I need to setup a hadoop cluster (using HDP 2.6, ambari and blueprint) in a 
>> secure environment which limits the ingress/egress ports and the 
>> destinations/sources of internet traffic. For example, the hosts in this 
>> environment only open 22, 443 ports and they can only access website A, B.
>> 
>> To setup a hadoop cluster in such an environment, I need to know below so 
>> that ambari can work:
>> 
>> 1. which ports need to be open.
>> 2. which destinations/sources of internet traffic need to be permitted.
>> 
>> Other than searching document online and try-fail-try, is there a way to get 
>> such information reliably so that I can more confidently ask people to relax 
>> the environment? Appreciate any clue.
> 

Re: The ports needed for ambari and hadoop installation

[Lian Jiang]

I want to re-raise this question since I have not got satisfying answers.
Is there any document for the required ports and internet access? Thanks a
lot.

On Mon, Mar 5, 2018 at 1:34 PM, Lian Jiang  wrote:

> I need to setup a hadoop cluster (using HDP 2.6, ambari and blueprint) in
> a secure environment which limits the ingress/egress ports and the
> destinations/sources of internet traffic. For example, the hosts in this
> environment only open 22, 443 ports and they can only access website A, B.
>
> To setup a hadoop cluster in such an environment, I need to know below so
> that ambari can work:
>
> 1. which ports need to be open.
> 2. which destinations/sources of internet traffic need to be permitted.
>
> Other than searching document online and try-fail-try, is there a way to
> get such information reliably so that I can more confidently ask people to
> relax the environment? Appreciate any clue.
>

Re: The ports needed for ambari and hadoop installation

[Fernández Rodríguez , Juan Carlos]

Hi Lian,
you may be interested in https://knox.apache.org/. Hi haven't looked the
project for a lot of time, but it may be helpfull for you.
Regards

2018-03-05 22:34 GMT+01:00 Lian Jiang :

> I need to setup a hadoop cluster (using HDP 2.6, ambari and blueprint) in
> a secure environment which limits the ingress/egress ports and the
> destinations/sources of internet traffic. For example, the hosts in this
> environment only open 22, 443 ports and they can only access website A, B.
>
> To setup a hadoop cluster in such an environment, I need to know below so
> that ambari can work:
>
> 1. which ports need to be open.
> 2. which destinations/sources of internet traffic need to be permitted.
>
> Other than searching document online and try-fail-try, is there a way to
> get such information reliably so that I can more confidently ask people to
> relax the environment? Appreciate any clue.
>



-- 

*  KEEDIO*


*  Juan Carlos Fernández Rodríguez*

*+34 630 288 149*

*www.keedio.com *

C/ Virgilio 25, Pozuelo de Alarcón