Hi All, I have large volume of data nearly 500TB(from 2016-2018-till date), I have to do some ETL on that data.
This data is there in the AWS S3, so I planning to use AWS EMR setup to process this data but I am not sure what should be the config I should select . 1. Do I need to process monthly or can I process all data at once? 2. What should be Master and slave(executor) memory both Ram and storage? 3. What kind of processor (speed) I need? 4. How many slaves do we need ? Based on this I want to calculate the cost of AWS EMR and start process the data Regards Indra
