Dear,
If you have anyone with you for the following position, please send the
suitable resume along with Contact Details,
Kindly share suitable resumes ASAP to [email protected]
*Role : Hadoop Developer with AWS EMR Experience *
*Location : Portland, Oregon*
*Duration : Long term*
* Experience:9+ years*
*Rates:$60/hr*
*Job description : *
*Technical/Functional Skills Mandatory skills:*
• 5+ years of experience in programming with python. Strong
proficiency in python
• Familiarity with functional programming concepts
• 3+ years of Hands on experience in developing ETL data
pipelines using pyspark on AWS EMR
• Hands on experience of XML processing using python
• Good understanding of Spark’s RDD API
• Good understanding of Spark’s Dataframe and API
• Experience in configuring EMR clusters on AWS
• Experience and good understanding of Apache Spark Data sources
API.
• Experience of dealing with AWS S3 object storage from Spark.
• Experience in trouble shooting spark jobs. Knowledge of
monitoring spark jobs using Spark UI
• Performance tuning of Spark jobs.
• Understanding fundamental design principles behind a business
processes
*Nice to have skills:*
• Knowledge of AWS SDK CLI
• Experience of setting up continuous integration/deployment of
spark jobs to EMR clusters
• Knowledge of scheduling spark applications in AWS EMR cluster.
• Understanding the differences between Hadoop Mapreduce and
Apache Spark
• Proficient understanding of code versioning tools as Git, SVN
*Roles & Responsibilities*
• Design, development and implementation of performant ETL
pipelines using python API (pySpark) of Apache Spark on AWS EMR
• Writing reusable, testable, and efficient code
• Integration of data storage solutions in spark – especially
with AWS S3 object storage.
• Performance tuning of pySpark scripts.
• Need to ensure overall build delivery quality is good and on
time delivery is done at all times.
• Should be able to handle meetings with customers with ease.
• Need to have excellent communication skills to interact with
customer.
• Be a team player and willing to work in an onsite offshore
model, mentor other folks in the team (onsite as well as offshore)
pySpark developer with AWS EMR experience
- Spark, python, pyspark
Thanks & Regards,
*Sanjay Yadav *Desk : 609-853-0818 Ext 2167
[email protected] <[email protected]>
www.nityo.com
--
You received this message because you are subscribed to the Google Groups "Open
Source Erp & Crm" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/open-source-erp-crm.
For more options, visit https://groups.google.com/d/optout.
