Dear,
If you have anyone with you for the following position, please send the
suitable resume along with Contact Details,
Kindly share suitable resumes ASAP to sanjay.ya...@nityo.com
*Role : Hadoop Developer with AWS EMR Experience *
*Location : Portland, Oregon*
*Duration : Long term*
* Experience:9+ years*
*Rates:$60/hr*
*Job description : *
*Technical/Functional Skills Mandatory skills:*
• 5+ years of experience in programming with python. Strong
proficiency in python
• Familiarity with functional programming concepts
• 3+ years of Hands on experience in developing ETL data
pipelines using pyspark on AWS EMR
• Hands on experience of XML processing using python
• Good understanding of Spark’s RDD API
• Good understanding of Spark’s Dataframe and API
• Experience in configuring EMR clusters on AWS
• Experience and good understanding of Apache Spark Data sources
API.
• Experience of dealing with AWS S3 object storage from Spark.
• Experience in trouble shooting spark jobs. Knowledge of
monitoring spark jobs using Spark UI
• Performance tuning of Spark jobs.
• Understanding fundamental design principles behind a business
processes
*Nice to have skills:*
• Knowledge of AWS SDK CLI
• Experience of setting up continuous integration/deployment of
spark jobs to EMR clusters
• Knowledge of scheduling spark applications in AWS EMR cluster.
• Understanding the differences between Hadoop Mapreduce and
Apache Spark
• Proficient understanding of code versioning tools as Git, SVN
*Roles & Responsibilities*
• Design, development and implementation of performant ETL
pipelines using python API (pySpark) of Apache Spark on AWS EMR
• Writing reusable, testable, and efficient code
• Integration of data storage solutions in spark – especially
with AWS S3 object storage.
• Performance tuning of pySpark scripts.
• Need to ensure overall build delivery quality is good and on
time delivery is done at all times.
• Should be able to handle meetings with customers with ease.
• Need to have excellent communication skills to interact with
customer.
• Be a team player and willing to work in an onsite offshore
model, mentor other folks in the team (onsite as well as offshore)
pySpark developer with AWS EMR experience
- Spark, python, pyspark
Thanks & Regards,
*Sanjay Yadav *Desk : 609-853-0818 Ext 2167
sanjay.ya...@nityo.com <ak...@nityo.com>
www.nityo.com
--
--
To unsubscribe from this group, send email to
cbe-software-engineer-unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/CBE-Software-Engineer?hl=en
---
You received this message because you are subscribed to the Google Groups "CBE
Software Engineer" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to cbe-software-engineer+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
