Hi,

My client is looking for* Big Data Engineer.*

Please let me know if you are interested .



*Position:  Big Data Engineer*

*Location:  Lexington, KY *

*Duration:  6+ Months*

*Start:  ASAP*



*Job Description*



Build and tune a Spark/Python-based system in AWS that will allow data
scientists to run ad-hoc queries from R against nearly-raw JSON/Parquet
files residing in S3.  Given our strict security requirements, the
candidate must have strong AWS experience with VPCs, subnets, cross-account
access, instance profiles, assuming roles, and so on.  Finally, they must
be capable of writing version-controlled Bash/Python scripts to automate
the environment.



In terms of technology keywords, I would say the following are
mandatory: *PySpark,
Spark SQL, Spark DataFrames, Python, Boto, AWS CLI, S3, EC2, VPCs,
Thrift, Bash, Git, JSON, and Parquet*.  The following may be helpful, but
should not be their primary qualification: Jupyter, Spark Scala, Spark
Java, Maven, JDBC, HDFS, Data Pipeline, EMR, Hive, and Redshift/Postgres













*--------*

*Thanks,*

*Bhanu Pratap Singh*

*Source InfoTech Inc.*

W: *609-917-3310*| F: 732-909-2282| Email: *[email protected]
<[email protected]>* | Website: *www.sourceinfotech.com*
<http://www.sourceinfotech.com/> | *Hangout:* *[email protected]
<[email protected]>*

-- 
-- 
***************************************************************************************
For all SAP related tutorials,Articles,Faqs,Tips
          
          www.sapbrainsonline.com

****************************************************************************************

You received this message because you are subscribed to the Google Groups 
"sapbrains" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to 
[email protected]
For more options, visit this group at 
http://groups.google.com/group/sapbrains?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"sapbrains" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
For more options, visit https://groups.google.com/d/optout.

Reply via email to