*Big Data Engineer - Hadoop/Spark-Predictive Analytics * *Location: Hartford, CT *
*Duration: 6 Month Contract* *Hartford, CT area.* *Job Description:* The Big Data Engineer will be working on setup of a Big Data Platform in an AWS/Azure environment to gather and analyze sensor data. Build and deploy production grade Big Data pipeline for data driven analytics including models and alerting criteria. Train personnel in the software capabilities of the AWS-Azure/Hadoop platform. • Determine the appropriate pieces of software need to accomplish the reporting needs. • Capacity planning on the AWS platform to handle the projected load, availability, and cost concerns. • Determine a standardized method of evaluating sensor data to determine when equipment is exhibiting abnormal behavior and/or is headed for failure. • Work with the Engineering teams to document alerting criteria for individual pieces of equipment. • Develop reporting capabilities to analyze sensor data to predict equipment failure. Qualifications: • 8-10 years of professional Big Data / Predictive Analytics experience. • 5+ years of Big Data Hadoop experience, including experience with HDP 2.5 on AWS/Azure Cloud Platforms. • Creative Problem Solver who has worked with Big Data and built models in the area of Predictive and Preventive analytics. Worked with different approaches and dealt with data in a variety of contexts. • Proven experience in design, building and deployment of production grade Big Data pipeline for data driven analytics. • Very strong and real project experience with latest version of: Spark (Streaming, MLlib, GraphX, SQL); Java, Scala, Python, R, and SAS. • Implemented projects with NoSQL technology like Cassandra, Hbase. • Ingesting streaming data with technologies like Nifi, Kafka, Storm, Flume, Kinesis, Azure Eventhub. • Very strong SQL skills. • REST APIs for source data from sensor, server logs as well as structured data (such as sensor meta data) from RDBMS, etc. • Ability to set up Security using Knox and Ranger. • Excellent technical skills particularly with Microsoft Excel, data analysis, and graphics • Good communications skills and technical report writing skills • Experience with P&C Insurance sensor data highly desirable. • Bachelors in Computer Science, Engineering or Mathematics required. • HDP Certified Apache Spark Developer preferred. *Waiting for your response…* Best Regards, *Ravi Nigam* 978-558-4666 Ext. 101 r...@teknavigators.com *TekNavigators LLC* 100 Cummings Center, Suite 207 P, Beverly, MA 01915 DISCLAIMER: This message and any attachments are solely for the use of the individual or entity to which it is addressed and may contain information that is privileged or confidential. If you are not the intended recipient, any disclosure, use or distribution of the information contained herein is prohibited. If you have received this communication in error, please notify the sender by reply e-mail and immediately delete this message and any attachments. You may reply and send an email with "Remove" in the subject line in order to discontinue communication. -- You received this message because you are subscribed to the Google Groups "SAP-UK" group. To unsubscribe from this group and stop receiving emails from it, send an email to sap-uk+unsubscr...@googlegroups.com. To post to this group, send email to sap-uk@googlegroups.com. Visit this group at https://groups.google.com/group/sap-uk. For more options, visit https://groups.google.com/d/optout.
