*10 plus years of experience* *Systems Engineer/DATA ENGINEER II *
*123 NORTH 3RD STREET, SUITE 300, MINNEAPOLIS, MN* *12 plus months* As a data engineer you will work with a small team to deliver data products to business customers, leveraging the vast corpus of data using the latest big data technologies in the cloud. A data engineer has the unique experience of working across multiple programming languages and technologies to implement the right solution for the customer. *Responsibilities * ● Design and implement large scale distributed solutions in AWS and GCP clouds. ● Implement solutions which utilize Big Data cloud tools like Google Dataproc, Dataflow, and BigQuery. ● Design, build, and debug Hadoop, Hive, and Spark based data pipelines. ● Create APIs which expose collected and analyzed data to partners using NodeJS and Python. ● Design, build, and debug Python based pipelines using the Luigi framework. ● Process real-time streaming data using the ELK stack, Apache Storm, and Spark Streaming. ● Create new web visualizations using common open-source libraries like D3. *Required Skills / Qualifications * *Requirements: * ● BS degree in Computer Science or equivalent work experience ● Experience with Java, Python, or Scala and a willingness to learn the others. ● Experience with SQL languages ● Experience with distributed version control like Git or Mecurial ● Excellent problem solver and communicator ● Self-motivated and ability to take initiative with creative problem solving ● Understanding of software craftsmanship qualities and principles *Preferred: * ● Experience with Scala and/or Spark ● Experience with Kafka, Amazon Kinesis, or Google Pub/sub ● Experience building applications at scale using distributed databases, NoSQL, and *MapReduce tools. * ● Experience creating and consuming APIs for integration with external customers ● Experience with Javascript ● Familiarity with Amazon Web Services or Google Cloud Platform ● Familiarity with natural language processing and data modeling. -- You received this message because you are subscribed to the Google Groups "SAP ABAP" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/sap-abap. For more options, visit https://groups.google.com/d/optout.
