Data Engineer Wilmington DE
Sr DE: 8+ years exp Working Experience Software/Tools; ○ Experience with big data tools: Hadoop, Apache Spark, Kafka, etc. ○ Experience with relational SQL, Snowflake and NoSQL databases, including Postgres and Cassandra. ○ Experience with data pipeline and workflow management tools: NiFi, Kylo, Luigi, Airflow, Azkaban etc. ○ Experience with AWS cloud services: S3, EC2, EMR, RDS, Redshift ○ Experience with stream-processing systems: Storm, Spark-Streaming, etc. ○ Experience with object-oriented/object function scripting languages: Python, Java, C++, PySpark, Scala, etc. Responsibilities for Data Engineer: ● Create and maintain optimal data pipeline architecture, ● Assemble large, complex data sets that meet functional / non-functional business requirements. ● Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. ● Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies. ● Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. ● Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs. ● Keep our data separated and secure across national boundaries through multiple data centers and AWS regions. ● Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader. ● Work with data and analytics experts to strive for greater functionality in our data systems. *Regards,* *ANKIT MENDIRATTA* *Lead Recruiter* *Net**2**Source Inc.* *Global HQ Address – 7250 Dallas Pkwy, Suite 825 Plano, Texas 75024* *Office: (201) 340-8700 x **459 | Fax: (201) 221-8131| Email: **[email protected] <[email protected]>* -- You received this message because you are subscribed to "rtc-linux". Membership options at http://groups.google.com/group/rtc-linux . Please read http://groups.google.com/group/rtc-linux/web/checklist before submitting a driver. --- You received this message because you are subscribed to the Google Groups "rtc-linux" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/rtc-linux/CALQk_bdwiPdFeVSHDgZDKeP-O_ahv--9akg_CTWAvDV5pnS8Dg%40mail.gmail.com.
