*Job Title :: Need Senior/Exp Spark Scala Resource*
*Location :: Columbus, IN* *Mode of hire: Contract (C2C/W2) * *Duration :: **6+ Month contract* *Client :: Cognizant* *RATE :: $60/hr on C2C* *Job Details ::* - Looking for candidate having 5+years of experience. - REQUIRED - Intermediate experience resulting in the following skills and knowledge: - Familiarity analyzing complex business systems, industry requirements, and/or data regulations. - Background in processing and managing large data sets. - Design and development for a Big Data platform using open source and third-party tools. - SPARK, Scala/Java, Map-Reduce, Hive, HBase, and Kafka or equivalent college coursework. - SQL query language. - Clustered compute cloud-based implementation experience. - Experience developing applications requiring large file movement for a Cloud-based environment and other data extraction tools and methods from a variety of sources. - Experience in building analytical solutions. *Key Responsibilities ::* • Designs and automates deployment of our distributed system for ingesting and transforming data from various types of sources (relational, event-based, unstructured). • Designs and implements framework to continuously monitor and troubleshoot data quality and data integrity issues. • Implements data governance processes and methods for managing metadata, access, retention to data for internal and external users. • Designs and provide guidance on building reliable, efficient, scalable and quality data pipelines with monitoring and alert mechanisms that combine a variety of sources using ETL/ELT tools or scripting languages. • Designs and implements physical data models to define the database structure. Optimizing database performance through efficient indexing and table relationships. • Participates in optimizing, testing, and troubleshooting of data pipelines. • Designs, develops and operates large scale data storage and processing solutions using different distributed and cloud based platforms for storing data (e.g. Data Lakes, Hadoop, Hbase, Cassandra, MongoDB, Accumulo, DynamoDB, others). • Uses innovative and modern tools, techniques and architectures to partially or completely automate the most-common, repeatable and tedious data preparation and integration tasks in order to minimize manual and error-prone processes and improve productivity. Assists with renovating the data management infrastructure to drive automation in data integration and management. • Ensures the timeliness and success of critical analytics initiatives by using agile development technologies such as DevOps, Scrum, Kanban • Coaches and develops less experienced team members. *Thanks and Regards,* *Atulit Tripathi*Call – 732-369-4193 |Email- [email protected] *XChange Software Inc.*(*Subsidiary of Intone Networks*) -- You received this message because you are subscribed to the Google Groups "CorptoCorp" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/corptocorp/5d1bff18-7f44-4ecf-aa5b-57eadc6f5874%40googlegroups.com.
