Dear Friends, Greetings of the day!!!
Please share suitable profiles at the earliest: JD as follows: *Role: SR. Data Engineer* *Location: Deerfield, Illinois* Looking for Data Engineers with Databricks experience: who have experience in Databricks. Should be capable of programming in Python, Pyspark, Scala and Spark SQL. *Responsibilities :* · Should be able to work with other professionals to ensure successful implementation of proposed designs and completion of projects. · Should be responsible for the development, and integration of computer programs. · Should understand the business needs and works strictly in compliance with the needs of the client. *Requirements :* · Capability or programming in one of the following languages. o Python/Pyspark o Scala o Spark SQL · Deep understanding of distributed computing and Spark Architecture · Experience with Delta Lake/Tables within Databricks · Experience with optimizing Spark Queries and analyzing Spark DAGs · Understanding of both Batch and Streaming Jobs in Spark · Familiarity with different file types such as CSV, Parquet, JSON, etc. · Experience with other Azure data services such as Azure Data Lake Gen2, Event Hubs, Synapse etc. · Deep understanding of Azure data storage technologies such as Azure Blob Storage, Azure Data Lake Gen2, Synapse, Azure SQL, Azure Event Hub and the frameworks applied to each. · Understanding of ETL/ELT practices including data cleansing, validation, and transformation activities. · Data modelling experience shaping and transforming data into third normal form and dimensional models. · Advanced understanding of best practices for structuring and organizing Data Lake file systems for large volumes of data. Knowledge of big-data ecosystems -- Thanks & Regards, *Srikanth | *Technical Recruiter HCL Global Systems, Inc. Email ID: [email protected] Certified Minority Business Enterprise (MBE) -- You received this message because you are subscribed to the Google Groups "project managment" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/project-managment/CAED9fV4869Woc6HcOL1mu3gUfWPWh3Qow0OXQqpZAKRG9AkrUA%40mail.gmail.com.
