Hello,
Please respond with any available profile to t...@zodiac-solutions.us or can call me at desk for further queries…… Job Title: Hadoop Developer Cum Admin Location: Eden Prairie, MN Rate: $65/Hr C2C Years of exp at least 10 + - Implemented Spark streaming to receive real time data from the Push agents and dump them to event hub - Handled importing data from the sources for data cleansing and transformations - Created Spark batch jobs to move data from event hubs to anomaly detection engine - Development of Spark streaming, SQL and batch jobs through Scala - Implemented Kafka message receiving for spark streaming job - Created Spark SQL queries for faster requests - Implemented Hive Queries for analyzing data using Hive QL - Converted the data into Parquet format and read the data from Parquet format - Orchestrating Oozie Workflow Engine in running workflow jobs - Worked on creating RDDs, Data Frames and performed different Actions and Transformations - Defined the data flow within Hadoop eco system and guide the team with the implementation - Developed custom UDFS and implemented Pig scripts - Involved in Azure Data Factory (ADF) Pipeline creation for job execution - Provided support to data analysts in running Hive queries to for further anomaly analysis - Specifying the cluster size, allocating Resource pool, Distribution of Hadoop by writing the specification texts in JSON and Parquet file formats Thank You Tejaswini t...@zodiac-solutions.us -- You received this message because you are subscribed to the Google Groups "Business_Intelligence" group. To unsubscribe from this group and stop receiving emails from it, send an email to business_intelligence+unsubscr...@googlegroups.com. To post to this group, send email to business_intelligence@googlegroups.com. Visit this group at https://groups.google.com/group/business_intelligence. For more options, visit https://groups.google.com/d/optout.
