Hello Friends Hope you are doing great
Please let me know if you have any Hadoop Developer with some Admin Experience . Please share it on [email protected] We are a looking for a strong HADOOP developer with some admin . Good to have Cloudera certified. *Location: Eden Prairie, MN* *Open for h1b s who can join immediately* *Years of exp at least 10 +* · Implemented Spark streaming to receive real time data from the Push agents and dump them to event hub · Handled importing data from the sources for data cleansing and transformations · Created Spark batch jobs to move data from event hubs to anomaly detection engine · Development of Spark streaming, SQL and batch jobs through Scala · Implemented Kafka message receiving for spark streaming job · Created Spark SQL queries for faster requests · Implemented Hive Queries for analyzing data using Hive QL · Converted the data into Parquet format and read the data from Parquet format · Orchestrating Oozie Workflow Engine in running workflow jobs · Worked on creating RDDs, Data Frames and performed different Actions and Transformations · Defined the data flow within Hadoop eco system and guide the team with the implementation · Developed custom UDFS and implemented Pig scripts · Involved in Azure Data Factory (ADF) Pipeline creation for job execution · Provided support to data analysts in running Hive queries to for further anomaly analysis · Specifying the cluster size, allocating Resource pool, Distribution of Hadoop by writing the specification texts in JSON and Parquet file formats *Best,* *Mani Sharma* *Team Lead* *Dominion Technology Services Corp.* 3900 Westerre Parkway, Suite 300 Richmond, VA 23233 *[email protected] <[email protected]>* |www.dtscinc.com -- You received this message because you are subscribed to the Google Groups "SAP BASIS" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/sap-basis. For more options, visit https://groups.google.com/d/optout.
