Hi,
Please find this requirement and send me your consultant resume at
manish.srivast...@idctechnologies.com and call me 408-844-3778.
*Title: Lead Big data ( Hadoop ) (Need GC/USC and Local consultant) *
*Duration: 6+ Months *
*Location: Basking Ridge NJ, and Boston MA *
Project; Big data platform Data Lake
Responsibilities:
- Provide hands-on leadership for the design and development of ETL data
flows using Hadoop and Spark ECO system components. Leading the develop of
large-scale, high-speed, and low-latency data solutions in the areas of
large scale data manipulation, long-term data storage, data warehousing,
low-latency retrieval systems, real-time reporting and analytics Data
applications - visualization, BI, dashboards, ad-hoc analytics
- Design & implement work flow jobs using Talend & Unix / Linux
scripting to perform ETL on Hadoop platform
- Translate complex functional and technical requirements into detailed
design
- Perform analysis of data sets and uncover insights
- Maintain security and data privacy
- Propose best practices/standards
- Work with the System Analyst and development manager on a day-to-day
basis
- Work with other team members to accomplish key development tasks
- Work with service delivery (support) team on transition and
stabilization
- Design and develop optimal solutions for the implementation,
maintenance and monitoring of all components of software
- Responsible for integrating all development with the architecture used
across the company
- Help shape and augment team’s continuous delivery capabilities and
utilize DevOps best practices to improve delivery automation,
collaboration, and efficiency
- Design and develop ETL data flows using Hive / Pig.
- Loading from disparate data sets.
- Pre-processing using Hive and Pig.
- Translate complex functional and technical requirements into detailed
design.
- Perform analysis of data sets and uncover insights.
- Maintain security and data privacy.
- Implement data flow scripts using Unix / hive / pig scripting.
- Propose best practices/standards.
- Work with the System Analyst and Development Manager on a day-to-day
basis
- Work with other team members to accomplish key development tasks
- Work with service delivery (support) team on transition and
stabilization
Required Software / Tools:
- We are looking for a Lead Big Data Developer who will lead and work on
the collecting, storing, processing, and analyzing of huge sets of data.
- The primary focus will be on choosing optimal solutions to use for
these purposes, then maintaining, implementing, and monitoring them.
- You will also be responsible for integrating them with the
architecture used across the company.
- Individual should have expertise and at least 5 years of hands-on
experience in Java Enterprise ecosystem (Design, Development, Test, Deploy
on Production) is required.
- At least 4 years of hands-on experience with
Hadoop/Hive/MapReduce/Pig/Sqoop/Flume (Design, Development, Test, Deploy on
Production Hadoop cluster) , demonstrated ability to segment and organize
data from disparate sources and knowledge of data security and encryption
models is desirable.
- Experience working with Hadoop/HBase/Hive/MRV1/MRV2 & ETL processing
with HIVE/Pig scripts is required.
- Demonstrate experience in implementing Unix scripting is required.
- Any experience is health care insurance industry is a plus.
Preferred Qualifications:
· Team lead experience
· ETL development experience
· ETL data flows experience
· Apache Spark
· Talend experience
· Unix/Linux Scripting experience
· Shell Scripting experience
· Python experience
· HBase experience
· NoSQL experience
· Scala experience
· JSON experience
· REST experience
· Sqoop experience
· Flume experience
· Data warehouse implementation experience
*Thanks and Regards*
*Manish Srivastava*
*Sr. Technical Recruiter*
*IDC Technologies, Inc.*
*408-844-3778*
--
--
***************************************************************************************
For all SAP related tutorials,Articles,Faqs,Tips
www.sapbrainsonline.com
****************************************************************************************
You received this message because you are subscribed to the Google Groups
"sapbrains" group.
To post to this group, send email to sapbrains@googlegroups.com
To unsubscribe from this group, send email to
sapbrains-unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/sapbrains?hl=en
---
You received this message because you are subscribed to the Google Groups
"sapbrains" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to sapbrains+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
