Hello Professionals,

Hope you are doing well.

 

Role: Big Data Architect

Location: Austin, TX and Sunnyvale, CA

Long Term Contract

 

 

Must have Skills : 

. Apache Spark  

            Ω Should have working experience in Spark Programming and Spark
jobs

            Ω Should have working experience in Apache Spark Installation /
Infrastructure setup

            Ω Infrastructure setup for Hadoop

            Ω Usage : Spark jobs will be used for streaming real-time data
processing from multiple data sources  

            Ω Note : Hadoop Mapreduce was explored and did not fit the need
as there was too much latency and was not deriving the real-time data.

 

. Apache Hadoop

            Ω Should have working experience in Hadoop Installation
(distributed clusters) / Infrastructure setup

            Ω Usage : To Store Data side of all the real-time processing
dump that the spark jobs would stream from Oracle, Couchbase, Elastic data
sources. 

 

. Security 

            Ω Should have experience in the Authentication & Authorization
modules like - Kerebros / LDAP / S3 authentication (plan is to explore one
of the authentication model)

            Ω AWS / Amazon S3

 

. Oracle or any database foundation : 

            Ω Must have very strong SQL knowledge. 

 

. Presto Query Engine (Plug and play) 

            Ω for distributed SQL engine module

 

. Docker & Kubernetes

 

. Monsoon VMs 

 

Nice to have

. Kafka basic knowledge 

 

 


 <https://idctechnologies.com/> Description: Description: Description:
Description: Description: cid:[email protected]


Deependra Kumar | Senior Technical Recruiter


IDC Technologies Inc.

Email:  <mailto:[email protected]> [email protected]

Phone: 408-882-6922

Website:  <http://idctechnologies.com/> idctechnologies.com 



 

 

-- 
You received this message because you are subscribed to "rtc-linux".
Membership options at http://groups.google.com/group/rtc-linux .
Please read http://groups.google.com/group/rtc-linux/web/checklist
before submitting a driver.
--- 
You received this message because you are subscribed to the Google Groups 
"rtc-linux" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion on the web visit 
https://groups.google.com/d/msgid/rtc-linux/5f16fd5a.1c69fb81.1bdb1.f12bSMTPIN_ADDED_BROKEN%40gmr-mx.google.com.

Reply via email to