Position: Hadoop Infrastructure Engineer Location: NY, NY
Duration: 12 Months CTH Responsibilities: - Automate operation, installation and monitoring of Hadoop ecosystem components in our open source infrastructure stack; specifically: HBase, HDFS, Map/Reduce, Yarn, Oozie, Pig, Hive, Tez, Kafka, Storm - Evaluate Hadoop infrastructure requirements and design/deploy solutions (high availability, big data clusters, elastic load tolerance, etc.) - Create productive models for integrating internal application teams and vendors with our infrastructure - Do performance analysis and capacity planning for our clusters - Troubleshoot and debug Hadoop ecosystem run-time issues - Provide developer and operations documentation - Recommend OS and hardware level optimizations Qualifications: - Proven experience building and scaling out Hadoop based or Unix hosted database infrastructure for an enterprise - 2+ years experience of Hadoop administration or a strong and diverse background of distributed cluster management experience - 2+ years of Chef, Puppet, Ansible, etc. system configuration experience (or incredible quality shell scripting for systems management -- error handling, idempotency, configuration management) - 2+ years of Dev. Ops. experience or System Administration experience (be conversant in Unix networking and C system calls) - Having used continuous integration (Jenkins or Buildbot) for at least one released software project is a plus - Experience in Java, Python or Ruby development is a plus (including testing with standard test frameworks and dependency management systems, knowledge of Java garbage collection fundamentals) - Open source experience is a plus (a well curated blog, upstream accepted contribution or community presence) Many Thanks, [email protected] -- You received this message because you are subscribed to the Google Groups "Open Source J2EE frameworks" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/open-source-j2ee-frameworks. For more options, visit https://groups.google.com/d/optout.
