Hadoop Developer / Admin
Immediate need
Job Location: McLean, VA
Long-term/Ongoing project
Full-time opportunity available
Job Responsibilities:
- Management and Administration of Hadoop clusters and all other resources in the entire Hadoop ecosystem.
- Deployment and configuration of Hadoop clusters, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure name-node high availability, and other Hadoop management functions.
- Conduct Hadoop cluster performance tuning and optimizations.
- Perform proactive and reactive monitoring of Hadoop clusters.
- Capacity planning and Scaling of Hadoop cluster as needed.
- Monitor Hadoop cluster connectivity and security.
- Backup, restore, and maintenance of HDFS file system as required.
Required Qualifications:
- 5+ years hands-on administrative experience of Apache Hadoop.
- 3+ years of Linux, AIX or other UNIX based system administration.
- Solid understanding of Shell Scripting, YARN and other Hadoop ecosystem tools.
- Basic administration knowledge of Cloudera Distribution.
- B.S. in Computer Science/Engineering or equivalent relevant experience.
- Must be a team player with positive attitude and ability to collaborate effectively.
Desired Qualifications:
- Working experience with Cloudera distribution.
- Familiarity with Hive and MapReduce modules.
- Knowledge of Azure cloud infrastructure.
- Working knowledge of automation tools like CHEF.
- Familiarity with both relational and NoSQL database systems.
- Familiarity with Data Lakes repository technology.
- Familiarity with Teradata data warehousing systems.