Senior Big Data Platform Engineer – C12 – AVP - Pune

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Responsibilities:

• Install and configure Cloudera cluster
• Apply proper architecture guidelines to ensure highly available services
• Plan and execute major platform software and operating system upgrades and maintenance across physical environments
• Develop and automate processes for maintenance and monitoring of the environment (Python, Java, Shell Script)
• Implement security measures for all aspects of the cluster (SSL, disk encryption, role-based access via Cloudera sentry)
• Ensure proper resource utilization between the different development teams and processes
• Review performance stats and query execution/explain plans; recommend changes for tuning Hive/Impala queries
• Create and maintain detailed, up-to-date technical documentation

Qualifications:

• 5+ years experience with big data tools: Hadoop, Hive, HBase, Spark, Kafka, Impala, Solr, Phoenix, etc.
• 3+ years experience with Python, Java, Shell Script
• 2+ years experience with cloud services platform (prefer AWS.)
• Ability to troubleshoot problems and quickly resolve issues
• Cluster maintenance as well as creation and removal of nodes
• Performance tuning of Hadoop clusters
• Screen Hadoop cluster job performances and capacity planning
• Monitor Hadoop cluster connectivity and security
• Manage and review Hadoop log files
• File system management and monitoring
• HDFS support and maintenance
• Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required

Education:

• Bachelor’s degree/University degree

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

------------------------------------------------------

Job Family Group:

------------------------------------------------------

Job Family:

------------------------------------------------------

Time Type:

------------------------------------------------------

Most Relevant Skills

------------------------------------------------------

Other Relevant Skills

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.