Principal OR Lead Devops Engineer

About Us: Paytm is India’s leading digital payments and financial services company, which is focused on driving consumers and merchants to its platform by offering them a variety of payment use cases. Paytm provides consumers with services like utility payments and money transfers, while empowering them to pay via Paytm Payment Instruments (PPI) like Paytm Wallet, Paytm UPI, Paytm Payments Bank Netbanking, Paytm FASTag and Paytm Postpaid- Buy Now, Pay Later. To merchants, Paytm offers acquiring devices like Soundbox, EDC, QR and Payment Gateway where payment aggregation is done through PPI and also other banks’ financial instruments. To further enhance merchants’ business, Paytm offers merchants commerce services through advertising and Paytm Mini app store. Operating on this platform leverage, the company then offers credit services such as merchant loans, personal loans and BNPL, sourced by its financial partners.

We are seeking an experienced Principal Engineer (Data DevOps) to lead our Data DevOps team in building, managing, and optimizing high-scale, secure, and reliable big data platforms. The ideal candidate will combine strong technical expertise with proven leadership skills, driving best practices in cloud infrastructure, automation, CI/CD, and big data technologies. This role involves managing cross-functional priorities, mentoring engineers, and ensuring delivery of high-quality, scalable data solutions.

Key Responsibilities: 

● Lead, mentor, and grow a high-performing Data DevOps team, fostering technical excellence and ownership.

● Drive architecture, design, and implementation of large-scale cloud and data infrastructure, ensuring scalability, performance, and security.

● Collaborate closely with Data Engineering, Data Science, Analytics, and Product teams to deliver efficient and reliable data platforms.

● Oversee operations and optimization of AWS-based infrastructure, including VPC, EC2, S3, EMR, EKS, SageMaker, Lambda, CloudFront, CloudWatch, and IAM.

● Manage and scale big data platforms leveraging Kafka, Hive HMS, Apache Ranger, Apache Airflow, EMR, Spark, Trino, Looker, and Jupyter Notebooks.

● Implement and maintain CI/CD pipelines and infrastructure automation using Terraform, Ansible, and CloudFormation.

● Ensure system observability, proactive incident management, and SLA adherence.

● Champion cloud security best practices, including API security, TLS/HTTPS, and access control policies.

● Partner with stakeholders to prioritize initiatives, manage budgets, and optimize cloud and operational costs

 Experience: 8+ years in DevOps/Data DevOps or related fields, including at least 4+ years in a leadership role.

● Proven track record in managing high-scale big data infrastructure and leading engineering teams.

● Strong hands-on experience with AWS services and infrastructure automation tools (Terraform, Ansible, CloudFormation).

● Deep knowledge and hands-on experience with Kafka, Hive HMS, Apache Ranger, Apache Airflow, EMR, Spark, Trino, Jupyter Notebooks, and Looker.

● Proficiency in Kubernetes/EKS, Docker, ECS, and CI/CD tools.

● Strong understanding of networking, cloud security, and compliance requirements.

● Excellent communication, stakeholder management, and decision-making skills.

● Exposure to SQL and data query optimization is an advantage.

Compensation: If you are the right fit, we believe in creating wealth for you with enviable 500 mn+ registered users, 25 mn+ merchants and depth of data in our ecosystem, we are in a unique position to democratize credit for deserving consumers & merchants – and we are committed to it. India’s largest digital lending story is brewing here. It’s your opportunity to be a part of the story!