Experience – 8+ years
Pune Location
Job Description: As an AWS DevOps Developer with Data Engineering skills, you will be responsible for designing, developing, and maintaining scalable data solutions on the AWS platform. You will work closely with cross-functional teams to ensure seamless integration and optimal performance of our data engineering projects.
Key Responsibilities:
• Design, develop, and implement data pipelines and ETL processes using AWS services.
• Collaborate directly with our FinOps teams and market units across the organization to understand data requirements and deliver solutions that meet business needs.
• Optimize and manage data storage solutions using AWS services such as S3, RDS, and NoSQL databases.
• Ensure data quality, integrity, and security across all data engineering projects.
• Monitor and troubleshoot data workflows to ensure high availability and performance.
• Design and build advanced and interactive dashboards using tools such as AWS QuickSight and Power BI.
• Create and oversee a cloud billing dashboard to track, manage and optimize cloud costs and Reserved Instance purchases
• Build a dashboard that provides secure self‐service capabilities to all teams on cloud spend
• Knowledge of DevOps practices and CI/CD pipelines.
• Stay updated with the latest AWS technologies and best practices to continuously improve our data infrastructure.
Solve technical problems and create viable tooling
Design and implement shared services in cloud infrastructure.
Use best appropriate infrastructure automation tools to provision cloud infrastructure components
Attend important Agile events and finish assigned work packages / tasks
Ensure smooth handover of project deliverables to internal and external customers
Actively contributing to internal projects such as tooling and documentation
Mentor new team member
Promote the use of automation to solve technical challenges
Skills:
• Bachelor’s degree in computer science, Information Technology, or a related field.
• Proven experience as a Cloud Developer or Data Engineer, with a focus on AWS.
• Strong proficiency in AWS services such as EKS, EC2, S3, Lambda, Glue.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Strong proficiency in Python
• Familiarity with infrastructure as code tools like CloudFormation or Terraform.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.
• Experience in building and utilizing REST APIs.
• Experience building and running Kubernetes Background Tasks with Batch-Jobs.
• Hands on experience Git-Hub Action
Preferred Qualifications:
• AWS Certified DevOps Engineer – Professional and or AWS Certified Data Engineer – Associate
• Knowledge of DevOps practices and CI/CD pipelines.
• Knowledge in using Flask framework to create dynamic websites, APIs or microservices is a plus.