Data Engineer - AWS/PySpark

Job Title : Data Engineer (AWS & PySpark) Experience : 8 YEARS (Minimum 5 years in Apache PySpark with AWS, GLU) Location : Hyd/Pune/ Kolkatta Time Zone : Normal IST Mandatory Skills : - AWS Glue - AWS Step Function - PySpark - Python - Apache PySpark with Python and AWS (Minimum 5 years of experience) Key Responsibilities : - Develop and optimize ETL pipelines using AWS Glue and PySpark - Implement AWS Step Functions for workflow automation - Work with SparkSQL, SQL, and AWS cloud environments to manage and process large datasets - Ensure robust data engineering practices with DevOps, CloudOps, and DataOps methodologies - Follow CI/CD best practices with a Site Reliability Engineering (SRE) mindset - Design and implement Lakehouse and Data Warehouse (DW) architectures - Develop APIs and Microservices for data integration and transformation - Apply version control using Git for efficient code management Soft Skills : - Strong written and verbal communication skills - Ability to translate business needs into system requirements - Analytical mindset with strong problem-solving skills - Ability to collaborate effectively in a team-oriented environment Preferred Experience : - Hands-on experience with cloud-based data processing and analytics - Strong understanding of dimensional modeling and database optimization - Exposure to modern data engineering best practices and architectures (ref:hirist.tech)

Location: in, IN

Posted Date: 5/10/2025