AWS Data Engineer - ETL/Python

We are seeking a skilled AWS Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, PySpark, AWS Glue, Athena, Redshift, and SQL. The successful candidate will play a key role in designing, developing, and maintaining our data infrastructure, ensuring optimal performance and reliability. Key Responsibilities : - Design, develop, and maintain scalable and efficient ETL pipelines using AWS Glue, Python, and PySpark to process structured and unstructured data. - Integrate data from various sources into data lakes and data warehouses, ensuring data consistency and quality. - Develop and maintain data models and schemas to support business intelligence and analytics requirements. - Optimize data processing workflows for performance and cost-effectiveness, leveraging AWS services like Athena and Redshift. - Work closely with data scientists, analysts, and business stakeholders to understand data needs and deliver scalable solutions. - Implement monitoring solutions and troubleshoot data pipeline issues to ensure data accuracy and reliability. - Maintain comprehensive documentation of data workflows, processes, and best practices. - Stay updated with industry best practices and emerging technologies in data engineering to drive continuous improvement. Required Skills and Qualifications : - Minimum 5 years of experience in data engineering roles, with a focus on AWS cloud services. - Strong proficiency in Python and PySpark for data engineering tasks. - Hands-on experience with AWS Glue, Athena, and Redshift. - Proficient in SQL with the ability to write complex queries for data analysis. - Solid understanding of data modeling and data warehousing concepts. - Experience with version control systems and best practices. - AWS Certified Data Analytics Specialty or AWS Certified Solutions Architect. - Experience with AWS services such as Lambda, S3, and EMR. - Familiarity with data visualization tools like QuickSight. - Knowledge of CI/CD pipelines and infrastructure as code (e.g., Terraform) (ref:hirist.tech)

Location: in, IN

Posted Date: 5/9/2025