Data Engineer (PythonPyspark)

About Position: As a Data Engineer, you will play a critical role in ensuring the reliability, availability, and performance of our systems and applications. Role: Data Engineer (PythonPyspark) Location: All PSL Location Experience: 4-10 years. Job Type: Full Time Employment What You'll Do: Technical Design and implement client requirements. Build data pipeline. Perform transformations using pyspark and python in data bricks. Create automated workflows with the help of triggers, Scheduled Jobs in Airflow. Design and development of Airflow dags to orchestrate the data processing jobs. Design and development for ensuring timely notifications through email alerts in the event of job failures or critical system issues. Developing and implementing of code to write the logic data. Add unit testcases for using testing libraries pytest with 100% test coverages. Direct customer interaction to understand & gather requirements. Provision of technical input to customer for analysis and design work. Support to customer queries. Expertise You'll Bring: Design and implement the ETL solution according to Business Requirements and platform specific technical best practices. Build and manage data pipeline using databricks and airflow. Perform data transformation using Pyspark from different data sources. Good Knowledge on Azure Databricks. Technical issue management & knowledgebase contributions. Design and Development tasks for critical applications. Good analytical and design skills. Customer interaction. Strong communication and coordination skills. Benefits: Competitive salary and benefits package Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications Opportunity to work with cutting-edge technologies Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards Annual health check-ups Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents Inclusive Environment: Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds. We offer hybrid work options and flexible working hours to accommodate various needs and preferences. Our office is equipped with accessible facilities, including adjustable workstations, ergonomic chairs, and assistive technologies to support employees with physical disabilities. If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment. We are committed to creating an inclusive environment where all employees can thrive. Our company fosters a values-driven and people-centric work environment that enables our employees to: Accelerate growth, both professionally and personally Impact the world in powerful, positive ways, using the latest technologies Enjoy collaborative innovation, with diversity and work-life wellbeing at the core Unlock global opportunities to work and learn with the industry’s best Let’s unleash your full potential at Persistent “Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

Location: pune, IN

Posted Date: 4/30/2025