Data Engineer

About Position: As a Data Engineer, you will play a critical role in ensuring the reliability, availability, and performance of our systems and applications. Role: Data Engineer (JavaSpark) Location: All PSL Locations Experience: 4-10 years. Job Type: Full Time Employment What You'll Do: Technical Design and implement client requirements. Build data pipeline. Perform transformations using Javaspark in data bricks. Create automated workflows with the help of triggers, Scheduled Jobs in Airflow. Design and development of Airflow dags to orchestrate the data processing jobs. Design and development for ensuring timely notifications through email alerts in the event of job failures or critical system issues. Developing and implementing of code to write the logic data. Direct customer interaction to understand & gather requirements. Provision of technical input to customer for analysis and design work. Support to customer queries. Expertise You'll Bring: Proficiency in Java, with a good understanding of its ecosystems. Must have Experience in Data Engineering Java and Spark, Java is a must. Good knowledge of Spark Architecture Basic knowledge of Linux / Linux scripting is a must Transformation and aggregated data from multiple sources. Good Knowledge of Spark Architecture including Spark Core, Spark SQL, RDD, Data Set, and Data Frames. Good to have basic knowledge. Performance tuning using Optimization techniques, Caching Data in Memory, Broadcast etc. Good to have. Azure/Cloud DevOps concepts, CI/CD pipeline. Good to have. Good knowledge on the architecture of a Spark application. Good to have. Knows the concepts of deployment pipelines. Good to have. Hands-on experience with git bash. Must have Has worked with scrum methodology. Familiar with ceremonies and ways of working. Good to have. Able to communicate with the end clients via email with good email etiquette and via phone. Understanding business needs, identifying the right data sources, developing scalable and reliable data pipelines to ensure a smooth process Benefits: Competitive salary and benefits package Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications Opportunity to work with cutting-edge technologies Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards Annual health check-ups Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents Inclusive Environment: Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds. We offer hybrid work options and flexible working hours to accommodate various needs and preferences. Our office is equipped with accessible facilities, including adjustable workstations, ergonomic chairs, and assistive technologies to support employees with physical disabilities. If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment. We are committed to creating an inclusive environment where all employees can thrive. Our company fosters a values-driven and people-centric work environment that enables our employees to: Accelerate growth, both professionally and personally Impact the world in powerful, positive ways, using the latest technologies Enjoy collaborative innovation, with diversity and work-life wellbeing at the core Unlock global opportunities to work and learn with the industry’s best Let’s unleash your full potential at Persistent “Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

Location: pune, IN

Posted Date: 4/30/2025