Sr Data Engineer

About Position: As a Sr. Data Engineer, you will design and develop analytics workloads using Apache Spark and Scala for big data processing. You will create and optimize data transformation pipelines, migrate existing workloads to open-source Spark infrastructure on Kubernetes, and implement performance optimization techniques. Leverage your expertise in distributed computing and data modeling to drive impactful data solutions. Role: Sr Data Engineer Location: All PLS Location Experience: 10 to 15 years Job Type: Full Time Employment What You'll Do: Design and Develop: Analytics workloads using Apache Spark and Scala for big data processing. Create and Optimize: Data transformation pipelines using Spark or Apache Flink. Migrate Workloads: From cloud platforms to open-source Apache Spark infrastructure on Kubernetes. Implement Optimization: Performance techniques for large-scale data processing Expertise You'll Bring: Scala Programming: Focus on functional programming paradigm. Apache Spark: Extensive experience with core concepts and APIs, including: Spark SQL and DataFrame APIs Spark Structured Streaming Spark MLlib for analytics Distributed Computing: Strong understanding of big data processing frameworks. Data Modeling: Expertise in optimization techniques for large-scale datasets. Performance Tuning: Proficiency in optimizing Spark jobs. Lakehouse Storage: Good understanding of technologies like Delta Lake and Apache Iceberg Benefits: Competitive salary and benefits package Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications Opportunity to work with cutting-edge technologies Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards Annual health check-ups Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents Inclusive Environment: Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds. We offer hybrid work options and flexible working hours to accommodate various needs and preferences. Our office is equipped with accessible facilities, including adjustable workstations, ergonomic chairs, and assistive technologies to support employees with physical disabilities. If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment. We are committed to creating an inclusive environment where all employees can thrive. Our company fosters a values-driven and people-centric work environment that enables our employees to: Accelerate growth, both professionally and personally Impact the world in powerful, positive ways, using the latest technologies Enjoy collaborative innovation, with diversity and work-life wellbeing at the core Unlock global opportunities to work and learn with the industry’s best Let’s unleash your full potential at Persistent “Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

Location: pune, IN

Posted Date: 4/30/2025