Data Engineer - Python/SQL

Role : GCP Data : 5 years Location : Remote Company : Deqode About Deqode : At Deqode, we work with next-gen technologies to help businesses solve complex data challenges. Our collaborative teams build reliable, scalable systems that power smarter decisions and real-time analytics. Key Responsibilities : - Build and maintain scalable, automated data pipelines using Python, PySpark, and SQL. - Work on cloud-native data infrastructure using Google Cloud Platform (BigQuery, Cloud Storage, Dataflow). - Implement clean, reusable transformations using DBT and Databricks. - Design and schedule workflows using Apache Airflow. - Collaborate with data scientists and analysts to ensure downstream data usability. - Optimize pipelines and systems for performance and cost-efficiency. - Follow best software engineering practices: version control, unit testing, code reviews, CI/CD. - Manage and troubleshoot data workflows in Linux environments. - Apply data governance and access control via Unity Catalog or similar tools. Required Skills & Experience : - Strong hands-on experience with PySpark, Spark SQL, and Databricks. - Solid understanding of GCP services (BigQuery, Cloud Functions, Dataflow, Cloud Storage). - Proficiency in Python for scripting and automation. - Expertise in SQL and data modeling. - Experience with DBT for data transformations. - Working knowledge of Airflow for workflow orchestration. - Comfortable with Linux-based systems for deployment and troubleshooting. - Familiar with Git for version control and collaborative development. - Understanding of data pipeline optimization, monitoring, and debugging. Preferred Qualifications : - Bachelors or Masters degree in Computer Science, Engineering, or related field. - Previous experience working in a collaborative team with analysts and data scientists. - Strong communication skills - both written and verbal. (ref:hirist.tech)

Location: in, IN

Posted Date: 5/12/2025