Principal Data Engineer

This role is for one of Weekday's clients
Min Experience: 8 years
Location: Pune
JobType: full-time

Requirements

Title: Principal Data Engineer

Job Description:

Job Summary:

Lead the design, development, and optimization of enterprise-scale data pipelines and architectures to drive data-driven decision-making. Architect efficient data tables and schemas to enhance query performance, ensuring seamless integration with cross-functional teams

Key Responsibilities:

Data Pipeline

• Design and implement high-performance data pipelines using ETL processes, batch/streaming frameworks (e.g., Apache Spark, Airflow), and cloud platforms (AWS).
• Optimize data ingestion, transformation, and storage workflows to meet scalability, reliability, and latency requirements.

Data Architecture & Query Efficiency

• Architect database schemas and dimensional models (e.g., star/snowflake) to maximize query performance and reduce latency.
• Implement indexing strategies, partitioning, and materialized views to optimize data retrieval.

Collaboration & Governance

• Partner with data scientists, product managers, and engineers to align data infrastructure with business needs.
• Establish data governance frameworks, ensuring compliance with security, privacy, and quality standards.
• Mentor junior engineers and foster best practices in data engineering

Innovation & Leadership

• Stay ahead of industry trends (e.g., AI/ML integration, real-time analytics) and advocate for emerging technologies.
• Lead technical strategy for data infrastructure, balancing innovation with operational stability.

Technical Expertise:

• 8+ years of experience in data engineering, with a focus on ETL, data modelling, and cloud-based architectures.
• Proficiency in SQL, Python, and tools like Spark and Snowflake.
• Strong knowledge of database design, dimensional modeling, and query optimization.

Leadership & Collaboration 

• Proven ability to lead teams, mentor engineers, and drive technical initiatives.
• Experience translating business requirements into scalable technical solutions.

Preferred qualification – 

• Expertise in machine learning model deployment or real-time analytics.
• Familiarity with DevOps practices (CI/CD, Docker, Kubernetes).

Our Core Values

• Data Fanatics: Our edge is always found in the data
• Partner Obsessed: We are obsessed with partner success
• Team of Doers: We have a bias for action
• Game Changers: We encourage innovation