Senior Data Engineer

Job Description – Senior Data EngineerRole Summary
We are seeking an experienced Senior Data Engineer with strong expertise in Databricks and AWS to design and build enterprise-grade Data Lake and Lakehouse platforms. The role involves developing scalable data pipelines, implementing Medallion architecture (Bronze, Silver, Gold layers), and enabling analytics-ready datasets for enterprise reporting and advanced analytics.

The ideal candidate should have hands-on experience building Enterprise Data Lakes, Lakehouse architectures, and data engineering frameworks within financial services environments.

Key Responsibilities
Design and develop enterprise Data Lake and Lakehouse solutions on AWS and Databricks
Build scalable ETL/ELT pipelines using Python, PySpark, SQL, and Databricks Notebooks
Implement Medallion architecture (Bronze, Silver, Gold layers) using Delta Lake
Develop curated datasets, data marts, and semantic-ready datasets for analytics and reporting
Optimize Spark workloads and distributed data pipelines
Enable data access using Trino or distributed SQL engines
Implement data quality, monitoring, and governance frameworks
Collaborate with Data Architects, Data Modelers, and analytics teams to deliver enterprise data platforms
Technical Skills – Must Have
Strong SQL, Python, and PySpark programming expertise
Hands-on experience with Databricks Lakehouse Platform and Delta Lake
Experience implementing Medallion Architecture (Bronze, Silver, Gold layers)
Strong experience building Enterprise Data Lakes on AWS (Amazon S3)
Experience with Databricks Notebooks, Workflows, and Jobs
Strong understanding of ETL/ELT pipeline development and distributed data processing
Experience working with large-scale analytical datasets
Technical Skills – Nice to Have
Experience with Trino or distributed SQL query engines
Exposure to semantic data layers for BI platforms (Power BI / Tableau)
Experience with data governance and metadata frameworks
Experience working in large enterprise data modernization programs
Experience & Domain
8–10 years of experience in Data Engineering and Analytics platforms
Experience working in Financial Services or Capital Markets domain
Exposure to financial transactions, regulatory reporting, or market data platforms
Certifications (Preferred)
Databricks Certified Data Engineer
AWS Certified Data Analytics or AWS Solution Architect
Education
Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Technology, or related field.

Role: Data Engineer
Industry Type: IT Services & Consulting
Department: Data Science & Analytics
Employment Type: Full Time, Permanent
Role Category: Data Science & Machine Learning

UG: Any Graduate
PG: Any Postgraduate