Junior Data Engineer

Job Title: Junior Data Engineer (ETL, Development & Data Operations)

Role Type: Junior / Developer / Analyst

Experience: 0 - 2 Years

Location: MRC Nagar, Chennai

Role Overview

The Junior Data Engineer will play a key role in building, maintaining, and optimizing end-to-end data pipelines across modern cloud-based data platforms. The role involves supporting data ingestion, transformation, validation, and operational monitoring to ensure reliable, high-quality, and timely data delivery for analytics, reporting, and business decision-making.

Key Responsibilities

Design, develop, and maintain ETL pipelines using Databricks and PySpark.
Extract, transform, and integrate data from multiple sources, including APIs, databases, and flat files.
Implement and optimize data transformations and load curated datasets into Delta Tables.
Schedule, orchestrate, and monitor workflows using Databricks Workflows.
Perform daily data validation checks to ensure accuracy, completeness, and consistency of data loads.
Maintain and update data catalog, lineage documentation, and metadata repositories.
Generate and circulate success/failure reports, job run summaries, and operational dashboards.
Build and maintain data quality dashboards and monitoring tools using Power BI or Superset.
Collaborate with Data Leads, BI teams, and cross-functional stakeholders for schema design, data integration, and analytics support.
Troubleshoot ETL issues, apply error-handling logic, and contribute to pipeline performance optimization.
-

Required Skills and Competencies

Technical Skills:

Programming: SQL, Python, PySpark
ETL Platforms & Tools: Databricks Notebooks, Databricks Workflows, Delta Lake
Cloud Storage: Azure Data Lake / AWS S3
Version Control: Git, GitHub
Data Quality & Reporting: Excel, Power BI, Superset
Knowledge Areas:

Strong understanding of ETL concepts, data integration, and data quality frameworks
Basic familiarity with data modeling and cloud-based architectures
Understanding of data governance, security, and metadata management principles
Soft Skills:

Analytical and problem-solving mindset
Strong attention to detail and process discipline
Effective communication and teamwork abilities
Eagerness to learn and adapt to new technologies

Education:

Bachelors degree in Computer Science, Information Technology, Data Science, or a related field.

Why Join Us:

Opportunity to work on cutting-edge data technologies and cloud platforms.
Collaborative environment with mentorship and learning opportunities.
Exposure to end-to-end data lifecycle management and real-world data engineering challenges.
Role: Data Engineer
Industry Type: Medical Services / Hospital
Department: Engineering - Software & QA
Employment Type: Full Time, Permanent
Role Category: Software Development

UG: B.C.A. in Any Specialization, B.Com in Computer Application, B.A - Bachelor of Arts in Computer Science, Computer Application, B.B.A. / B.M.S. in Computer Application
PG: MCA in Any Specialization, M.Tech in Computers, MS/M.Sc(Science) in Computers, PG Diploma in Computers