# Job Description – Data Engineer

**Job ID:** 407987\

**Role:** Data Engineer\

**Location:** PAN India\

**Experience:** 8+ Years overall, with a minimum of 5 years in Data Engineering\

**Shift:** General Shift\

**Band:** BPO5\

**Salary:** Up to ₹16–17 LPA\

**Education:** Graduation is compulsory

## Job Summary

We are looking for an experienced Data Engineer to design, develop, deploy, and maintain scalable data pipelines for integrating data from multiple heterogeneous sources. The ideal candidate should have strong expertise in Python/R, SQL, cloud technologies, ETL/ELT processes, Apache Spark, Databricks, and data warehouse/data lake solutions.

The role involves collaborating with cross-functional teams, managing structured and unstructured data, ensuring data quality and integrity, and delivering reliable data integration solutions, particularly in a clinical data environment.

## Key Responsibilities

- Design, develop, and maintain scalable, reusable data pipelines for integrating data from multiple sources.

- Build and optimize ETL/ELT workflows using Python/R, SQL, and cloud technologies.

- Implement data ingestion, extraction, transformation, and loading processes across data lakes and data warehouses.

- Work with AWS, Azure, or GCP, along with Databricks and Apache Spark, to process large datasets efficiently.

- Develop and maintain data integration solutions for structured, semi-structured, and unstructured data.

- Implement data quality checks, validation rules, and integrity controls to ensure accurate data delivery.

- Troubleshoot pipeline failures, investigate data issues, and improve pipeline performance and reliability.

- Collaborate with clinical data programmers, statistical programmers, analytics teams, data management teams, and external vendors.

- Develop and maintain technical specifications, data transfer agreements, reusable libraries, templates, and integration standards.

- Work with APIs, JSON, XML, and other data exchange formats to facilitate seamless data integration.

- Support data visualization, ad-hoc analysis, KPI tracking, and continuous process improvement.

- Participate in technical design discussions, project planning, testing, validation, documentation, and deployment activities.

- Provide technical guidance, end-user support, and training to internal and external stakeholders.

- Ensure compliance with applicable SOPs, Good Clinical Practice (GCP), and relevant GxP requirements.

## Mandatory Technical Skills

- Strong experience in Data Engineering and data pipeline development.

- Proficiency in Python or R and SQL.

- Experience with NoSQL databases and database concepts.

- Hands-on experience with AWS, Azure, or GCP.

- Experience with Apache Spark and Databricks.

- Strong understanding of ETL/ELT processes and data integration.

- Experience with data lakes and data warehouses, such as Snowflake or Amazon Redshift.

- Experience with GitLab/GitHub and CI/CD tools such as Jenkins or GitLab CI/CD.

- Experience deploying and maintaining cloud-based data pipelines.

- Knowledge of structured and unstructured data processing.

- Understanding of APIs, JSON, XML, and data exchange formats.

- Experience building scalable, reusable, and efficient data processing solutions.

## Preferred Skills

- Experience developing Python applications or R Shiny applications.

- Knowledge of Hadoop and big data technologies.

- Experience with Agile development methodologies.

- Experience in clinical data integration or healthcare-related data environments.

- Knowledge of data visualization and large-dataset analysis.

- Python or R certifications are an added advantage.

## Required Qualifications

- Bachelor's degree in Computer Science, Statistics, Biostatistics, Mathematics, Biology, Healthcare, or a related field.

- 8+ years of overall professional experience, including at least 5 years in Data Engineering.

- Strong analytical, problem-solving, project management, and communication skills.

- Ability to work independently, manage competing priorities, and collaborate effectively with cross-functional teams.

## Candidate Eligibility Criteria

- Graduation is mandatory.

- PAN and Date of Birth (DOB) are required for employee profile creation in the database.

- Former or current TCS/Tata employees are not eligible for this position.

## Key Competencies

- Strong attention to detail and organizational skills.

- Excellent communication and stakeholder management.

- Ability to troubleshoot technical issues and resolve problems independently.

- Adaptability to changing requirements and new technologies.

- Strong teamwork, ownership, and continuous improvement mindset.

- Ability to deliver quality results within defined timelines.

Recruiter screening keywords: Data Engineer, Python, R, SQL, AWS, Azure, GCP, Databricks, Apache Spark, ETL, ELT, Snowflake, Redshift, Data Lake, Data Warehouse, GitHub, GitLab, Jenkins, CI/CD, APIs, JSON, XML, Clinical Data Integration.

Important screening points: Prioritize candidates with 8+ years of overall experience, at least 5 years in Data Engineering, hands-on cloud pipeline deployment, and strong Python/R and SQL skills. Verify graduation and the stated TCS/Tata employment restriction before submission.