Data Engineer

Greetings from TCS!!!

We are looking for one of our requirements of AWS Data Engineer.

Desired Experience Range** 4-7years

Location - Pune / Chennai

Mode of Interview: Virtual

Job Summary

We are looking for a highly skilled AWS Data Engineer with strong hands-on experience in Python development and cloud-based data engineering. The candidate should have expertise in building scalable data pipelines, developing ETL solutions, and working with AWS data services. The role requires strong coding skills, problem-solving ability, and experience working in Agile environments.

Mandatory Skills (Weightage)

Must Have Technical Skills

• 4-7 years of experience in Data Engineering.
• Strong hands-on experience in Python programming with OOP concepts.
• Experience in developing reusable Python modules, APIs, and data processing frameworks.
• Expertise in PySpark for large-scale data transformation.
• Hands-on experience with AWS services:
• AWS Glue
• S3
• EMR
• Lambda
• Redshift
• IAM
• Step Functions
• CloudWatch
• Strong SQL skills including Joins, CTEs, Window Functions, and Query Optimization.
• Experience in Data Lake and Data Warehouse architectures.
• Good understanding of ETL/ELT processes and data pipeline development.
• Experience with Git, CI/CD pipelines, and Agile delivery models.

Good to Have

• Apache Airflow
• DBT
• Snowflake
• Databricks
• Terraform
• AWS Certifications

Roles & Responsibilities

• Develop and maintain scalable data pipelines using Python, PySpark, and AWS services.
• Design, build, and optimize ETL/ELT workflows.
• Create reusable Python frameworks and utilities for data ingestion and transformation.
• Work with large datasets and optimize data processing performance.
• Collaborate with architects, business analysts, and stakeholders to understand requirements.
• Perform code reviews and ensure best coding practices.
• Support production deployments and troubleshoot data pipeline issues.
• Implement monitoring, logging, and data quality controls.

Education

• Bachelor's Degree in Computer Science, Information Technology, Engineering, or related field.