Start Your Search Here

Job Search

Tata Consultancy Services

Hyderabad G.P.O. / Global

Data Engineer

Job Description

An Azure Data Engineer designs, builds, and manages scalable data pipelines and cloud storage solutions on the Microsoft Azure platform.

Location- Chn/blr/hyd

Core Responsibilities

- Pipeline Development: Build and maintain ETL/ELT workflows using Azure Data Factory to move data from various sources into centralized storage.

- Data Processing: Transform, clean, and aggregate large datasets using Azure Databricks, Spark, and PySpark.

- Storage Management: Configure and optimize data lakes and warehouses via Azure Data Lake Storage Gen2 and Azure Synapse Analytics.

- Performance & Quality: Monitor pipeline performance, troubleshoot query execution, and ensure data integrity and security (RBAC, encryption).

Key Skills & Tech Stack

- Languages: Advanced SQL and Python/PySpark.

- Azure Services: ADF, ADLS Gen2, Databricks, Synapse Analytics, and Stream Analytics.

- Data Modeling: Dimensional modeling, star/snowflake schemas, and data warehousing concepts.

- DevOps: Git version control and CI/CD pipeline integration.

If you are tailoring a resume or drafting a specific job posting, tell me:

- The experience level required (Junior, Mid-level, Senior)

- Any specific industry tools to include (like Snowflake, Terraform, or Kafka)

Apply Now

Similar Opportunities

View all jobs