Data Engineer

Job Description – Microsoft Data Engineer

Job Title: Microsoft Data Engineer

Location: Hydrabad

Employment Type: Full-Time

Role Overview

We are looking for a Microsoft Data Engineer with Minimum 7 Years exp, with strong hands-on experience in Microsoft Fabric, OneLake, PySpark, Python, and SQL. The ideal candidate will be responsible for building and optimizing modern data pipelines, data platforms, and analytics solutions using Microsoft’s data ecosystem.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and data engineering solutions using Microsoft Fabric.
• Work extensively with Microsoft OneLake for data storage, integration, and management.
• Develop data transformation and processing solutions using PySpark and Python.
• Write and optimize complex SQL/PSQL queries for data extraction, transformation, and analysis.
• Build and maintain ETL/ELT workflows within the Microsoft Fabric ecosystem.
• Work with Azure data services and integrate cloud-based data solutions.
• Collaborate with data analysts, architects, and engineering teams to deliver reliable data solutions.
• Implement data quality, performance optimization, and monitoring practices.
• Use GitHub for source control and collaborative development.
• Leverage GitHub Copilot and other AI-assisted development tools to improve engineering productivity.

Mandatory Skills

• Microsoft Fabric
• OneLake
• PySpark
• Python
• SQL / PSQL
• Strong understanding of Data Engineering concepts, ETL/ELT, data pipelines, and data transformation

Good-to-Have Skills

• Azure
• Azure Data Services
• Databricks
• ADS (Azure Data Studio)
• GitHub
• GitHub Copilot
• Experience working with modern cloud data platforms and lakehouse architecture.

Experience

• 5+ years of experience in Data Engineering or a related role.
• Strong hands-on experience with the Microsoft data ecosystem.
• Experience working with large-scale data processing and cloud-based data platforms.