Job Description

Job Title- Pyspark (Data Engineer)

Location- Chennai / Kolkata / Hyderabad / Pune

Experience Required- 5-10 years.

Job Description:

We are looking for a skilled and experienced professional to join our team. The ideal candidate should have 5-10 year of relevant experience and to be comfortable working in dynamic, fast-paced environment.

Key Responsibilities:

Lead the team from offshore by owning project deliverables & provide technical oversight (For Tech Lead)
Experienced in architecting & Developing Big Data solutions (For Tech Lead)
Strong understanding of Big Data tools and Apache projects (For Tech Lead, Sr. Developer)
Good understanding on performance tuning on Big data technologies (For Tech Lead, Sr. Developer)
Good to have Python and Java background (For Tech Lead, Sr. Developer)
Experience in relational database and data warehousing concept
Well versed in Hive QL, Spark QL
Create ETL transformation using Hive, Spark
Support development team and testing team in implementing and testing the ETL respectively
Build data quality rule and orchestrate using in house framework
Work with Cloudera/Big Data support for root cause analysis and resolutions
Good team player and collaborate with other team

Apply Now

Similar Opportunities

Tata Consultancy Services

in / Global

Data Engineer

IQVIA

Bangalore / Global

Data Engineer

Insight Global

Bangalore / Global

Data Engineer

Norwin Technologies

Vasanthanagar / Global

Data Engineer

Toptal

Bengaluru / Global

Data Engineer

Remote

Persistent Systems

Bengaluru / Global

Data Engineer

Hybrid

View all jobs

Name	Expiration	Description
ATTBCookie* ATTBUserID ATTB_LinkedUserID	2 years 400 days 1 year	These cookies are used to remember a user’s choice about cookies on thebigjobsite.com. Where users have previously indicated a preference, that user’s preference will be stored in these cookies.
ATTBTracking*	Session	These cookies are used by ATTB to understand user interaction with the website.
last-search search redirect-stage original-keyword	1 day Session 1 hour 1 hour	These cookies are used by thebigjobsite.com to pass search data between our own pages.
datadome	1 year	DataDome is a cybersecurity solution to detect bot activity
jja*	1 days	Used to track if you have seen the Job Alerts prompt and hold settings for your profile. Job Alerts is a service you can subscribe to to receive information about new jobs.

Name	Expiration	Description
_ga _gid _gat_gtag_* _ga_JH3TWMTYRK __gads	Typically ranges from session-based (24 hours) to longer-lasting cookies (up to 2 years).	Google Analytics Cookies: Used for tracking and analytics, these cookies collect information about website usage to help understand user behavior. Visitor tracking, session management, and ad performance analysis.
_gcl_au NID DV UULE, EUULE	Typically lasts from a few days to months.	Google Ads / AdSense Cookies: Cookies used for advertisement personalization, conversion tracking, and remarketing by Google Ads. Track ad clicks and impressions, personalize ad content, and measure conversions.
_uetsid _uetvid	Typically lasts from a few days to months.	Microsoft Advertising (Bing Ads): Microsoft's tracking cookies for advertising and user analytics. Track user sessions and unique visitors for remarketing campaigns.
SID SSID SAPISID, APISID SIDCC SOCS AEC	Typically lasts from a few days to months.	Google Account/Authentication Cookies: These cookies are set by Google services (e.g., Gmail, YouTube) to manage user sessions, preferences, and account security. Authentication, session security, and maintaining user preferences.
__secure*	Typically lasts from a few days to months.	Secure Cookies (Potentially Third-Party): Cookies prefixed with __secure* are often used for enhanced security in user sessions or tracking. These are typically first- or third-party cookies, depending on their origin.
MSPTC MUID SRCHD SRCHHPGUSR SRCHUID SRCHUSR USRLOC WLS _EDGE_S _EDGE_V _SS _U ANON	Typically lasts from a few days to months.	These cookies form part of an analytics service that connects data from Bing with actions performed on the website. These cookies allow Bing to serve relevant advertisements to visitors across the Microsoft Bing network
_clck _clsk CLID ANONCHK MR MUID SM	Typically lasts from a few days to months.	Microsoft Clarity: is a cutting-edge behavioral analytics tool that helps us understand user interaction with your website. By using Clarity, we can enhance the user experience.

Start Your Search Here

Cookie Settings

Cookie Settings

Tata Consultancy Services

Data Engineer

Job Description

Success! You're now signed up for Job Alerts.

Similar Opportunities

Tata Consultancy Services

Data Engineer

IQVIA

Data Engineer

Insight Global

Data Engineer

Norwin Technologies

Data Engineer

Toptal

Data Engineer

Persistent Systems

Data Engineer