We use cookies to provide the essential functionality of the website and its advanced features, to analyse traffic and to improve our services to you, and to provide personalised content to you.
By clicking ‘Accept All’ you agree to these. You can change your selection at any time under the ‘Cookie Settings’ link on the page.
You can read more about our cookies in our Cookie Policy
Cookie Settings
We use cookies to provide the essential functionality of the website and its advanced features, to analyse traffic and to improve our services to you, and to provide personalised content to you.
By clicking ‘Accept’ you agree to these. You can read more about our cookies in our Cookie Policy
Essential
These cookies are essential to the functionality of thebigjobsite.com
When you log in to the Internet Site the Company will set a cookie containing a randomly generated unique reference number. This anonymous number allows the Company to identify you. The Company will never store your personal information directly as a cookie. A persistent cookie will be set, persistent cookies are not deleted when you close your browser, and will allow the Internet Site to recognise you on your next visit.
Name
Expiration
Description
ATTBCookie*
ATTBUserID
ATTB_LinkedUserID
2 years
400 days
1 year
These cookies are used to remember a user’s choice about cookies on thebigjobsite.com. Where users have previously indicated a preference, that user’s preference will be stored in these cookies.
ATTBTracking*
Session
These cookies are used by ATTB to understand user interaction with the website.
last-search
search
redirect-stage
original-keyword
1 day
Session
1 hour
1 hour
These cookies are used by thebigjobsite.com to pass search data between our own pages.
datadome
1 year
DataDome is a cybersecurity solution to detect bot activity
jja*
1 days
Used to track if you have seen the Job Alerts prompt and hold settings for your profile. Job Alerts is a service you can subscribe to to receive information about new jobs.
Advanced Features
Advanced features of the site use Cookies to provide information you requested and to reduce you having to key in repeated fields.
Name
Expiration
Description
attb-loc
3 months
Stores your location information so that we can pre-populate search fields to find jobs near you.
attb-latest-visit
attb-prev-visit
1 year
1 year
These cookies are used by ATTB to record when a user last visited the website so that we can highlight new content.
Analytics
Analytic cookies allow the Company to see how the Internet Site is being used. This information forms the basis of future development work, and so enables the Company to continually improve its Internet Site to best suit its users.
Name
Expiration
Description
_ga
_gid
_gat_gtag_*
_ga_JH3TWMTYRK
__gads
Typically ranges from session-based (24 hours) to longer-lasting cookies (up to 2 years).
Google Analytics Cookies: Used for tracking and analytics, these cookies collect information about website usage to help understand user behavior. Visitor tracking, session management, and ad performance analysis.
_gcl_au
NID
DV
UULE, EUULE
Typically lasts from a few days to months.
Google Ads / AdSense Cookies: Cookies used for advertisement personalization, conversion tracking, and remarketing by Google Ads. Track ad clicks and impressions, personalize ad content, and measure conversions.
_uetsid
_uetvid
Typically lasts from a few days to months.
Microsoft Advertising (Bing Ads): Microsoft's tracking cookies for advertising and user analytics. Track user sessions and unique visitors for remarketing campaigns.
SID
SSID
SAPISID, APISID
SIDCC
SOCS
AEC
Typically lasts from a few days to months.
Google Account/Authentication Cookies: These cookies are set by Google services (e.g., Gmail, YouTube) to manage user sessions, preferences, and account security. Authentication, session security, and maintaining user preferences.
__secure*
Typically lasts from a few days to months.
Secure Cookies (Potentially Third-Party): Cookies prefixed with __secure* are often used for enhanced security in user sessions or tracking. These are typically first- or third-party cookies, depending on their origin.
MSPTC
MUID
SRCHD
SRCHHPGUSR
SRCHUID
SRCHUSR
USRLOC
WLS
_EDGE_S
_EDGE_V
_SS
_U
ANON
Typically lasts from a few days to months.
These cookies form part of an analytics service that connects data from Bing with actions performed on the website. These cookies allow Bing to serve relevant advertisements to visitors across the Microsoft Bing network
_clck
_clsk
CLID
ANONCHK
MR
MUID
SM
Typically lasts from a few days to months.
Microsoft Clarity: is a cutting-edge behavioral analytics tool that helps us understand user interaction with your website. By using Clarity, we can enhance the user experience.
About the Company
At NationsBenefits, we are leading the transformation of the insurance industry by developing innovative benefits management solutions. We focus on modernizing complex back-office systems to create scalable, secure, and high-performing platforms that streamline operations for our clients. As part of our strategic growth, we are focused on platform modernization — transitioning legacy systems to modern, cloud-native architectures that support the scalability, reliability, and high performance of core backoffice functions in the insurance domain.
About the Role
We are seeking a self-driven Lead Data Engineer with 10+ years of experience to build and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. The role involves working across scrum teams to develop data solutions, ensure data governance with Unity Catalog, and support real-time and batch processing. Strong problem-solving skills, T-SQL expertise, and hands-on experience with Azure cloud tools are essential. Healthcare domain knowledge is a plus.
Job Description:
Work with different scrum teams to develop all the quality database programming requirements of the sprint.
Experience in Azure cloud platforms like Advanced Python Programming, Databricks, Azure SQL , Data factory (ADF), Data Lake, Data storage, SSIS.
Create and deploy scalable ETL/ELT pipelines with Azure Databricks by utilizing PySpark and SQL.
Create Delta Lake tables with ACID transactions and schema evolution to support Realtime and batch processing.
Experience in Unity Catalog for centralized data governance, access control, and data lineage tracking.
Independently analyse, solve, and correct issues in real time, providing problem resolution end-to-end.
Develop unit tests to be able to test them automatically.
Use SOLID development principles to maintain data integrity and cohesiveness.
Interact with product owner and business representatives to determine and satisfy needs.
Sense of ownership and pride in your performance and its impact on company’s success.
Critical thinker and problem-solving skills.
Team player.
Good time-management skills.
Great interpersonal and communication skills.
Mandatory Qualifications:
10+ years of experience as a Lead Data Engineer.
Self-driven with minimal supervision.
Proven experience with T-SQL programming, Azure Databricks, Spark (PySpark/Scala), Delta Lake, Unity Catalog, ADLS Gen2
Microsoft TFS, Visual Studio, Devops exposure.
Experience with cloud platforms such as Azure or any.
Analytical, problem-solving mindset.
GET