Sr Analyst, Data Engineering- Databricks
Company
Cardinal Health
Location
Other US Location
Type
Full Time
Job Description
Sr Analyst, Data Engineering - Databricks
Headquartered in Dublin, Ohio, Cardinal Health, Inc. (NYSE: CAH) is a global, integrated healthcare services and products company connecting patients, providers, payers, pharmacists and manufacturers for integrated care coordination and better patient management. Backed by nearly 100 years of experience, with more than 50,000 employees in nearly 60 countries, Cardinal Health ranks among the top 20 on the Fortune 500.
Job Overview:
The Sr Analyst, Data Engineering - Databricks will be responsible for building and optimizing the data pipelines. You will work closely with Business users, data analysts, data scientists and other engineers to support their data needs and maximize the value of our data processing capabilities.
Responsibilities:
- Develop, and maintain scalable and robust data pipelines on Databricks.
- Collaborate with analysts and business to understand data requirements and deliver solutions.
- Optimize and troubleshoot existing data pipelines for performance and reliability.
- Ensure data quality and integrity across various data sources.
- Implement data security and compliance best practices.
- Monitor data pipeline performance and conduct necessary maintenance and updates.
- Document data pipeline processes and technical specifications. Optimizing data pipelines for performance and cost for data pipelines.
Desired Qualifications:
- Bachelor's degree in engineering or equivalent work experience
- 3+ years of engineering experience in Big Data systems, Data Analytics and Data Integration related fields
- 1+ years of hands-on experience working with Databricks.
- Experience in working in databricks notebooks.
- Wellversed in Databricks SQL including performance turning, Data aggregations and Statistical functions.
- Experience with Databricks Workflow – Scheduling, Error debug, Repairing failed runs.
- Experience with CI/CD pipelines on Databricks with usage of different tools.
- Experience of exploring and transforming large datasets using information schema and Databricks Catalog.
- Ability to read and understand complex Microsoft SQL server Stored procedures.
- Experience in working with Cloud Data Engineering Platforms (E.g. Google, AWS or Azure) and Cloud Analytics solutions are preferred.
- Agile development skills and experience.
- Databricks certifications is a plus
Candidates who are back-to-work, people with disabilities, without a college degree, and Veterans are encouraged to apply.
Cardinal Health supports an inclusive workplace that values diversity of thought, experience and background. We celebrate the power of our differences to create better solutions for our customers by ensuring employees can be their authentic selves each day. Cardinal Health is an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, ancestry, age, physical or mental disability, sex, sexual orientation, gender identity/expression, pregnancy, veteran status, marital status, creed, status with regard to public assistance, genetic status or any other status protected by federal, state or local law.
To read and review this privacy notice click here
Date Posted
12/31/2024
Views
0
Similar Jobs
Senior Engineering Manager, Micros Foundations - Atlassian
Views in the last 30 days - 0
Atlassian is seeking a Senior Engineering Manager to lead a team of Backend Software Engineers The role involves guiding technical decisions prioritiz...
View DetailsSenior Frontend Engineer - Simply Business
Views in the last 30 days - 0
Simply Business is seeking a Senior Frontend Engineer to join their Front End Tooling team The role involves developing products using best practices ...
View DetailsDevelopment Underwriter - Simply Business
Views in the last 30 days - 0
Simply Business is seeking a Development Underwriter with an Underwriting background to support their new MGA brand Nupro which aims to disrupt the sm...
View DetailsE2E Solution Architect - Ahold Delhaize USA
Views in the last 30 days - 0
Ahold Delhaize USA is seeking a Solution Architect with extensive experience in IT architecture BigData Analytics and various software designs and dev...
View DetailsE2E Solution Architect - Ahold Delhaize USA
Views in the last 30 days - 0
Ahold Delhaize USA is seeking a Solution Architect with extensive experience in IT architecture BigData Analytics and various software designs and dev...
View DetailsE2E Solution Architect - Ahold Delhaize USA
Views in the last 30 days - 0
Ahold Delhaize USA a division of a global food retailer is seeking a Solution Architect for its US operations The role involves translating business r...
View Details