Senior Data Engineer with Python and Databricks

Endava โ€ข Other US Location

Company

Endava

Location

Other US Location

Type

Full Time

Job Description

Company Description

Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.
By combining world-class engineering, industry expertise and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses.
From prototype to real-world impact - be part of a global shift by doing work that matters.

Job Description

  • Work together with data scientists and analysts to understand the needs for data and create effective data pipelines
  • Solution design, implement, and maintain data pipelines for data ingestion, processing, and transformation using could services and other technologies
  • Create and maintain data solutions IN Azure, using any of the following: Data Factory, Synapse, Databricks/Spark, Polars/Pandas, Fabricย 
  • Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
  • Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
  • Monitoring and resolving data pipeline problems, ensuring consistency and availability of the data.


Qualifications

  • Proficient in Python and SQL
  • Knowledge of good data design principles (concepts such as Kimball and Star Schema), data warehousing concepts and data modelling.
  • Strong experience with Relational and ideally NoSQL databases.
  • Strong understanding of ETL/ELT processes.
  • Exposure to data monitoring and observability tools.
  • Relevant experience with Event-Driven Architecture
  • Good understanding of Agile ways of working

Additional Information

Discover some of the global benefits that empower our people to become the best version of themselves:

  • Finance: Competitive salary package, share plan, company performance bonuses, value-based recognition awards, referral bonus;
  • Career Development: Career coaching, global career opportunities, non-linear career paths, internal development programmes for management and technical leadership;
  • Learning Opportunities: Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences;
  • Work-Life Balance: Hybrid work and flexible working hours, employee assistance programme;
  • Health: Global internal wellbeing programme, access to wellbeing apps;
  • Community: Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations.

Our diversity makes us stronger - it drives meaningful change and enables us to build innovative technology solutions. We are committed to creating an inclusive community where all of us, regardless of background, identity, or personal characteristics, feels valued, respected, and free from discrimination. As an equal opportunity employer, we welcome applications from all individuals and base hiring decisions on merit, skills, qualifications, and potential.

Apply Now

Date Posted

01/21/2025

Views

0

Back to Job Listings โค๏ธAdd To Job List Company Info View Company Reviews
Positive
Subjectivity Score: 0.9

Similar Jobs

Senior Engineering Manager, Micros Foundations - Atlassian

Views in the last 30 days - 0

Atlassian is seeking a Senior Engineering Manager to lead a team of Backend Software Engineers The role involves guiding technical decisions prioritiz...

View Details

Senior Frontend Engineer - Simply Business

Views in the last 30 days - 0

Simply Business is seeking a Senior Frontend Engineer to join their Front End Tooling team The role involves developing products using best practices ...

View Details

Development Underwriter - Simply Business

Views in the last 30 days - 0

Simply Business is seeking a Development Underwriter with an Underwriting background to support their new MGA brand Nupro which aims to disrupt the sm...

View Details

E2E Solution Architect - Ahold Delhaize USA

Views in the last 30 days - 0

Ahold Delhaize USA is seeking a Solution Architect with extensive experience in IT architecture BigData Analytics and various software designs and dev...

View Details

E2E Solution Architect - Ahold Delhaize USA

Views in the last 30 days - 0

Ahold Delhaize USA is seeking a Solution Architect with extensive experience in IT architecture BigData Analytics and various software designs and dev...

View Details

E2E Solution Architect - Ahold Delhaize USA

Views in the last 30 days - 0

Ahold Delhaize USA a division of a global food retailer is seeking a Solution Architect for its US operations The role involves translating business r...

View Details