Data Engineer

Position Summary:

The Data Engineer supporting Services Bureau & Product Platforms will have a track record of designing and developing reliable data ingestion pipelines from multiple process and operational data stores using cloud-based technologies.  These pipelines will require data validation and data profiling automation using version control to ensure ongoing resiliency and maintainability of the inbound data flows supporting business intelligence, advanced analytics and consulting projects.

Essential functions of the job include but are not limited to: 

• Manage monthly data warehouse activities including onboarding of new vendors who will be accessing proprietary medical/pharmacy claims via snowflake/AWS infrastructure.
• Collaborate with Sr. Director of Product & Services to design and develop data pipelines/processes within our AWS environment inclusive of unit tests, integration tests and utilization functions
• Collaborate with internal stakeholders to identify data ingestion requirements for structured, unstructured, and semi-structured data, pilot their implementation, and ensure user acceptance
• Collaborate with V.P Of Operations and IT to define and implement automated profiling capabilities needed to ensure reliable data transfer, using agile software development and CI/CD practices
• Collaborate with Services Bureau team to develop and implement data governance processes to support a robust and well documented data lake environment in-order to support patient journey analytics associated with medical/pharmacy claims data.
• Support ad-hoc, project-based data extraction and processing of structured and unstructured data

 Qualifications:

Minimum Required:

• Bachelor’s degree required in Computer Science, Engineering, Math, Software Engineering or related discipline
• 3+ years of production experience using SQL
• 3+ years of experience developing batch ingestion pipelines
• 3+ years of AWS platform services, including AWS S3 & EC2, Snowflake, Data Migration Services (DMS), RedShift

 Other Required:

• Proven success in communicating with business users and other technical teams to collect requirements, describe data modeling decisions and data engineering strategy
• Excellent organizational skills including prioritization of multiple concurrent projects while still delivering timely and accurate results
• Experience with agile software development & continuous integration + continuous deployment methodologies along with supporting tools such as Git (Github/Gitlab), Jira, etc.

Preferred:

• Established enterprise ETL and integration tools
• Experience with health care data (administrative claims, EMR, etc.)
• Experience supporting Data and Analytics or SaaS-based enterprise products
• Experience in Oncology medical/pharmacy claims data in-order to support patient journey analytics is preferred.
• 3+ years of demonstrated production programming proficiency in at least 1 modern JVM language, with a preference for Python Related (Jython/ZipPy) or R Related (Renjin/FastR)
• Strong, hands-on technical familiarity with AWS platform technology and tools