Data Engineer

ConsumerAffairs helps consumers make smart buying decisions in moments of need. Every month millions of consumers turn to our site and tools for help with their considered (often emotional) purchases.

We educate them about their options, learn about their specific needs, and connect hundreds of thousands of them directly to brands. These brands use our SaaS tools to manage their reviews and communicate directly with consumers to serve them better. Our business thrives when the consumers who trust us get matched with the right brands for them.

We're fast-paced and our core values are the bedrock of who we are and who we want to be.

Our employees believe in raising the bar through data-driven innovation, intellectual curiosity, and grit. We have a team-first mentality, and manifest wins by putting the team first. Collaboration and teamwork are in our hearts; we believe winning together is the most fun. But, above all else, we care. We have servant hearts for our consumers, customers, and colleagues. If you want to be part of a globally diverse team focussing on helping people, in an environment where we raise the bar, win as a team, and care above all else-then ConsumerAffairs may be just the place for you!

ABOUT THE JOB:

The Data Engineer is responsible for monitoring, expanding, and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems as well as building them from the ground up.

The Data Engineer supports our solution architects, data analysts, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.

Candidates should have education and/or experience in data modeling, requirements analysis, and best practices in analytics. Experience with BI applications is a definite plus.

RESPONSIBILITIES & EXPECTATIONS

These responsibilities are not to be construed as a complete statement of all duties performed. Employees will be required to perform other job-related duties as required

• Create and maintain optimal data pipeline architecture
• Collect and refine business requirements to create technical specifications
• Collaborate with other D&A teams to integrate disparate data sources and systems
• Collaborate with other CA teams to identify and refine requirements
• Develop and implement comprehensive data ingestion processes
• Develop and implement comprehensive data integration processes
• Develop and implement data models to support operations and analytics
• Keep data separated and secure at rest and in transit
• Maintain and support cloud data architecture
• Maintain job processes managed in Airflow and DBT
• Maintain data integration processes via Airbyte, Stitch, Fivetran, and Talend
• Create, maintain, and update technical documentation
• Help troubleshoot, document, and maintain system processes
• Assemble large, complex data sets that meet business requirements
• Constantly look for ways to improve monitoring, uncover issues, and deliver value
• Meet professional obligations through efficient work habits such as meeting deadlines, honoring agreed schedules, coordinating resources in an effective and timely manner, and demonstrating respect for others

Requirements

Qualifications & Credentials

Education/Licensure/Certification:

• BSc/BA in Computer Science, Engineering or relevant fie.

Experience:

• 5 years' experience in Data Integration and Integration
• 5 years' experience in Data Warehousing, notably Cloud Data
• Experience in SQL across relational and dimensional databases
• Experience in AWS and Snowflake implementation and administration
• Industry experience is beneficial

Knowledge, skills and abilities:

• Fluent in English
• Must be highly curious, driven, and disciplined
• Understanding of data models, data warehouses, and data mining
• Familiarity with BI technologies
• Knowledge of SQL is required
• Familiarity with cloud analytics is beneficial (AWS, Snowflake)
• Proven abilities to take initiative and be innovative
• Analytical mind with a problem-solving aptitude
• Stands up for decisions and takes responsibility for results
• Shares both good and bad outcomes transparently
• Obsessed with ensuring an exceptional customer experience- for both internal and external customers.
• Stands up for decisions, takes responsibility for results, and shares both good and bad outcomes transparently.
• Demonstrates a relentless focus on results with a commitment to deliver;
• Takes decisive action, and confidently changes course if unsuccessful.
• Displays a growth mindset to continually improve; encourages everyone around them to be tenacious and never settle.
• Constantly seeks feedback to improve; Focuses on solving issues through teamwork, and collaboration
• Acts with urgency; delivers top results in hours and days instead of weeks and months.
• Relentless in their pursuit of success and possessing the willpower to embrace challenges as opportunities

Specific Measures of Success - Expected Outcomes

Start Date to Start Date +1 Year

• Familiarity and proficiency with our Airflow and Snowflake installations and our Python codebase
• Full participation in our on-duty rotation that handles recurring tasks and customer requests during business hours
• Full understanding of our data ingestion process for hundreds of partners with the ability to onboard new partners, debug and fix failures, and suggest improvements to the system based on the experience of running and maintaining it
• Recommend/deploy improvements to overall team processes and educational opportunities

Core Values

Raise The Bar

• We raise the bar through innovation, intellectual curiosity, and grit. We are not satisfied with yesterday and our hearts thirst to be better tomorrow.

Win As A Team

• We manifest wins by putting the team first. We have collaboration and teamwork in our hearts and believe winning together is the most fun.

Care Above All Else

• We care above all else. We have servant hearts for our consumers, customers, and colleagues.

Physical Requirements & Environmental Conditions

• Location: Remote/ Tulsa
• Frequency of travel: Occasional travel may be required for meetings, training and/or conferences.
• Light physical activities and efforts required in working within an office environment.

(Reasonable accommodations will be made in accordance with existing ADA requirements for otherwise qualified individuals with disabilities.)

ConsumerAffairs provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

• This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.

Benefits

• Health Care Plan (Medical, Dental & Vision)
• Retirement Plan (401k, IRA)
• Life Insurance (Basic, Voluntary & AD&D)
• Paid Time Off (Vacation, Sick & Public Holidays)
• Family Leave (Maternity, Paternity)
• Short Term & Long Term Disability
• Training & Development
• Work From Home
• Free Food & Snacks
• Stock Option Plan