Senior Python ETL Engineer
Company
EPAM Systems
Location
Rockaway, NJ
Type
Full Time
Job Description
EPAM is on the lookout for a talented Python ETL Engineer to join the team. In this role, you'll be the wizard behind the curtain, designing and implementing ETL processes that weave data magic. Extracting, transforming and loading data from various sources into our data warehouse will be your domain. Your expertise will be pivotal in understanding business requirements, crafting data models, and ensuring the accuracy and quality of our data.
Got a passion for Python? Love the thrill of creating ETL pipelines that run like clockwork? Perfect! Your solid Python development background, advanced programming knowledge and expertise with Airflow or Luigi will drive our data-driven success. And let's not forget your experience in data modeling, database design, and SQL - a true game-changer.
Want more jobs like this?
Get jobs in Rockaway, NJ delivered to your inbox every week.
So, if you're passionate about ETL development and crave the excitement of cutting-edge technologies, we can't wait to welcome you aboard!
Experience the freedom of remote work from anywhere in Kyrgyzstan, whether it's the comfort of your home or our modern office in Bishkek.
#LI-DNI#Senior-Python-ETL-Engineer-8#python-vacancies-July-KG#Not found
Responsibilities
- Design and implement ETL processes
- Understand business requirements and translate them into technical specifications
- Develop custom ETL scripts using Python
- Maintain ETL pipelines using frameworks such as Airflow or Luigi
- Ensure data accuracy and quality by implementing ETL best practices such as data cleansing, data validation, and error handling
- Work with data warehouses such as Redshift, Snowflake, or BigQuery to store and manage large data sets
- Run SQL and relational databases such as PostgreSQL, SQL Server, and Oracle to design and optimize database schemas and queries
- Operate cloud technologies such as AWS, Azure, or Google Cloud Platform, including cloud-based ETL services such as AWS Glue or Azure Data Factory
- Collaborate with cross-functional teams to ensure the successful delivery of projects
- Stay up-to-date with industry trends and best practices in ETL development
- Bachelor's degree in Computer Science, Information Technology or a related field
- 3+ years of experience in Python development
- Advanced Python programming language knowledge with an understanding of internal mechanics (interpreter, memory management, concurrency, etc.)
- Ability to develop scalable, maintainable and reliable ETL code
- Proficiency with ETL frameworks such as Airflow or Luigi
- Familiarity with data extraction from diverse sources such as databases, APIs, and flat files and transforming them to meet business requirements
- Strong understanding of data modeling and database design, including experience with dimensional modeling and star schemas
- Knowledge of SQL and relational databases such as PostgreSQL, SQL Server, and Oracle, including experience with database optimization techniques
- Showcase of working with cloud technologies such as AWS, Azure or Google Cloud Platform English - B1+, both verbal and written
- Competency in maintaining CI/CD pipelines for ETL applications
- Expertise in web applications for data ingestion using Flask or FastAPI
- Knowledge of Agile development methodologies (SCRUM/Kanban)
- Availability of Cloud certification (AWS, GCP, Azure)
- Familiarity with Docker and Docker Compose
- Flexibility to use big data technologies such as Hadoop, Spark
- We connect like-minded people::
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
- We invest in your growth::
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to LinkedIn Learning, Get Abstract, O'Reilly, Cloud Guru
- Free English classes with certified teachers
- We cover it all::
- Monetary bonuses for engaging in the referral program
- Comprehensive medical & family care package
- Six trust days per year (sick leave without a medical certificate)
- Coverage of psychology sessions of your choice
- Discounts for fitness clubs and sports programs
- Benefits package (sports activities, a variety of stores and services)
Date Posted
10/30/2024
Views
0
Similar Jobs
Rare Disease Account Manager, Immunology Autoantibody Diseases -North Jersey - Johnson & Johnson
Views in the last 30 days - 0
Johnson Johnson Innovative Medicine is recruiting for a Rare Disease Account Manager RAM for Immunology Autoantibody Diseases in Northern NJ The role...
View DetailsSenior National Account Manager - Drug Wholesale - Sanofi U.S.
Views in the last 30 days - 0
Opella a leading global player in the OTC VMS market is seeking a Senior National Account Manager Drug Wholesale The role involves leading a sales t...
View DetailsConsulting, Manager - Deloitte
Views in the last 30 days - 0
Deloitte Consulting LLP is seeking a Consulting Manager in Jersey City New Jersey with potential for national travel The role involves managing IT pro...
View DetailsOEM Application Engineer - Eaton
Views in the last 30 days - 0
Eatons ES AMER NAS division is recruiting for a hybridbased OEM Application Engineer position The role involves specifying testing and implementing so...
View DetailsCAR-T SR Warehouse Operator - Johnson & Johnson
Views in the last 30 days - 0
Johnson Johnson is seeking a CART Sr Warehouse Operator in New Jersey The role involves managing inventory processing incoming stock and ensuring hig...
View DetailsMobile Engineer: Toms River, NJ - CBRE
Views in the last 30 days - 0
Global Workplace Solutions GWS is seeking a skilled Facility Technician with at least 4 years of experience The role involves performing complex preve...
View Details