Principal Software Engineer - AWS Big Data Analytics

Job Profile

Position Overview

At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to foster an inclusive workplace culture where all of our employees feel respected, valued and have an opportunity to contribute to the company’s success. As a Principal AWS Software Solutions Engineer within PNC's Enterprise Data Management Technology organization, you will be based within one of PNC’s Technology and Innovation hub office locations (Pittsburgh, PA, Cleveland, OH, Dallas, TX, Birmingham, AL or Phoenix, AZ,). Some travel required (up to 10%)
Technical Skills:
o Cloud Knowledge: A deep understanding of cloud computing concepts, especially related to Amazon Web Services (AWS).
o Infrastructure Design: Ability to design and implement cloud solutions, considering scalability, security, and performance.
o Experience: Practical firsthand experience with cloud platforms, preferably AWS.
o Best Practices: Familiarity with best practices for deploying and managing cloud resources.
o Cloud Governance: Knowledge of governance principles within the AWS environment.
o Amazon EMR: In-depth knowledge of EMR, including cluster setup, configuration, and management.
o EC2 Instances: Understanding of EC2 instance types and their suitability for EMR clusters.
o S3: Proficiency in using Amazon S3 for data storage and EMR input/output.
o IAM: Ability to manage permissions and access control using Identity and Access Management.
o Lambda: Knowledge of serverless computing for automating tasks.
o Data Pipelines: Experience with creating data pipelines using AWS services.
o Lake Formation: Experience with Glue Catalog or Lake Formations
o Data Storage Fundamentals: A solid understanding of various data storage options, including Amazon S3, Amazon RDS, Amazon Redshift, and DynamoDB.
o Database Design and Optimization: Proficiency in designing efficient database schemas, indexing strategies, and query optimization.
o Big Data Technologies: Familiarity with big data tools like Amazon EMR, Athena, Lake Formation, Data Sync, and Glue for processing large datasets.
o Cluster Sizing: Ability to determine the right cluster size based on workload requirements.
o Scaling: Know-how of scaling EMR clusters dynamically based on demand.
o Monitoring and Troubleshooting: Proficiency in monitoring cluster health, identifying bottlenecks, and resolving issues.
o Cost Optimization: Strategies to tag resources with an eye on optimizing costs and observability.
Security and Compliance:
o Encryption: Understanding of data encryption at rest and in transit.
o Security Groups and VPC: Knowledge of network security and virtual private clouds.
o Compliance Controls: Ensuring compliance with industry standards and regulations.
Scripting and Automation:
o Langauge Proficiency: Bash,Python, R, Spark, SQL in scripting languages for automating tasks.
o MLOPs: Ability to collaborate with the business to optimize Data Engineering process, and data lifeycle management
o CloudFormation/Terraform: Ability to create and manage infrastructure as code.
o Infrastructure as Code (IaC): Ability to assist DevOps engineers to develop proper Terraform templates used to provision AWS analytics infrastructure.
Backup and Disaster Recovery:
o Snapshotting: Familiarity with taking EMR cluster snapshots for backup and recovery.
o High Availability: Implementing strategies for fault tolerance and disaster recovery.
Soft Skills:
o Communication: Effective communication with stakeholders, developers, and data engineers.
o Problem-Solving: Analytical thinking to address complex issues.
o Adaptability: Keeping up with evolving technologies and best practices.
o Decisiveness: Make informed decisions, especially when dealing with complex architectural choices.
o Business Acumen: Understand business requirements and align technical solutions accordingly.
o Continuous Learning: A zeal for staying updated with evolving cloud technologies.
o
Experience and Certifications:
o Experience: Senior AWS Cloud Architects must have 3 to 5 years of firsthand experience in designing and building cloud applications.
o Certifications: An AWS Professional Solutions Architect certification is desired for senior roles

Job Description

• Aligns business strategy with software solutions.
• Proposes, designs & codes software solutions to address complex business needs. Oversees technical and procedural documentation required.
• Leads complex problem solving.
• Provides technical guidance and support to colleagues and solution development.
• Displays an innovative approach to apply modern principles, methodologies and tools to advance business initiatives and capabilities.

PNC Employees take pride in our reputation and to continue building upon that we expect our employees to be:

• Customer Focused - Knowledgeable of the values and practices that align customer needs and satisfaction as primary considerations in all business decisions and able to leverage that information in creating customized customer solutions.
• Managing Risk - Assessing and effectively managing all of the risks associated with their business objectives and activities to ensure they adhere to and support PNC's Enterprise Risk Management Framework.

Competencies

Application Design, Architecture – Knowledge of application design activities, tools and techniques; ability to utilize these to convert business requirements and logical models into a technical application design.

Packaged Application Integration – Knowledge of and the ability to implement packaged application software and integrate it with company applications, databases and technology platforms.

Product and Vendor Evaluation – Knowledge of and ability to implement processes for the evaluation and selection of products, tools, services and infrastructure components ensuring they are in line with an organization's business needs and architectural principles.

Software Process Improvement (SPI) – Knowledge of formal software process improvement disciplines, and ability to assess and improve the quality and operating costs associated with an existing application.

System Development Life Cycle – Knowledge of project management techniques and the ability to plan, design, develop, test, implement and maintain system development life cycle segments and phases.

Technical Troubleshooting – Knowledge of technical troubleshooting approaches, tools and techniques, and the ability to anticipate, recognize, and resolve technical (hardware, software, application or operational) problems.

Work Experience

Roles at this level typically require a university / college degree, with 5+ years of industry-relevant experience. Specific certifications are often required. In lieu of a degree, a comparable combination of education, job specific certification(s), and experience (including military service) may be considered.

Education

Bachelors

Additional Job Description

Benefits

Disability Accommodations Statement:

If an accommodation is required to participate in the application process, please contact us via email at [email protected]. Please include “accommodation request” in the subject line title and be sure to include your name, the job ID, and your preferred method of contact in the body of the email. Emails not related to accommodation requests will not receive responses. Applicants may also call 877-968-7762 and select Option 4: Recruiting for accommodation assistance. All information provided will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.

At PNC we foster an inclusive and accessible workplace. We provide reasonable accommodations to employment applicants and qualified individuals with a disability who need an accommodation to perform the essential functions of their positions.

Equal Employment Opportunity (EEO):

PNC provides equal employment opportunity to qualified persons regardless of race, color, sex, religion, national origin, age, sexual orientation, gender identity, disability, veteran status, or other categories protected by law.

California Residents

Refer to the California Consumer Privacy Act Privacy Notice to gain understanding of how PNC may use or disclose your personal information in our hiring practices.