Software Engineer, Client Team, AI Frameworks

About the role:

The Client’s team is focused on building client software that drives Modular product adoption. We are responsible for developing and maintaining modular client software, auth, telemetry API’s and SDK components. We work with frameworks frontend, compiler, performance and kernel teams to fully instrument, generate and collect events, metrics, logs and traces to track our production systems and customer usage data. We are looking for candidates based on their breadth and depth of experience in building software infrastructure, systems engineering, and machine learning.

We are a growing team that collaborates across disciplines on a day to day basis. A strong cross-collaborator is a must. If solving customer problems excites you, come and be part of our team and architect our client side infrastructure at Modular. Join our world-leading AI infrastructure team and help drive our AI infrastructure stack forward.

LOCATION: Candidates based in the US or Canada are welcome to apply. You can work remotely from home.

What you will do:

• You are responsible for building a best-in-class response time modular-client, a cmd line interface tool to support easy installation and configuration of modular products.
• Build monitoring, alerting and observability infrastructure for Modular services.
• Work with compiler, performance, and kernel teams providing API’s to fully integrate the events, metrics, logs and traces to analyze today’s complex production systems.
• Ensure that telemetry infrastructure is high performing and work with ML frameworks inside the Modular runtime.
• Collaborate with open source engineers to help facilitate the future of ML software stacks

What you bring to the table:

• In-depth knowledge of modern C++ is required.
• 5+ years of leading design and architecture experience with strong fundamentals in design patterns, reliability and scaling concepts.
• Ability to create durable, reusable software frameworks that are leveraged across teams and functions.
• Develops secure and high-quality production code, and reviews and debugs code written by others.
• Experience with one or more application programming languages (C, C++, Java, C#, Go etc.) and modern scripting languages (Bash, Python, etc).
• Strong collaboration skills, ability to share information with internal and external engineering and product teams.
• Experience, or deep interest, in machine learning technologies and use cases.
• Experience using open source software components in production.
• Devotion to quality and engineering excellence.
• Strong written and verbal communication skills.
• Creativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with others, and alignment with our culture.
• Strongly identifies with our core company cultural values.

Helpful but not required:

• LLVM, MLIR, or Python experience is a bonus.
• Experience with working on or contributing to a major machine learning framework such as TensorFlow, PyTorch, and/or ONNX/ONNXRuntime is a bonus.

The estimated base salary range for this role to be performed in the US, regardless of the state, is $166,500.00 - $286,000.00 USD.

The salary for the successful applicant will depend on a variety of permissible, non-discriminatory job-related factors, which include but are not limited to education, training, work experience, business needs, or market demands. This range may be modified in the future. The total compensation for a candidate will also include annual target bonus, equity, and benefits, with equity making up a significant portion of your total compensation.

For candidates who fall outside of the listed requirements, we nevertheless encourage you to apply as we may have openings that are lower/higher level than the ones advertised.