Senior Software Engineer, Semantic Search

Mission Summary:

Motional's autonomous vehicles collect petabytes of data on the road every day. The Semantic Search Team manages data infrastructure, processing, and visualization for Motional's machine learning data. Our team also provides a scenario mining framework that other teams in Autonomy use to mine for complex and rare scenarios to improve our ML training model and av-stack performance.

As our data continues to grow in 2023, our team is looking for a Senior Software Engineer to design scalable data processing infrastructure and improve the efficiency of the data architecture and scenario mining framework for the entire Autonomy organization.

What you'll be doing: 

• Build a text-to-image search engine for improved data discovery and data annotation 
• Design and implement new data pipelines for other Autonomy teams
• Migrate the existing scenario mining framework to Apache Spark
• Scale the existing Semantic Search data infrastructure and data pipelines

What we're looking for:

• Strong experience in large-scale data processing with Apache Spark
• Strong coding experience with Python or Scala
• Solid experience in developing data pipelines with Apache Airflow  
• Solid experience in AWS/Cloud (e.g., API Gateway, EKS,  Lambda, OpenSearch, Redshift, S3)
• Experience interacting with REST APIs and microservices
• Ability to mentor junior engineers
• Ability to communicate clearly to non-domain experts about potentially complex behaviors

Bonus Points (not required):

• Web backend experience with C#.Net
• Autonomous Vehicle experience

Why you should join us: 

• Opportunity to build impactful products across the organization
• Help shape the technical roadmap towards a better product
• Be part of a rapidly growing team that interfaces with many branches of the organization

Working conditions:

• While performing the duties of this job, the employee is frequently required to convey and detect communication
• The employee occasionally required to remain stationary at times for up to 50% of working time, move in designated working areas; & operate and use office equipment
• The employee may occasionally move up to 50 pounds

The Motional global headquarters are located at 100 Northern Avenue in Boston, MA. Nestled in the bustling Seaport district with sweeping views of Boston Harbor and downtown Boston, the offices are located close to major transit lines and a quick walk to various restaurants and popular attractions.  This position can support remote work within the United States.