Senior Staff AI Engineer - LLM inference optimization Job at Yoh, A Day & Zimmermann Company, San Jose, CA

bUVvQi9YcUhCWjFBanMxM0NhdFkyRm5Z
  • Yoh, A Day & Zimmermann Company
  • San Jose, CA

Job Description

Senior Staff AI Engineer – LLM inference optimization



Roles and Responsibilities:

  • Design and architect technical solutions to deliver foundational AIOS capabilities within SkyOS across ECU domains in electric vehicles (EVs).
  • Lead the development of proof-of-concept projects to evaluate architectural designs for functionality, performance, security, and reliability.
  • Collaborate closely with engineering teams to understand real-world development constraints and ensure high-quality implementation, validation, and integration of AIOS designs.
  • Define the technical roadmap for the evolution of AIOS solutions.
  • Develop and communicate clear requirements to guide the development team.
  • Continuously monitor industry trends and analyze competitors’ technical approaches.
Required Qualifications:
  • 5+ years of experience in software design and development focused on AI model inference optimization, and deployment.
  • Strong knowledge of Large Language Models (LLMs) with expertise in optimizing inference on resource-constrained edge devices. Vision-Language Models (VLMs) are a plus.
  • Hands-on experience with cutting-edge AI models and frameworks.
  • Solid background in GPU/NPU architectures and AI training frameworks such as PyTorch, TensorFlow, or similar.
  • 7+ years of experience building complex software systems.
  • Proficiency in C/C++ and Python programming languages.
Preferred Qualifications:
  • Expertise in optimizing AI models for inference on edge devices.
  • Experience with performance tuning and inference optimization for deep learning models across various hardware platforms.
  • Deep understanding of computer architectures, including CPU, MPU, GPU, and NPU technologies.
  • Solid foundation in embedded and mobile operating systems.
  • Familiarity with microkernel architectures, Linux kernel development, hypervisors, middleware, and application frameworks.


Estimated Min Rate : $200,000.00

Estimated Max Rate : $300,000.00

Note: Any pay ranges displayed are estimations. Actual pay is determined by an applicant's experience, technical expertise, and other qualifications as listed in the job description. All qualified applicants are welcome to apply.

Yoh, a Day & Zimmermann company, is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Visit  to contact us if you are an individual with a disability and require accommodation in the application process.

For California applicants, qualified applicants with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. All of the material job duties described in this posting are job duties for which a criminal history may have a direct, adverse, and negative relationship potentially resulting in the withdrawal of a conditional offer of employment.

Job Tags

Similar Jobs

Belcan

Procurement Coordinator Job at Belcan

 ...contract supplier follow up Below are nice to haves: Engineering background Experience in coatings and paint industry CPSM/CPM certification Experience with large capital projects (Processing Coatings Equipment and Construction a plus) Experience with... 

EVONA

Wire Harness Assembly Technician Job at EVONA

 ...Wire Harness Assembly Technician Albuquerque, New Mexico We are seeking an experienced Electrical Technician with a strong background...  ...integrity. Quality Control & Compliance Ensure all work meets industry and company quality standards, adhering to safety... 

SOS International LLC

Korean Linguists Job at SOS International LLC

Overview:**This position is contingent upon award of contract** SOS International LLC (SOSi)is seeking Korean Linguists to support a US Government Client. Linguists will serve as subject matter experts and leverage Korean and their cultural expertise to translate... 

USPRO

Senior Project Manager (11360) Job at USPRO

 ...General Job Description: The Senior Project Manager is expected to develop and maintain a client base, manage HVAC/Plumbing/process sales...  ...change orders, strategies, etc. for good business procedures and legal protection. Billing, while maintaining a clear... 

Risus Talent Partners

Junior Buyer Job at Risus Talent Partners

Located: Tucson, AZ Mission of the Role (What you will be doing) The Merchandiser identifies and sources products to satisfy unique, non-stock customer requirements and is an important communication link between the supplier, customer service, sales, and operations....