Member of Technical Staff - Model Evaluation

The Member of Technical Staff - Model Evaluation role at xAI involves joining a dedicated team focused on assessing and enhancing the performance of AI models. xAI is committed to developing AI systems that accurately understand the universe and assist humanity in its pursuit of knowledge. The company operates with a flat organizational structure, emphasizing hands-on contributions and engineering excellence.

In this position, you will be responsible for providing comprehensive assessments of AI models, delving into model training and data to identify weaknesses revealed during evaluations. Collaboration with the modeling and data teams is essential to develop plans aimed at improving model quality. Your work will directly influence the advancement and reliability of xAI's AI systems.

The ideal candidate should have experience in model assessment and evaluation task development, including both public and in-house benchmarking. Proficiency in collecting and synthesizing data for new evaluations is crucial. Additionally, building infrastructure and frameworks for user-friendly model evaluation, with familiarity in inference frameworks like SGlang and vLLM, is highly desirable.

The annual salary for this role ranges from $180,000 to $440,000 USD. xAI offers a comprehensive benefits package that includes equity, medical, vision, and dental coverage, access to a 401(k) retirement plan, short and long-term disability insurance, life insurance, and various other perks.

xAI fosters a culture of curiosity and continuous learning, encouraging employees to challenge themselves and contribute directly to the company's mission. The organization values strong communication skills and prioritization abilities, providing opportunities for leadership to those who show initiative and consistently deliver excellence.