AI Specialist (AI Engineering)

Hyphen Connect is seeking an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. This role is pivotal in developing and deploying cutting-edge AI solutions, ensuring optimal efficiency across diverse hardware architectures.

Key responsibilities include compressing and optimizing large language and vision models for on-device inference, developing pipelines for model distillation and hardware-specific compilation, and benchmarking performance across various NPU/GPU architectures.

The ideal candidate will have expertise in model distillation, pruning, and 4-bit/8-bit quantization techniques. Hands-on experience with TensorRT, ONNX Runtime, and edge deployment is essential. Strong proficiency in C++ and Python is also required.

Hyphen Connect offers a dynamic work environment where innovation and collaboration are highly valued. Employees have access to continuous learning opportunities and are encouraged to contribute to projects that push the boundaries of AI technology.