Neural Magic

About:

Neural Magic provides high-performance inference serving solutions for deploying leading open-source LLMs on CPU and GPU infrastructure.

Website: http://neuralmagic.com/

Twitter/X: neuralmagic

Top Investors: Andreessen Horowitz, New Enterprise Associates, Pillar VC, Ridgeline, Comcast Ventures

Description:

Neural Magic is a series-A company with a mission to enable enterprise deployment of open-source machine learning models across edge, datacenter, and cloud. Our deep expertise across AI model optimization and high-performance computing has led us to invent the industry's state-of-the-art techniques for model quantization and sparsification, and inference server acceleration. With this we provide enterprise-grade inference server solutions under subscription that deliver maximum speed and efficiency across both GPUs and CPUs. Neural Magic is headquartered in Somerville, MA, and was founded in 2018 by MIT professor Nir Shavit and MIT Research Scientist Alex Matveev.