Pink Hat introduced plans to accumulate Neural Magic, an organization that focuses on generative AI efficiency engineering, mannequin optimization algorithms, and high-performance GPU and CPU inference serving.
Neural Magic was spun out of MIT in 2018, and it presents software program and algorithms that speed up generative AI inference workloads. Its experience in giant language fashions together with Pink Hat’s capacity to help these fashions throughout the hybrid cloud aligns with Pink Hat’s said purpose of creating gen AI extra accessible to extra organizations.
Pink Hat intends to democratize the facility of AI by way of open-source-licensed fashions that may run anyplace. This can improve organizations’ skills to customise giant language fashions, use inference efficiency engineering for infrastructure effectivity, and companion within the open-source ecosystem to allow broader selections for {hardware} and chip structure.
