• Thu. Nov 28th, 2024

Hugging Face pitches HUGS as an alternative to Nvidia’s NIM for open models

Byadmin

Oct 25, 2024



HUGS supports 13 models: Llama-3.1-8B-Instruct, Llama-3.1-70B-Instruct, Llama-3.1-405B-Instruct-FP8, Hermes-3-Llama-3.1-8B, Hermes-3-Llama-3.1-70B, Hermes-3-Llama-3.1-405B-FP8, Nous-Hermes-2-Mixtral-8x7B-DPO, Mixtral-8x7B-Instruct-v0.1, Mistral-7B-Instruct-v0.3, Mixtral-8x22B-Instruct-v0.1, Gemma-2-27b-it, Gemma-2-9b-it, and Alibaba’s Qwen2.5-7B-Instruct.

The documentation page on HUGS shows that Hugging Face is expected to add support for models such as Deepseek, T5, Phi, and Command R soon. Other multimodal and embeddings models that are expected to be added soon includes Idefics, Llava, BGE, GTE, Micbread, Arctic, Jina, and Nomic.

Nvidia says NIM supports more, though, including its proprietary Nemotron models, models from Cohere, A121, Adept, Getty Images, Shutterstock, and open models from Google, Hugging Face, Meta, Microsoft, Mistral AI, Stability AI.



Source link