Dec 11, 2023 · Mixtral outperforms Llama 2 70B on most benchmarks with 6x faster inference. It is the strongest open-weight model with a permissive license and the best model overall regarding cost/performance trade-offs.

Strongest global contributor to open source AI and AI policy. Mistral AI is the world’s greenest and leading independent AI lab.

Mistral AI API are versions with specific release dates. To prevent any disruptions due to model updates and breaking changes, it is recommended to use the dated versions of the Mistral AI …

Apr 17, 2024 · Mixtral 8x22B is a natural continuation of our open model family. Its sparse activation patterns make it faster than any dense 70B model, while being more capable than any other open-weight model (distributed under permissive or restrictive licenses).

Chat with Mistral AI's cutting edge language models.

Mistral AI is a research lab building the best open source models in the world. La Plateforme enables developers and enterprises to build new products and applications, powered by Mistral’s open source and commercial LLMs.

Our Chat Completion and Embeddings APIs specification. Create your account on [La Plateforme] (https://console.mistral.ai) to get access and read the [docs] (https://docs.mistral.ai) to learn how to use it.

Sep 27, 2023 · Mistral 7B uses a sliding window attention (SWA) mechanism (Child et al., Beltagy et al.), in which each layer attends to the previous 4,096 hidden states. The main improvement, and reason for which this was initially investigated, is a linear compute cost of O (sliding_window.seq_len).

Principal contributeur mondial à l'IA open source et à la politique de l'IA. Mistral AI est le laboratoire d'IA indépendant de pointe le plus écologique au monde.

Sep 17, 2024 · Pixtral was trained to be a drop-in replacement for Mistral Nemo 12B. Its key distinguishing factor from existing open-source models is the delivery of best-in-class multimodal reasoningwithout compromising on key text capabilities such as …