Completely Opensource AI LLM : mixtral-8x7b

I recently came across this awesome website for Artificial Intelligence projects, Hugging Face – The AI community building the future.

While at it, i came across something interesting, Startup called Mistrail: Mixtral of experts | Mistral AI | Open source models

they have built a completley Opensource AI model, with Apache 2.0 License. called Mixtrail 8x7b

Other notable links on my readings,:
Uncensored Models (erichartford.com)
Introduction | Mistral AI Large Language Models

Apparently, while this model is less than one year old, and can be trained with internal Data, it performans at about the same level as GPT 3.5 this is impressive.

Maybe now we can train these kinds of models, hosted on our own servers with internal company docs, and have them answer trivial questions.

I am curious what nextcloud will do with it.

Happy learning

3 Likes

in relation to this same topic,

I came accross another one opensource LLM thats API compatible with OpenAI API, that can be run on prmeise

mudler/LocalAI: :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs ggml, gguf, GPTQ, onnx, TF compatible models: llama, llama2, rwkv, whisper, vicuna, koala, cerebras, falcon, dolly, starcoder, and many others (github.com)

And Wonderful LLM course: mlabonne/llm-course: Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks. (github.com)

I wonder if this “opensource” LLM was, like OpenAI, dedicatedly trained with pedophile kiddie porn?

Was OpenAI’s version of the promise to mankind to empower any Tom, Dick and Harry, even without any Photoshop expeience, with the capabilities to create fake nudes of Celebs like Taylor Swift?
Great!
The capabilitiies to further kiddie porn?
Parts of Humanity are so sick - yet powerful people seem to push such “Agendas”…

My 2 pieces of glowing coals
Andy
(Acting Avocatus Diabolis)

:slight_smile:

1 Like