Skip to Content

Open source

10 posts

Posts tagged with Open source

DBRX: Databricks' Groundbreaking Open-Source LLM

Databricks unveils DBRX, a state-of-the-art open LLM with a mixture-of-experts architecture that sets new records for performance and efficiency. Learn about DBRX's capabilities, how it was built, and how to get started using it.

DBRX: Databricks' Groundbreaking Open-Source LLM

Introduction to DBRX

Databricks, a leading data and AI company, has just unveiled DBRX - an open, general-purpose large language model (LLM) that sets a new state-of-the-art among open LLMs. With 132B total parameters (36B active), DBRX was pre-trained on an enormous 12T token dataset spanning both text and code.

Introducing DBRX: A New State-of-the-Art Open LLM | Databricks

What sets DBRX apart is its fine-grained mixture-of-experts (MoE) architecture. By employing 16 experts and selecting 4 per input, it achieves 65x more expert combinations compared to peers like Mixtral and Grok-1. This granular approach, combined with

DBRX: Databricks' Groundbreaking Open-Source LLM Read more

Groq's LPU: Advancing LLM Inference Efficiency

Groq's LPU: Faster LLM inference with real-world benefits. Explore how this new tech empowers developers & unlocks potential for various applications.

Groq's LPU: Advancing LLM Inference Efficiency

Groq's LPU: The New Era for LLM Inference?

Generative AI including large language models (LLMs) has witnessed remarkable advancements in the last year, pushing the boundaries of what AI can achieve.

However, the potential of large language models (LLMs) to transform various industries is undeniable. However, there are some critical challenges, one being: slow inference speeds. Traditional methods, often reliant on GPUs, struggle to keep pace with the demands of LLMs, hindering their real-time applications.

Enter Groq, a pioneering company that wants to disrupt the LLM landscape with its revolutionary Language Processing Unit (LPU). This purpose-built hardware architecture overcomes the

Groq's LPU: Advancing LLM Inference Efficiency Read more

Build Custom AI Chatbots with Ease: Introducing DeepChat

See the power of customizable AI chatbots. Build intelligent, interactive chat experiences for websites & apps. Integrate with popular APIs, process text, images, & voice. Open-source & user-friendly. Boost engagement & automate tasks.

Build Custom AI Chatbots with Ease: Introducing DeepChat

DeepChat is a versatile and user-friendly AI chatbot platform notable for its extensive customization options, integration capabilities with major AI APIs, and multimodal features.

Deep Chat
Chat component for AI APIs

It's designed to be integrated into websites and offers a range of features that make it a versatile tool for various applications. Key characteristics of DeepChat include:

  1. Customizable AI Chatbot Component: It allows users to create custom AI chatbots that can be embedded into their own websites with minimal effort. This customization is a central feature, enabling the chatbots to serve specific functions as required by different
Build Custom AI Chatbots with Ease: Introducing DeepChat Read more

Openness in Language Models: Open Source vs Open Weights vs Restricted Weights

As language models hype "openness", this article proposes key criteria to evaluate true transparency balanced with safety.

Openness in Language Models: Open Source vs Open Weights vs Restricted Weights

Over the past months, there has been a slew of language models touted as “open-source” led by Meta’s LLama model and most recently Mistral’s Mixtral. However, brewing contention questions if these models qualify as fully open source. I take an in-depth look at this debate in this article.

The core question is whether simply releasing a model’s weights while keeping training methodology and data proprietary can be considered true open sourcing. As advanced language models like LLama and Mixtral demonstrate unprecedented capabilities, providing transparency into their development processes becomes critical.

By clearly delineating the differences between open

Openness in Language Models: Open Source vs Open Weights vs Restricted Weights Read more

Verba - The Golden RAGtriever for Effortless Data Interaction

Curious how an open-source AI assistant can make your data searchable in natural language? Meet Verba - your new smart personal doc librarian.

Verba - The Golden RAGtriever for Effortless Data Interaction

This open-source project seeks to simplify the user experience for Retrieval-Augmented Generation (RAG) applications. By utilizing Verba, users can effortlessly delve into their datasets, fostering meaningful interactions.

What is Verba?

Verba is an exciting new open-source AI application that makes querying and interacting with data a breeze. Developed by Weaviate, Verba leverages the power of large language models (LLMs) like GPT-3 along with Weaviate's cutting-edge generative search capabilities. The result is an intelligent assistant that can understand your documents and answer questions in a natural, conversational way.

GitHub - weaviate/Verba: Retrieval Augmented Generation (RAG) chatbot powered by Weaviate
Retrieval
Verba - The Golden RAGtriever for Effortless Data Interaction Read more

Ollama Puts Large Language Models On Your Laptop

Forget supercomputers and proprietary APIs. The future of AI is local and open - thanks to tools like Ollama that put language models in the hands of everyone.

Ollama Puts Large Language Models On Your Laptop

In recent years, large language models (LLMs) like GPT-3 have demonstrated impressive natural language capabilities. However, their proprietary nature and computational requirements have put them out of reach for most developers and researchers. This is starting to change thanks to open source alternatives like Ollama.

Ollama
Get up and running with large language models, locally.

A tool named Ollama addresses this by simplifying the process of running open-source LLMs locally. This essay explores Ollama's features, its step-by-step installation process, and the subsequent ease of interacting with large language models on personal computers.

An Introduction to Ollama

Ollama is simple as

Ollama Puts Large Language Models On Your Laptop Read more