Exploring the Purpose, Power & Potential of Small Language Models (SLMs)

Cobus Greyling

A multitude of Small Language Models (SLMs) are readily available as open-source resources, easily accessible through...

LLMs Training SLMs

Cobus Greyling

The primary focus in training Orca-2, was to create an open-sourced Small Language Model (SLM) which excels at...

Large Language Models Excel At In-Context Learning (ICL)

Cobus Greyling

Retrieval-augmented generation (RAG) is widely adopted in Generative AI applications for several reasons.

Introduction

TinyLlama Is An Open-Source Small Language Model

Cobus Greyling

The purpose of the TinyLlama model is to serve as a versatile platform for enabling end-user applications on mobile...

Large Impact: The Rise of Small Language Models

Cobus Greyling

A great number of Small Language Models (SLMs) are open-sourced, easy accessible via HuggingFace for download and...

Challenges In Adopting Retrieval-Augmented Generation Solutions

Cobus Greyling

Introduction

RAG (Retrieval-Augmented Generation) has gained significant popularity in developing Generative AI...

Please Stop Saying Long Context Windows Will Replace RAG

Cobus Greyling

Introduction

Long Context Windows are not replacing RAG, and I say this for a number of reasons.

1. Large or Long...

Three Considerations For Private Open-Source LLM Instances

Cobus Greyling

Using commercial LLM APIs for production applications pose clear & well researched risks. Consequently, enterprises are...

A Short History Of Chatbots

Cobus Greyling

The evolution of chatbot technology has been remarkable, progressing from rudimentary systems dependent on rules to...

Data Design For Fine-Tuning To Improve Small Language Model Behaviour

Cobus Greyling

Kore.ai Technical Blog

Exploring the Purpose, Power & Potential of Small Language Models (SLMs)

LLMs Training SLMs

Large Language Models Excel At In-Context Learning (ICL)

Retrieval-augmented generation (RAG) is widely adopted in Generative AI applications for several reasons.

Introduction

TinyLlama Is An Open-Source Small Language Model

The purpose of the TinyLlama model is to serve as a versatile platform for enabling end-user applications on mobile...

Large Impact: The Rise of Small Language Models

Challenges In Adopting Retrieval-Augmented Generation Solutions

Introduction

Please Stop Saying Long Context Windows Will Replace RAG

Introduction

Three Considerations For Private Open-Source LLM Instances

Using commercial LLM APIs for production applications pose clear & well researched risks. Consequently, enterprises are...

A Short History Of Chatbots

The evolution of chatbot technology has been remarkable, progressing from rudimentary systems dependent on rules to...

Data Design For Fine-Tuning To Improve Small Language Model Behaviour

Teaching Small Language Models to Self-Correct & Reason by using creative data formats for fine-tuning data. Via Prompt...

Leave Comment

Products

XO Capabilities

Solutions

Industries

Developers

RESOURCES

Support

Let’s work together