LLMs Training SLMs

Cobus Greyling

The primary focus in training Orca-2, was to create an open-sourced Small Language Model (SLM) which excels at...

Large Language Models Excel At In-Context Learning (ICL)

Cobus Greyling

Retrieval-augmented generation (RAG) is widely adopted in Generative AI applications for several reasons.

Introduction

TinyLlama Is An Open-Source Small Language Model

Cobus Greyling

The purpose of the TinyLlama model is to serve as a versatile platform for enabling end-user applications on mobile...

Large Impact: The Rise of Small Language Models

Cobus Greyling

A great number of Small Language Models (SLMs) are open-sourced, easy accessible via HuggingFace for download and...

Challenges In Adopting Retrieval-Augmented Generation Solutions

Cobus Greyling

Introduction

RAG (Retrieval-Augmented Generation) has gained significant popularity in developing Generative AI...

Please Stop Saying Long Context Windows Will Replace RAG

Cobus Greyling

Introduction

Long Context Windows are not replacing RAG, and I say this for a number of reasons.

1. Large or Long...

Three Considerations For Private Open-Source LLM Instances

Cobus Greyling

Using commercial LLM APIs for production applications pose clear & well researched risks. Consequently, enterprises are...

A Short History Of Chatbots

Cobus Greyling

The evolution of chatbot technology has been remarkable, progressing from rudimentary systems dependent on rules to...

Data Design For Fine-Tuning To Improve Small Language Model Behaviour

Cobus Greyling

Teaching Small Language Models to Self-Correct & Reason by using creative data formats for fine-tuning data. Via Prompt...

The Large Language Model Landscape — Version 5

Cobus Greyling

Kore.ai Technical Blog

LLMs Training SLMs

Large Language Models Excel At In-Context Learning (ICL)

Retrieval-augmented generation (RAG) is widely adopted in Generative AI applications for several reasons.

Introduction

TinyLlama Is An Open-Source Small Language Model

Large Impact: The Rise of Small Language Models

Challenges In Adopting Retrieval-Augmented Generation Solutions

Introduction

Please Stop Saying Long Context Windows Will Replace RAG

Introduction

Three Considerations For Private Open-Source LLM Instances

Using commercial LLM APIs for production applications pose clear & well researched risks. Consequently, enterprises are...

A Short History Of Chatbots

The evolution of chatbot technology has been remarkable, progressing from rudimentary systems dependent on rules to...

Data Design For Fine-Tuning To Improve Small Language Model Behaviour

Teaching Small Language Models to Self-Correct & Reason by using creative data formats for fine-tuning data. Via Prompt...

The Large Language Model Landscape — Version 5

In the recent past I have been observing and describing current LLM-related technologies and trends. In this article...

Leave Comment

Products

XO Capabilities

Solutions

Industries

Developers

RESOURCES

Support

Let’s work together