Data Design For Fine-Tuning LLM Long Context Windows

Cobus Greyling

Fine-Tune your LLM To fully utilise the available context window.

Something I find intriguing considering recent...

Five Levels Of AI Agents

Cobus Greyling

This is a topic I really enjoyed researching and I was looking forward to writing this. Mostly because I wanted to...

Comparing LLM Agents to Chains: Differences, Advantages & Disadvantages

Cobus Greyling

In this article I put into plain terms the difference between chains and agents, and what will work best for certain...

Exploring the Purpose, Power & Potential of Small Language Models (SLMs)

Cobus Greyling

A multitude of Small Language Models (SLMs) are readily available as open-source resources, easily accessible through...

LLMs Training SLMs

Cobus Greyling

The primary focus in training Orca-2, was to create an open-sourced Small Language Model (SLM) which excels at...

Large Language Models Excel At In-Context Learning (ICL)

Cobus Greyling

Retrieval-augmented generation (RAG) is widely adopted in Generative AI applications for several reasons.

Introduction

TinyLlama Is An Open-Source Small Language Model

Cobus Greyling

The purpose of the TinyLlama model is to serve as a versatile platform for enabling end-user applications on mobile...

Large Impact: The Rise of Small Language Models

Cobus Greyling

A great number of Small Language Models (SLMs) are open-sourced, easy accessible via HuggingFace for download and...

Challenges In Adopting Retrieval-Augmented Generation Solutions

Cobus Greyling

Introduction

RAG (Retrieval-Augmented Generation) has gained significant popularity in developing Generative AI...

Please Stop Saying Long Context Windows Will Replace RAG

Cobus Greyling

Introduction

Long Context Windows are not replacing RAG, and I say this for a number of reasons.

1. Large or Long...

Kore.ai Technical Blog

Data Design For Fine-Tuning LLM Long Context Windows

Fine-Tune your LLM To fully utilise the available context window.

Five Levels Of AI Agents

Comparing LLM Agents to Chains: Differences, Advantages & Disadvantages

In this article I put into plain terms the difference between chains and agents, and what will work best for certain...

Exploring the Purpose, Power & Potential of Small Language Models (SLMs)

LLMs Training SLMs

Large Language Models Excel At In-Context Learning (ICL)

Retrieval-augmented generation (RAG) is widely adopted in Generative AI applications for several reasons.

Introduction

TinyLlama Is An Open-Source Small Language Model

The purpose of the TinyLlama model is to serve as a versatile platform for enabling end-user applications on mobile...

Large Impact: The Rise of Small Language Models

Challenges In Adopting Retrieval-Augmented Generation Solutions

Introduction

Please Stop Saying Long Context Windows Will Replace RAG

Introduction

Leave Comment

Products

XO Capabilities

Solutions

Industries

Developers

RESOURCES

Support

Let’s work together