Cobus Greyling (7)

Chain-of-Instructions (CoI) Fine-Tuning

This approach draws inspiration from Chain-of-Thought (CoT) prompting which generates step-by-step rationales from...

Performing Multiple LLM Calls & Voting On The Best Result Are Subject To Scaling Laws

More LLM calls enhance performance on easy queries but diminish it on hard ones.

So what scaling laws can be...

Exploring the Purpose, Power & Potential of Small Language Models (SLMs)

A number of very capable Small Language Models (SLMs) have been open-sourced recently. In this article you will find...

Self-Reflective Retrieval-Augmented Generation (SELF-RAG)

The SELF-RAG framework trains a single arbitrary language model to adaptively retrieve passages on-demand.To generate...

Prompt-RAG

Vector Embedding Free Retrieval-Augmented Generation

While Prompt-RAG does come with its limitations, it can...

Please Stop Saying Long Context Windows Will Replace RAG

And I’m curious to know if anyone has innovative approaches to using long context windows efficiently?

Long Context...

LLMs Training SLMs

Research from Microsoft Research shows how they used LLMs to train SLMs without any RLHF…

The primary focus in training...

The Evolution of Grounding & Planning In AI Agents

Simply put, intents are categories or classes used to classify conversations.Each interaction between a user and the...

The Rise of Agentic AI: Zones, Models & Tools

In recent developments within AI research, the focus has gradually shifted from reliance on Large Language Models...

LLM Drift, Prompt Drift & Cascading

Prompt Chaining can be performed manually or automatically; manual entails crafting chains by hand, via a GUI chain...