The SELF-RAG framework trains a single arbitrary language model to adaptively retrieve passages on-demand.To generate and reflect on retrieved passages and on own generations using special tokens, called reflection tokens.

1. It is interesting to note, that RAG is following very much the same trajectory as prompt engineering. RAG started off as a simple yet effective concept which consists of prompt injection with contextual reference data.
   
   
2. The primary objective of RAG is to leverage ICL (In-Context Learning) capabilities of LLMs.
   Complexity and efficiency are being introduced to RAG. Retrieval does not take place by default, and a process of triage takes place to determine if the LLM can fulfil the user request.
   
   
3. Efficiency and accuracy trade-off. There is always a balance to be found between efficiency and accuracy. Accuracy at the cost of efficiency negatively impacts user experience and practical use-cases. Efficiency at the cost of accuracy leads to a misleading and inaccurate solution.
   
   
4. Triaging user input to determine direct LLM inference or prompt injection via RAG requires a reference. In the case of SELF-RAG it is against a fine-tuned LLM making use of self-reflection.
   
   
5. The principle of RAG triage can be applied in various forms. The most important aspect is the reference against which the decision is made to directly infer the question from an LLM, or make use of RAG. And in the case where RAG is used; being able to assess the quality and correctness of the response.
   
   
6. Generative AI based applications can also include a wider consideration for triage…where other options apart from direct inference or RAG are available. For instance, human-in-the-loop, web search, multi-LLM orchestration, etc.

 Reflection Tokens

Reflection tokens are categorised into retrieval and critique tokens to indicate the need for retrieval and its generation quality respectively.

SELF-RAG uses reflection tokens to decide the need for retrieval and to self-evaluate generation quality.

Generating reflection tokens makes the LM controllable during the inference phase, enabling it to tailor its behaviour to diverse task requirements.

The study shows that SELF-RAG significantly outperforms LLMs and also standard RAG approaches.

Steps in SELF-RAG

1. The LLM generates text informed by retrieved passages.
2. Criticise the output by learning to generate special tokens.
3. These reflection tokens signal the need for retrieval or confirm the output’s relevance, support, or completeness.
4. In contrast, common RAG approaches retrieve passages indiscriminately, without ensuring complete support from cited sources.