---
title: 'KEDAS: Factual Knowledge Editing in LLMs'
url: https://www.emergentmind.com/topics/kedas
type: topic
---

# KEDAS: Factual Knowledge Editing in LLMs

KEDAS denotes **Knowledge Editing Alignment with Diverse Augmentation and Self-adaptive Inference**, a 2025 framework for factual knowledge editing in large language models (LLMs). It treats knowledge editing as a combination of one-time alignment, external edit memory, and inference-time routing: the base LLM is aligned with LoRA adapters to apply edited knowledge presented in context, edits are stored in multiple augmented textual forms, and a smart retriever plus filter decides whether a query should bypass editing and use the original model or invoke the aligned edit-aware path [2508.01302].

## 1. Terminology and disambiguation

The label **KEDAS** is not unique across arXiv usage. In current LLM knowledge-editing literature, it names the framework introduced as **“Knowledge Editing Alignment with Diverse Augmentation and Self-adaptive Inference”** [2508.01302]. In a distinct line of work on evaluation for knowledge graph completion, **KG-EDAS** abbreviates **“Knowledge Graph Evaluation based on Distance from Average Solution”** and is described as being “often informally written ‘KEDAS’” [2508.15357]. By contrast, a 2013 detector-software report on JUDIDT-based data acquisition and monitoring does **not** use the term “KEDAS” anywhere; the document instead refers to a DAQ program suite around JUDIDT and related tools [1304.2894].

| Usage | Expansion or status | Domain |
|---|---|---|
| KEDAS | Knowledge Editing Alignment with Diverse Augmentation and Self-adaptive Inference | LLM knowledge editing |
| KG-EDAS | Knowledge Graph Evaluation based on Distance from Average Solution | Knowledge graph completion evaluation |
| “KEDAS” in the 2013 DAQ report | Not mentioned anywhere in the text | Detector DAQ and monitoring |

Within the literature on LLM editing, KEDAS is therefore a specific architecture for factual updating rather than a generic label for editing systems. The naming overlap matters because the three usages address unrelated technical problems: knowledge editing in LLMs, meta-metric aggregation for KGC benchmarking, and detector DAQ software.

## 2. Formal task and motivation

KEDAS is formulated for **knowledge editing**, where an LLM is represented as a function $f:\mathcal{Q}\rightarrow\mathcal{A}$ from query space to answer space, and the edit set is written as
$$
\mathcal{E} = \{e^t\}_{t=1}^N = \{(q_e^t,a_e^t)\}_{t=1}^N.
$$
Each edit provides a triggering query and a desired updated answer. The post-edit system must satisfy three criteria: **edit success**, meaning correct responses on edited queries; **locality**, meaning preservation of answers on unrelated queries; and **portability**, meaning generalization of the edit to related queries [2508.01302].

The framework is motivated by deficiencies in two established families of methods. **Parameter-based editing** methods, including ROME, MEMIT, MEND, WISE, and AlphaEdit, directly change or add parameters; the paper states that such methods can be powerful but often require online gradient steps per edit, scale poorly to many edits, and risk accumulation of interference and degradation. **Retrieval-based editing** methods, including IKE, EREN, RECIPE, and LTE, externalize edits and inject them through prompts or soft prompts; these methods are often gradient-free and efficient, but the base model is not necessarily trained to interpret edits robustly, and naive retrieval can harm locality [2508.01302].

KEDAS is positioned as an **alignment-based** alternative that retains external memory while explicitly teaching the model how to use updated information in context. The immediate antecedent is LTE, which aligns an LLM for editing with an “editing prompt” but always uses the post-alignment model, including for irrelevant queries. The KEDAS paper identifies that design choice as a source of locality loss and degradation on general abilities [2508.01302].

## 3. Core methodology

KEDAS has three coupled components: **LoRA-based alignment**, **diverse edit augmentation**, and **self-adaptive post-alignment inference** [2508.01302].

During the **alignment phase**, the model is trained on an editing prompt of the form

```text
[Updated Information] {edit}
[Query] {query}
```

using low-rank adaptation rather than full fine-tuning. For a linear layer with weight matrix $W\in\mathbb{R}^{d_{\text{out}}\times d_{\text{in}}}$, LoRA parameterizes a rank-$r$ update as
$$
\Delta W = A B^\top,
$$
with $A\in\mathbb{R}^{d_{\text{out}}\times r}$ and $B\in\mathbb{R}^{d_{\text{in}}\times r}$. The effective model is denoted $f_{\Phi+\Delta\Phi(\Theta)}$, with frozen base parameters $\Phi$ and trainable adapter parameters $\Theta$. The aligned model is trained to use in-scope edits, ignore irrelevant edits for out-of-scope queries, and preserve general capabilities through additional general-query data [2508.01302].

The **diverse edit augmentation** stage expands each edit into multiple semantically equivalent textual realizations. For an edit $e^t=(q_e^t,a_e^t)$, the memory includes the original QA form, a declarative form, three paraphrases generated with gpt-4o-mini, and a reversed form. The memory update is written as
$$
\mathcal{M}^t = \mathcal{M}^{t-1} \cup \{ e^t_{\text{qa}}, e^t_{\text{dec}}, e^t_{\text{par}}, e^t_{\text{rev}} \}.
$$
This is intended to improve retrieval recall and portability by reducing sensitivity to surface form [2508.01302].

The third component is **self-adaptive inference**. Given a query $q$, the system first uses all-MiniLM-L6-v2 for high-recall retrieval with top-$k$ selection, where $k=4$:
$$
\mathcal{C}^{\text{top-}k} = \mathbf{Retriever}^{\text{top-}k}(q,\mathcal{M}^t).
$$
A trained binary classifier based on bert-base-uncased then filters candidate edits for relevance. If multiple edits survive, the system selects
$$
e^* = \arg\max_{e\in\mathcal{C}^{\text{filtered}}} \mathbf{Similarity}(e,q).
$$
The final routing rule is
$$
a =
\begin{cases}
f_\Phi(q) & \text{if no relevant edit is found},\\
f_{\Phi+\Delta\Phi(\Theta)}\big(\mathbf{KEPrompt}(e^*,q)\big) & \text{if a relevant edit is found}.
\end{cases}
$$
Irrelevant queries therefore traverse the original pre-alignment model, while relevant queries are answered with the aligned adapters activated and the retrieved edit placed in context [2508.01302].

## 4. Training configuration and evaluation protocol

KEDAS is evaluated with three open-source LLMs: **Llama-2-7B-Chat**, **Qwen2.5-7B-Instruct**, and **Llama-3.1-8B-Instruct** [2508.01302]. The LoRA configurations are reported explicitly: for Llama-2-7B-Chat, rank $r=8$, $\alpha=16$, dropout $=0.05$; for Qwen2.5-7B-Instruct, rank $r=16$, $\alpha=16$, dropout $=0.05$; for Llama-3.1-8B-Instruct, rank $r=8$, $\alpha=16$, dropout $=0$.

The alignment stage reuses LTE’s training data, including in-scope and out-of-scope editing prompts and general queries with GPT-4 completions. The reported training frameworks are LTE official scripts with DeepSpeed plus FastChat for Llama-2, and LLaMA-Factory for Qwen2.5 and Llama-3.1. Reported hyperparameters include batch size $=1$, gradient accumulation of $32$ for Llama-2, $16$ for Qwen2.5, and $8$ for Llama-3.1; learning rates of $3\times 10^{-4}$ for Llama-2 and $1\times 10^{-4}$ for Qwen2.5 and Llama-3.1; $3$ epochs for Llama-2 and Qwen2.5, and $1$ epoch for Llama-3.1 to avoid overfitting; maximum sequence lengths of $1024$ for Llama-2 and Qwen2.5 and $2048$ for Llama-3.1; and AdamW with cosine schedule and warmup ratio $0.03$ or $0.1$ [2508.01302].

The paper reports alignment training times of approximately **12 hours on 2×A40 48GB** for Llama-2, **19 hours on 1×A40** for Qwen2.5, and **6 hours on 1×A40** for Llama-3.1. After this offline phase, **no further parameter updates are needed for new edits** [2508.01302].

Evaluation uses four datasets from the KnowEdit suite: **ZsRE**, **WikiBio**, **WikiData\(_\text{recent}\)**, and **WikiData\(_\text{counterfact}\)**. The reported train and test edit counts are 10,000 train and 1304 test edits for ZsRE, 464 train and 306 test for WikiBio, 570 train and 1266 test for WikiData\(_\text{recent}\), and 1428 train and 885 test for WikiData\(_\text{counterfact}\). Metrics include **edit success (ES)**, **locality (L)**, **portability (P)**, **fluency**, and the **harmonic mean (HM)** of ES, L, and P; for WikiBio, which has no portability queries, HM is the harmonic mean of ES and L [2508.01302].

Three editing regimes are considered. In **single editing**, each edit is applied independently. In **sequential editing**, the update process is written as
$$
f^t = \mathbf{Edit}(f^{t-1}, q_e^t, a_e^t), \quad t=1,\dots,N,
$$
with only the final model evaluated. In **incremental editing**, the same update process is used, but evaluation is performed after each step on the corresponding evaluation sample. The framework is reported to support all three settings without extra training [2508.01302].

## 5. Empirical findings

The principal empirical claim is that KEDAS **“secures the highest overall performance scores in 35 out of 36 cases across four datasets with three LLMs on three settings”** and surpasses its “strong knowledge editing alignment counterpart by about **19.8 harmonic mean scores** of edit success, locality and portability” [2508.01302]. The same paper reports that, across all settings and models, KEDAS wins in **35 of 36** cases, and that in the **sequential** setting it gives the best HM in **all 12** model–dataset cases.

For **Llama-2-7B-Chat** in the sequential setting, the paper reports the following comparisons against LTE: on **ZsRE**, LTE has ES $99.6$, L $49.2$, P $69.2$, HM $66.9$, whereas KEDAS has ES $99.6$, L $91.0$, P $73.6$, HM $86.7$; on **WikiBio**, LTE has HM $64.1$ and KEDAS HM $100.0$; on **WikiData\(_\text{recent}\)**, LTE has HM $72.1$ and KEDAS HM $83.1$; on **WikiData\(_\text{counterfact}\)**, LTE has HM $76.0$ and KEDAS HM $82.8$ [2508.01302]. Comparable gains are reported for **Qwen2.5-7B-Instruct** and **Llama-3.1-8B-Instruct**, including ZsRE HM improvements from $64.9$ to $84.5$ and from $69.7$ to $85.5$, respectively.

The paper also reports results on **general tasks**—CSQA, MNLI, MMLU, and SST—to assess interference outside the editing benchmark. The reported averages are **54.67** for the pre-alignment model, **53.33** for the post-alignment model with no edits, **48.75** for LTE after edits, and **54.67** for KEDAS after **1304 sequential edits**. The routing mechanism is therefore presented as the component that preserves general capabilities by sending irrelevant queries back to the base model [2508.01302].

The ablation study isolates the contributions of **DEA**, **FLT**, **SPI**, and **ALGN**. Averaged sequential results with Llama-2 are reported as follows: full KEDAS gives ES $99.5$, L $86.2$, P $75.5$, HM $88.1$; **without DEA**, ES $94.7$, L $83.2$, P $74.7$, HM $84.3$; **without FLT**, ES $99.5$, L $53.8$, P $75.8$, HM $70.6$; **without SPI**, ES $99.5$, L $62.4$, P $75.5$, HM $76.5$; **without ALGN**, ES $73.5$, L $84.1$, P $53.1$, HM $72.7$ [2508.01302]. These numbers identify the filter as the main determinant of locality, the alignment stage as necessary for edit success and portability, and diverse augmentation as a contributor to retrieval recall and generalization.

The efficiency analysis for **1304 ZsRE edits** with Llama-2-7B-Chat reports **editing time 0.020 h**, **inference time 1.662 h**, and **GPU memory 25.9 GB** for KEDAS, compared with **0.003 h**, **1.490 h**, and **25.5 GB** for LTE, and substantially larger time or memory figures for SERAC, IKE, WISE, and RECIPE [2508.01302]. The reported interpretation is that KEDAS incurs a small retrieval-and-filter overhead relative to LTE while delivering a large improvement in HM.

## 6. Position in the literature, limitations, and relation to other “KEDAS” terms

KEDAS is positioned as a **hybrid between alignment and retrieval** rather than as a weight-surgery method. Relative to ROME, MEMIT, MEND, WISE, and AlphaEdit, it keeps base weights frozen and stores edits externally; relative to IKE, EREN, and RECIPE, it adds explicit alignment so that the model learns to treat updated information as authoritative; and relative to LTE, it adds diverse edit augmentation, a smart retriever with a filter, and self-adaptive routing between the base and aligned models [2508.01302]. A plausible implication is that the distinctive contribution is not merely external memory, but the coupling of external memory with a learned routing policy and a togglable aligned submodel.

The paper identifies four limitations. First, overall performance depends heavily on the **BERT-based filter**: false negatives reduce edit success and portability, while false positives can harm locality. Second, **diverse edit augmentation depends on an external LLM**, specifically gpt-4o-mini, which introduces API dependence and cost. Third, the current design is **limited to one-hop portability** rather than multi-hop reasoning over edited knowledge. Fourth, while the reported experiments handle **more than 1000 edits**, memory growth and retrieval/filter cost scale with the number of stored edits, so more scalable indexing or pruning may be required at larger scale [2508.01302].

The term’s overlap with **KG-EDAS** is conceptually accidental rather than substantive. KG-EDAS is a meta-metric for **Knowledge Graph Completion** that aggregates multiple metrics and datasets into a single normalized score $M_i\in[0,1]$ using distance from the average solution [2508.15357]. It addresses cross-metric and cross-dataset ranking conflicts in KGC, not knowledge editing in LLMs. The 2013 DAQ report is more distant still: it describes a **client–server DAQ program suite** around JUDIDT and ACQIRIS, but explicitly does not define or mention KEDAS at all [1304.2894].

In the arXiv record, then, **KEDAS** primarily names a 2025 knowledge-editing framework for LLMs, while adjacent uses either denote a different acronymic expansion—**KG-EDAS**—or reflect an external naming convention not present in the underlying paper.

Source: https://www.emergentmind.com/topics/kedas