Co-design of LLM-based preference agents: participation may drive overtrust

Large Language Models (LLMs) are increasingly used in database-backed applications to classify tuples, filter records using semantic predicates, extract structured attributes, and enrich query results. Yet the prompt that start these computations are typically stored outside the DBMS in unstructured formats, making them invisible to query execution, metadata management, and optimization. Drawing on Stonebraker's QUEL as a Data Type and the principles of reflective programming, this paper introduces PromptDB, a database system that treats prompts as tuple-level database values. PromptDB provides a logical PROMPT datatype whose values store a template, bindings to tuple attributes, model metadata, and task metadata. Relations may contain PROMPT attributes directly in base tables, or expose them through views over joined tuples. Users query prompt-valued attributes through generated evaluation views, while the system internally renders, rewrites, optimizes, and executes prompts through an EVAL operator. Making prompts database-visible creates a new optimization space. The key idea is to bring query-optimizer thinking to prompts: just as query optimizers exploit database metadata to rewrite SQL plans, PromptDB exploits database metadata to rewrite prompts. We evaluate PromptDB on synthetic and real-world data workloads across different tasks. The results show how database-guided rewriting improves output validity and yields favorable cost-quality trade-offs compared with static, manually written prompts.

Paper

References (12)

06. Attention-RAG: Attention-Guided Context Pruning in Retrieval-Augmented Generation2025
08Reflective programmingintherelationalalgebra1993 · ProceedingsoftheTwelfthACMSIGACT-SIGMOD-SIGARTSymposiumonPrinciplesofDatabaseSystems (Washington,D.C., USA) (PODS ’93)
09QuelasaDataType1984 · SIGMOD’84, Proceedings of Annual Meeting, Boston, Massachusetts,USA,June18-21,1984
102024. In-context Learning with Retrieved Demonstrations for Language Models: A SurveyarXiv
11We implement PromptDB on top of DuckDB using PROMPT attributes, generated evaluation views, an internal EVAL operator and PromptOpt𝐵 maps template
122025. Semantic Operators and Their Optimization: Enabling LLM-Based Data Processing with Accuracy Guarantees in LOTUSProc. VLDB Endow.

Similar papers

© 2026 NYSGPT2525 LLC