150 Commits

Author SHA1 Message Date
Daniel 342e2d43f6 Use FTS5 external content mode for blocks_fts to deduplicate data with blocks https://github.com/siyuan-note/siyuan/issues/17540
Signed-off-by: Daniel <845765@qq.com>
2026-07-03 14:16:20 +08:00
Daniel 96a2cc4c8e 🎨 Improve booting
Signed-off-by: Daniel <845765@qq.com>
2026-07-02 14:10:24 +08:00
Daniel b2b4f37b6a Semantic search using AI embeddings https://github.com/siyuan-note/siyuan/issues/17788
Signed-off-by: Daniel <845765@qq.com>
2026-07-01 07:54:41 +08:00
Daniel 2f133c5b5b Semantic search using AI embeddings https://github.com/siyuan-note/siyuan/issues/17788 https://github.com/siyuan-note/siyuan/issues/18002
Signed-off-by: Daniel <845765@qq.com>
2026-06-30 22:26:42 +08:00
Daniel 59dc786120 New settings UI https://github.com/siyuan-note/siyuan/issues/17601
Signed-off-by: Daniel <845765@qq.com>
2026-06-13 12:09:59 +08:00
Daniel 6d6c3b14ac ♻️ No longer create table blocks_fts_case_insensitive https://github.com/siyuan-note/siyuan/issues/17849
Signed-off-by: Daniel <845765@qq.com>
2026-06-12 22:18:07 +08:00
游夏 36f4e3720e 🎨 Add Simplified/Traditional Chinese sensitivity option (#17846)
*  搜索支持区分繁简选项 Add Simplified/Traditional Chinese sensitivity option for search

新增搜索配置 hanSensitive(区分繁简,默认开启 = 现状行为,命名与语义
向 caseSensitive 对齐)。关闭后简体与繁体可互相检索。

- FTS 层:关闭区分繁简时,blocks_fts / blocks_fts_case_insensitive 建表
  追加 han_insensitive 分词器参数(依赖 88250/go-sqlite3 配套补丁),
  繁体在分词时按单字折叠为简体,token 偏移仍指向原文;
- 切换选项复用区分大小写现有的 FullReindex 流程;
- 高亮:EncloseHighlighting 在关闭区分繁简时将关键字逐字符展开为
  繁简等价字符类(如 诗经 -> [诗詩][经經]),与分词器使用同一份
  OpenCC TSCharacters 映射数据;
- 兼容:旧版本 conf.json 缺 hanSensitive 字段时按既往行为置为开启;
  setSearch 请求未携带该字段(现行前端/第三方调用)时保持当前值,
  避免被零值意外翻转并触发重建索引;
- 遵照配置界面重写计划(#17601),本次不改动设置界面与 i18n,仅添加
  配置数据结构字段与前端类型定义(config.d.ts)。

范围说明:本次仅覆盖块全文搜索(关键字/查询语法)的命中与高亮;
历史/资源文件搜索、数据库属性过滤、虚拟引用、查找替换的替换动作
不在本次范围内(替换保持字节精确以避免误改原文)。

Fixes #13304

* 🐛 add missing util.SearchHanSensitive referenced by highlighting and sql.SetHanSensitive

Copilot 评审指出 util.SearchHanSensitive 未定义导致无法编译:补上该全局
变量(默认 true,与既往行为一致,由 sql.SetHanSensitive 维护),并修正
conf/search.go 的 gofmt 对齐。已在本地以 dev 当前 go.mod(已合并的
88250/go-sqlite3 分词器)完成 go build -tags fts5 与 kernel/search 单测验证。
2026-06-12 15:59:50 +08:00
Daniel 99eb811b86 Improve database view performance https://github.com/siyuan-note/siyuan/issues/17830
Signed-off-by: Daniel <845765@qq.com>
2026-06-08 09:09:39 +08:00
Daniel 88ae06150d 🎨 Improve indexing
Signed-off-by: Daniel <845765@qq.com>
2026-06-04 12:17:50 +08:00
Daniel 5a02e7b28f Semantic search using AI embeddings https://github.com/siyuan-note/siyuan/issues/17788
Signed-off-by: Daniel <845765@qq.com>
2026-05-31 09:46:42 +08:00
Daniel 08aaaedb13 Semantic search using AI embeddings https://github.com/siyuan-note/siyuan/issues/17788
Signed-off-by: Daniel <845765@qq.com>
2026-05-30 21:04:01 +08:00
Daniel f57eb24470 🎨 https://github.com/siyuan-note/siyuan/issues/17786
Signed-off-by: Daniel <845765@qq.com>
2026-05-30 10:37:08 +08:00
Daniel 4afa0adfa6 🎨 Improve rebuild index https://github.com/siyuan-note/siyuan/issues/17713
Signed-off-by: Daniel <845765@qq.com>
2026-05-24 21:05:03 +08:00
Jeffrey Chen 0a454d3cb7 🎨 Add read-only mode to /api/query/sql (#17696)
* 🧑‍💻 Add read-only mode to `/api/query/sql`

* 🎨 sql.CheckSingleStatement excludes end-of-line comments
2026-05-18 18:28:31 +08:00
Daniel d711ede632 🎨 https://github.com/siyuan-note/siyuan/issues/17695
Signed-off-by: Daniel <845765@qq.com>
2026-05-18 11:36:00 +08:00
Daniel b0177c4aa1 Command Line Interface https://github.com/siyuan-note/siyuan/issues/17674
Signed-off-by: Daniel <845765@qq.com>
2026-05-13 21:18:21 +08:00
Daniel 52b8a7cfed 🎨 add WAL persistence for database index queue to improve data indexing stability https://github.com/siyuan-note/siyuan/issues/17610
Signed-off-by: Daniel <845765@qq.com>
2026-04-29 21:45:55 +08:00
Daniel de5e7fd2b9 🎨 https://github.com/siyuan-note/siyuan/issues/17592
Signed-off-by: Daniel <845765@qq.com>
2026-04-29 09:28:35 +08:00
Daniel 1486804d67 🎨 https://github.com/siyuan-note/siyuan/issues/17534 https://github.com/siyuan-note/siyuan/issues/17545
Signed-off-by: Daniel <845765@qq.com>
2026-04-19 17:21:55 +08:00
Daniel 2d052a9400 🎨 https://github.com/siyuan-note/siyuan/issues/17536 https://github.com/siyuan-note/siyuan/issues/5889
Signed-off-by: Daniel <845765@qq.com>
2026-04-19 11:42:43 +08:00
Daniel 9fee2993f9 🐛 https://github.com/siyuan-note/siyuan/issues/17537
Signed-off-by: Daniel <845765@qq.com>
2026-04-19 11:23:59 +08:00
Daniel f5998d84b8 https://github.com/siyuan-note/siyuan/issues/17539
Signed-off-by: Daniel <845765@qq.com>
2026-04-19 10:40:38 +08:00
Jeffrey Chen 5c674d7249 ♻️ Replace interface{} with any (#17415) 2026-04-05 16:48:32 +08:00
Daniel a6a56a6442 🎨 https://github.com/siyuan-note/siyuan/issues/17157
Signed-off-by: Daniel <845765@qq.com>
2026-03-13 10:42:42 +08:00
Daniel 3ae8b2f3ae 🎨 https://github.com/siyuan-note/siyuan/issues/17157
Signed-off-by: Daniel <845765@qq.com>
2026-03-13 10:15:20 +08:00
Daniel 9a344830b4 🎨 https://github.com/siyuan-note/siyuan/issues/17157#issuecomment-4039704018
Signed-off-by: Daniel <845765@qq.com>
2026-03-12 08:42:08 +08:00
Daniel f7f05ffad1 🎨 Improve reindex
Signed-off-by: Daniel <845765@qq.com>
2026-03-09 11:25:05 +08:00
Daniel ecfb9329f9 🎨 https://github.com/siyuan-note/siyuan/issues/17158
Signed-off-by: Daniel <845765@qq.com>
2026-03-09 11:23:34 +08:00
Daniel ab83e5d987 🎨 https://github.com/siyuan-note/siyuan/issues/17157
Signed-off-by: Daniel <845765@qq.com>
2026-03-08 11:02:23 +08:00
Daniel 768f836617 🎨 https://github.com/siyuan-note/siyuan/issues/17157
Signed-off-by: Daniel <845765@qq.com>
2026-03-08 10:56:38 +08:00
Daniel 7253c191ec 🎨 https://github.com/siyuan-note/siyuan/issues/17157
Signed-off-by: Daniel <845765@qq.com>
2026-03-08 10:46:30 +08:00
Daniel c325eb696f 🎨 https://github.com/siyuan-note/siyuan/issues/17158
Signed-off-by: Daniel <845765@qq.com>
2026-03-08 10:07:52 +08:00
Daniel 3f82df40e3 🐛 Rebuilding the index caused a crash https://github.com/siyuan-note/siyuan/issues/17001
Signed-off-by: Daniel <845765@qq.com>
2026-02-11 23:44:12 +08:00
Daniel 87282404bb Improve data indexing to reduce disk read operations https://github.com/siyuan-note/siyuan/issues/16958
Signed-off-by: Daniel <845765@qq.com>
2026-02-06 18:25:48 +08:00
Daniel dc00060062 Improve data indexing to reduce disk read operations https://github.com/siyuan-note/siyuan/issues/16958
Signed-off-by: Daniel <845765@qq.com>
2026-02-06 18:11:02 +08:00
Daniel b059496eb6 🎨 Improve init db
Signed-off-by: Daniel <845765@qq.com>
2026-02-01 17:32:57 +08:00
Daniel 95242c3f4d 🐛 Fix https://github.com/siyuan-note/siyuan/issues/16847
Signed-off-by: Daniel <845765@qq.com>
2026-01-17 21:50:31 +08:00
Daniel e1ebb1f151 🎨 Database filtering follows search case sensitive settings https://github.com/siyuan-note/siyuan/issues/16585
Signed-off-by: Daniel <845765@qq.com>
2026-01-17 18:20:50 +08:00
Daniel ca24bea936 🎨 Improve handling of assets when exporting to Word .docx format https://github.com/siyuan-note/siyuan/issues/15253
Signed-off-by: Daniel <845765@qq.com>
2026-01-09 19:11:41 +08:00
Daniel 68e83a359d Improve data indexing performance https://github.com/siyuan-note/siyuan/issues/16557
Signed-off-by: Daniel <845765@qq.com>
2025-12-11 12:14:28 +08:00
Daniel 980f6dd0b8 Callout block https://github.com/siyuan-note/siyuan/issues/16051
Signed-off-by: Daniel <845765@qq.com>
2025-12-06 16:46:33 +08:00
Daniel 73963739ce 🐛 Renaming doc title does not update title in ial https://github.com/siyuan-note/siyuan/issues/16166
Signed-off-by: Daniel <845765@qq.com>
2025-10-21 17:52:42 +08:00
Daniel 34360fb9e3 🎨 Manually optimize the data index to reduce space usage and improve performance https://github.com/siyuan-note/siyuan/issues/15663 2025-08-25 11:23:42 +08:00
Daniel 16d3b65b2a 🎨 Improve search for emojis in tags https://github.com/siyuan-note/siyuan/issues/15391 2025-08-01 10:56:08 +08:00
Daniel 286223db84 🎨 Database index content/markdown values no longer contain zero-width spaces https://github.com/siyuan-note/siyuan/issues/15204 2025-07-03 10:01:04 +08:00
Daniel e321c639a7 🎨 Update the parent_id of blocks below a heading block when updating the heading block https://github.com/siyuan-note/siyuan/issues/14871 2025-05-24 11:59:47 +08:00
Daniel 536aa39f95 🎨 Add template function getBlock https://github.com/siyuan-note/siyuan/issues/14474 2025-03-31 16:39:24 +08:00
Daniel 37d358cd52 🎨 Add index idx_attributes_block_id https://ld246.com/article/1742827508465 2025-03-25 00:13:29 +08:00
Daniel 63ef661a67 🐛 Tag search not escaped correctly https://github.com/siyuan-note/siyuan/issues/13919 2025-01-31 11:58:39 +08:00
Daniel 4102e371f5 🎨 Improve indexing 2025-01-11 16:50:08 +08:00