Commit Graph

20 Commits

Author SHA1 Message Date
Yang Luo abae92b963 Add size to vector 2023-10-01 10:05:52 +08:00
Yang Luo 4426466d4f Check vector length in getNearestVectors() 2023-09-30 19:15:12 +08:00
Yang Luo b7acf39c17 Check vector's embedding provider 2023-09-30 19:06:19 +08:00
Yang Luo e6ff917c40 Skip existing items in RefreshStoreVectors() 2023-09-30 18:06:11 +08:00
Yang Luo 2c1a616ad6 Get top 5 knowlesge 2023-09-30 16:54:57 +08:00
Yang Luo cdf5fcbfd8 Add fields to vector 2023-09-30 13:31:15 +08:00
yehong 28f752c1a5 feat: support HNSW vector search algorithm (#646)
Signed-off-by: yehong <239859435@qq.com>
2023-09-24 00:36:18 +08:00
Yang Luo 2b6a69ce0c Add local file system storage provider 2023-09-17 18:24:34 +08:00
Yang Luo 6d7921a669 Add queryVectorSafe() 2023-09-10 00:53:04 +08:00
Yang Luo 2c8f6ac553 Add embedding provider 2023-09-10 00:38:21 +08:00
Yang Luo 12acd815d7 Refactor out vector_util.go 2023-09-09 22:50:56 +08:00
Yang Luo 2ab7e3011b Rename pkg to model 2023-09-09 22:39:00 +08:00
Yang Luo c47736c11c Add GetSupportedFileTypes() 2023-09-09 22:37:07 +08:00
Kelvin Chiu c5828138cc feat: refactor text extractor (#624) 2023-09-09 22:13:34 +08:00
Yang Luo f0fa71f141 Improve addVectorsForStore() 2023-09-07 23:55:53 +08:00
Yang Luo ec9bcb6d78 Refactor to addVectorsForStore() 2023-09-07 23:05:20 +08:00
Kelvin Chiu d940bab0f5
feat: support .docx, .pdf file parsing (#614)
* feat: add .pdf\.docx text extraction

* feat: add .pdf\.docx text extraction
2023-08-27 15:02:20 +08:00
Kelvin Chiu 83a4697c9d fix: update knowledge retrieval function (#609)
* fix: fix redirect not working error

* feat: update knowledge retrieval function

* fix: optimized the logic of retrieve function
2023-08-15 15:34:10 +08:00
Yang Luo 66a5021eb7 Improve filterTextFiles() 2023-08-14 02:47:44 +08:00
Kelvin Chiu 737dd4df4e feat: add refresh store vectors (#608)
* feat: add refresh store vectors

* fix: clean the object.Url from casdoorsdk
2023-08-14 02:26:25 +08:00