Commit Graph

21974 Commits

Author SHA1 Message Date
fschade
f615ccc896 enhancement(search): implement batch api 2025-09-02 13:06:08 +02:00
fschade
82e75e19c1 enhancement(search): move bleve engine into its own package and clean up the search batch processing implementation 2025-08-28 15:53:29 +02:00
André Duffeck
1003734b45 Use batches when restoring or moving items 2025-08-28 15:50:44 +02:00
André Duffeck
9f9e03794d Do not intertwine different batch operations 2025-08-28 15:50:44 +02:00
Florian Schade
3164fb2474 Merge pull request #1290 from fschade/search-opensearch
Search-service: add opensearch as distributed search backend
2025-08-28 15:26:55 +02:00
fschade
ca0493b286 enhancement(search): add support for testcontainers to run local tests 2025-08-28 09:32:26 +02:00
fschade
ad866b8ce3 refactor(search): unify osu request and params naming 2025-08-28 09:32:05 +02:00
fschade
8c509263b7 refactor(search): simplify osu builder interface and make use of a base for the requests 2025-08-28 09:32:05 +02:00
fschade
7fe5383d61 refactor(search): rename test-testdata helper 2025-08-28 09:32:05 +02:00
fschade
8d850b1f4a refactor(search): move index management from the osu to the opensearch package 2025-08-28 09:32:05 +02:00
fschade
e00fdc6ba3 refactor(search): remove samber/lo 2025-08-28 09:32:05 +02:00
fschade
42b794e01a refactor(search): cleanup for review 2025-08-28 09:32:05 +02:00
fschade
8795284a76 fix(search): potential nil slice entries 2025-08-28 09:32:05 +02:00
fschade
f3750f32c9 refactor(search):
- introduce path_hierarchy analyzer and tokenizer
- optimize performance by using the os painless script api to restore, purge and delete documents
2025-08-28 09:32:05 +02:00
fschade
a9d21bbb15 enhancement(search): allow to set the resource index name 2025-08-28 09:32:05 +02:00
fschade
1586f7fcbb enhancement(search): implement index manager and remove the use of index templates 2025-08-28 09:32:04 +02:00
fschade
9faa09e4c6 enhancement(search): implement search match highlighting for the content field 2025-08-28 09:31:38 +02:00
fschade
85e436b2bb fix(search): open-search engine interface compatibility 2025-08-28 09:31:38 +02:00
fschade
d605db8604 chore(search): add vendor dependencies 2025-08-28 09:31:36 +02:00
fschade
63e71b5bc4 enhancement(search): allow to configure open-search as search backend 2025-08-28 09:30:59 +02:00
fschade
2857e54975 fix(search): use recursion to request more search results if the searchResponse results are paginated 2025-08-28 09:30:59 +02:00
fschade
d761e8b3f0 enhancement(search): implement search backend recursive move and update restore and delete to be recursive too 2025-08-28 09:30:59 +02:00
fschade
f6144e6cdd enhancement(search): implement kql ast expansion helper and remove similar parts from the to os dsl query transpiler 2025-08-28 09:30:59 +02:00
fschade
d97b2a6410 enhancement(search): implement kql NOT operator to os dsl bool-query MUST_NOT 2025-08-28 09:30:59 +02:00
fschade
3401f49a8c enhancement(search): implement kql bool to os dsl term-query 2025-08-28 09:30:59 +02:00
fschade
d4183807dc enhancement(search): implement kql to os dsl range-query 2025-08-28 09:30:59 +02:00
fschade
48705c79f6 enhancement(search): implement os dsl range field 2025-08-28 09:30:59 +02:00
fschade
1c92f3db00 fix(search): implement support for versioned os index templates 2025-08-28 09:30:59 +02:00
fschade
a7d4ff4872 enhancement(search): group opensearch related files together, housekeeping 2025-08-28 09:30:59 +02:00
fschade
5abfd1744e enhancement(search): implement cluster health checks 2025-08-28 09:30:59 +02:00
fschade
1236cedacc enhancement(search): implementation that the search ignores resources marked as deleted 2025-08-28 09:30:59 +02:00
fschade
2d325d70b8 enhancement(search): implement search engine match to pg-hit conversion 2025-08-28 09:30:59 +02:00
fschade
f118e0d2c3 enhancement(search): implement kql to os dsl wildcard-query 2025-08-28 09:30:59 +02:00
fschade
2c316ea225 enhancement(search): implement kql string to os dsl match-phrase-query 2025-08-28 09:30:59 +02:00
fschade
4d5a5dde4b enhancement(search): implement non bool query compilation 2025-08-28 09:30:59 +02:00
fschade
098a220626 enhancement(search): implement kql to os dsl structure compilation and add basic tests 2025-08-28 09:30:59 +02:00
fschade
37d8b1d608 enhancement(search): implement engine search skeleton 2025-08-28 09:30:59 +02:00
fschade
492340f6f7 enhancement(search): implement engine docCount 2025-08-28 09:30:59 +02:00
fschade
bd5dec7327 enhancement(search): implement engine restore 2025-08-28 09:30:59 +02:00
fschade
59b6788b28 enhancement(search): implement engine delete 2025-08-28 09:30:59 +02:00
fschade
c18bfad222 enhancement(search): implement engine purge 2025-08-28 09:30:59 +02:00
fschade
4ad3865d52 enhancement(search): prepare opensearch integration 2025-08-28 09:30:59 +02:00
Christian Richter
60aa99ab8b Merge pull request #1344 from dragonchaser/user-soft-delet
initial skel for user soft delete
2025-08-27 16:42:50 +02:00
Christian Richter
f524d5de91 bump reva
Signed-off-by: Christian Richter <c.richter@opencloud.eu>
2025-08-27 10:36:13 +02:00
Christian Richter
19141c2b71 add user soft delete
Signed-off-by: Christian Richter <c.richter@opencloud.eu>
2025-08-27 10:36:12 +02:00
Ralf Haferkamp
2a76fc22be Merge pull request #1401 from opencloud-eu/dependabot/go_modules/github.com/nats-io/nats.go-1.45.0
build(deps): bump github.com/nats-io/nats.go from 1.44.0 to 1.45.0
2025-08-27 08:02:48 +02:00
Ralf Haferkamp
5821fbde9b Merge pull request #1400 from opencloud-eu/dependabot/go_modules/github.com/stretchr/testify-1.11.0
build(deps): bump github.com/stretchr/testify from 1.10.0 to 1.11.0
2025-08-27 08:02:13 +02:00
dependabot[bot]
f3dd516351 build(deps): bump github.com/nats-io/nats.go from 1.44.0 to 1.45.0
Bumps [github.com/nats-io/nats.go](https://github.com/nats-io/nats.go) from 1.44.0 to 1.45.0.
- [Release notes](https://github.com/nats-io/nats.go/releases)
- [Commits](https://github.com/nats-io/nats.go/compare/v1.44.0...v1.45.0)

---
updated-dependencies:
- dependency-name: github.com/nats-io/nats.go
  dependency-version: 1.45.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-08-26 22:00:57 +00:00
dependabot[bot]
df5a99af37 build(deps): bump github.com/stretchr/testify from 1.10.0 to 1.11.0
Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify) from 1.10.0 to 1.11.0.
- [Release notes](https://github.com/stretchr/testify/releases)
- [Commits](https://github.com/stretchr/testify/compare/v1.10.0...v1.11.0)

---
updated-dependencies:
- dependency-name: github.com/stretchr/testify
  dependency-version: 1.11.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-08-26 21:44:40 +00:00
Artur Neumann
2b430baa58 Merge pull request #1398 from opencloud-eu/watchfsinCI
[full-ci] run tests with STORAGE_USES_POSIX_WATCH_FS
2025-08-26 17:47:06 +05:45