Commit Graph

246 Commits

Author SHA1 Message Date
fschade 2857e54975 fix(search): use recursion to request more search results if the searchResponse results are paginated 2025-08-28 09:30:59 +02:00
fschade d761e8b3f0 enhancement(search): implement search backend recursive move and update restore and delete to be recursive too 2025-08-28 09:30:59 +02:00
fschade f6144e6cdd enhancement(search): implement kql ast expansion helper and remove similar parts from the to os dsl query transpiler 2025-08-28 09:30:59 +02:00
fschade d97b2a6410 enhancement(search): implement kql NOT operator to os dsl bool-query MUST_NOT 2025-08-28 09:30:59 +02:00
fschade 3401f49a8c enhancement(search): implement kql bool to os dsl term-query 2025-08-28 09:30:59 +02:00
fschade d4183807dc enhancement(search): implement kql to os dsl range-query 2025-08-28 09:30:59 +02:00
fschade 48705c79f6 enhancement(search): implement os dsl range field 2025-08-28 09:30:59 +02:00
fschade 1c92f3db00 fix(search): implement support for versioned os index templates 2025-08-28 09:30:59 +02:00
fschade a7d4ff4872 enhancement(search): group opensearch related files together, housekeeping 2025-08-28 09:30:59 +02:00
fschade 5abfd1744e enhancement(search): implement cluster health checks 2025-08-28 09:30:59 +02:00
fschade 1236cedacc enhancement(search): implementation that the search ignores resources marked as deleted 2025-08-28 09:30:59 +02:00
fschade 2d325d70b8 enhancement(search): implement search engine match to pg-hit conversion 2025-08-28 09:30:59 +02:00
fschade f118e0d2c3 enhancement(search): implement kql to os dsl wildcard-query 2025-08-28 09:30:59 +02:00
fschade 2c316ea225 enhancement(search): implement kql string to os dsl match-phrase-query 2025-08-28 09:30:59 +02:00
fschade 4d5a5dde4b enhancement(search): implement non bool query compilation 2025-08-28 09:30:59 +02:00
fschade 098a220626 enhancement(search): implement kql to os dsl structure compilation and add basic tests 2025-08-28 09:30:59 +02:00
fschade 37d8b1d608 enhancement(search): implement engine search skeleton 2025-08-28 09:30:59 +02:00
fschade 492340f6f7 enhancement(search): implement engine docCount 2025-08-28 09:30:59 +02:00
fschade bd5dec7327 enhancement(search): implement engine restore 2025-08-28 09:30:59 +02:00
fschade 59b6788b28 enhancement(search): implement engine delete 2025-08-28 09:30:59 +02:00
fschade c18bfad222 enhancement(search): implement engine purge 2025-08-28 09:30:59 +02:00
fschade 4ad3865d52 enhancement(search): prepare opensearch integration 2025-08-28 09:30:59 +02:00
Jörn Friedrich Dreyer 2c3ee68f08 ack tag events
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2025-08-20 14:43:46 +02:00
André Duffeck 7c59e57d43 Make batch size configurable 2025-08-04 16:14:56 +02:00
André Duffeck 7a7d148dcf Fix tests 2025-08-04 15:39:27 +02:00
André Duffeck 3c8e2dacfd Improve indexing performance using batches 2025-08-04 15:15:54 +02:00
André Duffeck 1afc1331af Do not run the timout func if the work func has run 2025-08-01 10:03:56 +02:00
André Duffeck 4bafe2e611 Make sure to register prometheus collectors only once 2025-07-31 08:55:10 +02:00
André Duffeck b4cc781832 Do not try to log metrics when we failed to get the consumer info
Fixes #1285
2025-07-29 14:19:00 +02:00
André Duffeck dbd6a4db71 Fix tests 2025-07-17 16:00:11 +02:00
André Duffeck 791b4df173 Collect metrics about search and index durations 2025-07-17 15:23:57 +02:00
André Duffeck 273c0ed270 Expose nats metris for the postprocessing service 2025-07-17 15:23:57 +02:00
André Duffeck 400b9a5d30 Expose nats metrics of the search service 2025-07-17 14:33:23 +02:00
André Duffeck e92f7c9086 Fix tests 2025-07-16 10:29:34 +02:00
André Duffeck 4998e1e09f Inject a stream into HandleEvents to increase testability 2025-07-16 10:29:34 +02:00
André Duffeck e21fe7a4fe Expose the MaxAckPending and AckWait settings for the search service 2025-07-15 09:57:19 +02:00
André Duffeck 608af81913 Switch to the raw nats consumer instead of the go-micro events
This allows more direct control of the nats events. As a first step
we'll now acknowledge events manually, but in the future we'll add
metrics etc. to gain more insight into the queues.
2025-07-15 09:57:19 +02:00
Jörn Friedrich Dreyer cf916b8a2c fix ready checks
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2025-07-14 14:12:40 +02:00
06kellyjac 2a3a20693a build: Modify mockery config to work with v3
Maintaining the positioning of the files from v2 to reduce cognitive
load.
Indentation of yaml files now matches `.editorconfig`.
All mock files regenerated.
Added empty `{}` following convention from `mockery init` etc.
Removed directory specification where it would already match.
2025-06-19 16:25:39 +01:00
Ralf Haferkamp 96684df32d Adjust to new tablewriter release 2025-05-19 19:26:38 +02:00
Ralf Haferkamp 3dc9c0cb9a Switch to opencloud-eu fork of libre-graph-api-go 2025-05-15 14:11:35 +02:00
Jörn Friedrich Dreyer 3c38a3e3ed fix mockery warnings
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2025-04-29 11:01:17 +02:00
Jörn Friedrich Dreyer f0e62323cb update generated code
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2025-03-27 10:06:45 +01:00
Ralf Haferkamp c46e0c4b6b Fix build with go 1.24
Go 1.24 does some stricter checks now on arguments to functions
accepting format strings.
This commit fixes a couple of "non-constant format string in call
to ..." errors when running the unit tests.
2025-03-10 10:43:34 +01:00
Ralf Haferkamp 2678d0bb89 Bump mockery to 2.53.0
Should fix build on go1.24. Also fix ci-go-generate step in multiarch
Dockerfile.

Closes: #289
2025-03-03 16:02:59 +01:00
Ralf Haferkamp 8e1f68f315 Reset 'introductionVersion" struct tag to 1.0.0 2025-02-24 11:40:33 +01:00
Klaas Freitag 669ad7c769 Rename demo users
See https://github.com/opencloud-eu/internal/issues/42
2025-01-28 18:03:12 +01:00
André Duffeck e8d35e1280 Use the opencloud reva from now on 2025-01-21 11:16:38 +01:00
André Duffeck 6bab922c7c Rebrand search 2025-01-17 09:25:36 +01:00
Andre Duffeck 9a04b12a8e Merge pull request #44 from opencloud-eu/nats-cluster-name
nats cluster name
2025-01-17 08:51:35 +01:00