Commit Graph

121 Commits

Author SHA1 Message Date
jkoberg
bd716156fc let ocis init set the serviceaccounts
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-08-31 12:11:44 +02:00
jkoberg
d8c2957c84 use service accounts for search
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-08-31 12:11:43 +02:00
Florian Schade
ed0dbce978 enhancement: Keyword Query Language (KQL) search syntax support (#7043)
* feat(search): introduce search query package

With the increasing complexity of how we organize our resources, the search must also be able to find them using entity properties.

The query package provides the necessary functionality to do this.

This makes it possible to search for resources via KQL, the microsoft spec is largely covered and can be used for this.

In the current state, the legacy query language is still used, in a future update this will be deprecated and KQL will become the standard
2023-08-28 16:41:36 +02:00
Daniel Swärd
49fc22d532 Add missing tracing references to multiple services. (#7110) 2023-08-23 15:17:17 +02:00
Christian Richter
d7139d4127 remove deprecated variables
Signed-off-by: Christian Richter <crichter@owncloud.com>
2023-08-22 17:25:24 +02:00
jkoberg
49cdcad129 unify eventstream creation
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-08-16 10:14:12 +02:00
Daniël Franke
952ebe7d7d Pass context to event publishing.
To allow tracing propagation via events, we need to pass the context
to the `Publish` function of reva events. This adds the context
everywhere where events are published. If there was no context to pass,
we started a new one with `context.Background()`.
2023-08-11 12:01:19 +02:00
Roman Perekhod
b879254fcb Fix the search 2023-08-03 17:02:25 +02:00
Daniel Swärd
6a5e21eff4 Replacing implicit grpc client initialization with explicit package local variables. 2023-07-31 12:57:59 +02:00
Daniel Swärd
82034d34ce Separate out grpc client to package local for search service. 2023-07-28 09:42:37 +02:00
Daniël Franke
e2fa2be973 Convert search service to use service tracing.
This converts the search service to use the service tracer.
It also initialises the grpc service with a trace provider.
2023-07-25 11:22:51 +02:00
Jörn Friedrich Dreyer
6bb265fcf0 use correct config struct for jwt token (#6761)
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-07-14 13:22:46 +02:00
Roman Perekhod
99b8cdc7d6 fix the total count 2023-07-12 18:13:58 +02:00
André Duffeck
1aa114c336 Remove false condition 2023-07-12 18:01:06 +02:00
André Duffeck
4bb10ebdf3 Support scoping searches in shares 2023-07-12 18:01:06 +02:00
Roman Perekhod
3487749509 Provide Search filter for locations #OCIS-3705 2023-07-12 18:01:06 +02:00
Martin
721f4e8422 Merge pull request #6723 from owncloud/fix_loglevel_description
[docs-only] Increase readability for log level values in the description
2023-07-07 17:06:38 +02:00
André Duffeck
ec8a260119 Handle shares received from project spaces.
Unfortunately searching these kinds of shares can't be fully fixed until
the service accounts have been implemented.
2023-07-07 12:48:00 +02:00
André Duffeck
b2f1e849fd Use the owner auth to get the path of shared resources
This fixes searching received shares that were not shared from the space
root.
2023-07-07 10:46:53 +02:00
mmattel
6ad53971ef [docs-only] Increase readability for log level values in the description 2023-07-07 10:33:42 +02:00
mmattel
d7b447b791 [docs-only] Increase readability for tracing values in the description 2023-07-07 09:50:39 +02:00
Daniël Franke
e43001fb96 Pass context for reva bump.
Also refresh the generated code.
2023-07-03 11:08:45 +02:00
Florian Schade
a26aea758a [full-ci] enhancement: add search result content preview and term highlighting. (#6634)
* enhancement: add search result content preview and term highlighting.

* chore: fix changelog

* noop

* enhancement: provide search highlight tests
2023-06-27 15:56:17 +02:00
Jörn Friedrich Dreyer
2ea3b8c400 unmarshal token to filter spaces for current user (#6596)
* unmarshal token to filter spaces for current user

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* Fix tests

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: André Duffeck <andre.duffeck@firondu.de>
2023-06-22 16:15:17 +02:00
Andre Duffeck
20252409ba Handle events asynchronously (#6584) 2023-06-22 09:23:49 +02:00
Andre Duffeck
c81f423357 Merge pull request #6512 from aduffeck/fix-case-insensitivity
Always make Name and Tags queries case-insensitive
2023-06-20 08:39:50 +02:00
kobergj
384488b8c7 return permissions also for project spaces (#6528)
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-06-14 16:52:52 +02:00
André Duffeck
80c944b311 Fix: Always make Name and Tags queries case-insensitive 2023-06-13 14:16:38 +02:00
Florian Schade
4f26424db6 [full-ci] enhancement: use reva client pool selectors (#6452)
* enhancement: use reva client pool selectors

register mock service to registry and pass tests

* enhancement: bump reva

* Fix a couple of linter issues

---------

Co-authored-by: Ralf Haferkamp <rhaferkamp@owncloud.com>
2023-06-08 12:41:04 +02:00
Michael Barz
2215d7f5d1 fix search permissions 2023-06-05 18:16:10 +02:00
jkoberg
d347448ec0 remove duplicated sutureservice code
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-06-02 12:02:27 +02:00
Andre Duffeck
c0665975b3 Do not try to fulltext-index large files. (#6395)
* Do not try to extract the content of large files.

Both tika and ocis do not handle large files/archives very well.

* Apply suggestions from code review

Co-authored-by: Martin <github@diemattels.at>

---------

Co-authored-by: Martin <github@diemattels.at>
2023-05-27 19:03:58 +02:00
jkoberg
70391a0bf2 unify CACERT envvars
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-05-25 13:32:37 +02:00
André Duffeck
e1279da025 Do not mess with non-lowercased fields 2023-05-25 10:55:52 +02:00
André Duffeck
f033182e09 Log search durations 2023-05-24 13:12:41 +02:00
André Duffeck
cfb0152372 Fix boolean queries 2023-05-24 12:01:35 +02:00
André Duffeck
b1bfb93230 Fix test expectations 2023-05-24 12:01:35 +02:00
André Duffeck
e8c9d16576 Do not choke on : searches
Fixes #4744
2023-05-24 12:01:35 +02:00
André Duffeck
9fe1225b53 Make field base search case insensitive
Fixes part of #6366
2023-05-24 12:01:35 +02:00
André Duffeck
6275b7b124 Do not include full-text and tag data in the composite field
This commit removes the full-text and tag data from the composite field
("_all") which can be used for default term queries which we don't do
anyways.
2023-05-19 16:13:30 +02:00
André Duffeck
55a6716d49 Trigger a space reindex when the space has been renamed
Fixes #6289 (in combination with https://github.com/cs3org/reva/pull/3889)
2023-05-15 16:21:53 +02:00
André Duffeck
e9d4e07a08 constify the "trashed" space state 2023-05-12 10:37:43 +02:00
André Duffeck
82590632b6 Always use UTC for doc timestamps 2023-05-12 10:37:43 +02:00
André Duffeck
e01ef9b8c6 Search spaces concurrently 2023-05-12 10:37:43 +02:00
André Duffeck
a9b139af97 Do not consider disabled spaces during search
Fixes #6201
2023-05-12 10:37:43 +02:00
André Duffeck
63b2ac2368 Do not use prefix queries which gets slow with big indexes
Co-authored-by: Florian Schade <f.schade@icloud.com>
2023-05-12 10:37:43 +02:00
André Duffeck
ca637de017 Fix detecting resources that haven't changed when reindexing spaces
This is a regression introduced with the experimental search backport.
2023-04-19 17:44:16 +02:00
mmattel
8ed34926ef [docs-only] Correct the removal version according semver to 4.0.0 2023-04-19 10:16:06 +02:00
Daniel Swärd
46e50b3a70 Reapply name change, without adding files by mistake. 2023-04-05 13:26:29 +02:00
Daniel Swärd
a693a18b99 Revert "Change new name to address PR comment."
This reverts commit 8911ca2e98.
2023-04-05 13:25:04 +02:00