Commit Graph

151 Commits

Author SHA1 Message Date
Roman Perekhod 7175316292 fix the tgz mime type, bump reva 2023-11-21 17:33:52 +01:00
Roman Perekhod 8a6464798f fix last month search 2023-11-17 10:04:55 +01:00
Roman Perekhod 7ab553e23b add file type filter chip (#7602)
* add file type filter chip

* changed the keyword

* use reva issue-7432-replace

* changed the filter name. fix types

* rework mapBinary

---------

Co-authored-by: Roman Perekhod <rperekhod@owncloud.com>
2023-11-13 18:04:17 +01:00
Florian Schade 643158b67b enhancement: add sharedWithMe graph beta endpoint (#7633) 2023-11-08 20:02:58 +01:00
Dominik Schmidt db32fb46f9 Audio Metadata (#7490)
* Add audio facet to search protobuf message

* Add audio metadata to search index

* Return audio facet from search if available

* Store audio metadata in arbitrary metadata

* Add audio facet to driveItems listings

* Make tests coding style more consistent

* Fix tests

* Add changelog

* Make valueToString code more defensive

* Log status code as well
2023-11-06 08:56:46 +01:00
Martin 4b86bd0921 [docs-only] Update search README.md (#7655)
References: #7553 (enhancement: improve content extraction stop word cleaning)

Making the term `stop word` and the use of the envvar more clear.
2023-11-03 14:46:02 +01:00
Florian Schade cdd2100b4b enhancement: improve content extraction stop word cleaning (#7553)
* enhancement: improve content extraction stop word cleaning

* fix: cleanup documentation

Co-authored-by: Martin <github@diemattels.at>

* fix: failing tika stop word unit tests

---------

Co-authored-by: Martin <github@diemattels.at>
2023-10-23 13:40:37 +02:00
Roman Perekhod acfae80b53 add last modified filter chip (#7455)
* add last modified filter chip

* Update add-last-modified-filter-chip.md

---------

Co-authored-by: Roman Perekhod <rperekhod@owncloud.com>
2023-10-19 18:25:01 +02:00
Christian Richter e56b23541a remove obsolete cli flags
Signed-off-by: Christian Richter <crichter@owncloud.com>
2023-10-11 16:31:10 +02:00
jkoberg f189b11ba9 default async uploads
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-10-05 15:33:42 +02:00
Jörn Friedrich Dreyer 3efe843742 prevent panic when user is nil
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-09-21 17:19:18 +02:00
Roman Perekhod 911ea1c0f6 fix kql-bleve search. wildcards are excluded 2023-09-15 17:14:59 +02:00
Florian Schade 0f2b2b9a94 [full-ci] enhancement: add support for natural language kql date ranges (#7263)
* enhancement: add more kql spec tests and simplify ast normalization

* enhancement: kql parser error if query starts with AND

* enhancement: add kql docs and support for date and time only dateTimeRestriction queries

* enhancement: add the ability to decide how kql nodes get connected

connecting nodes (with edges) seem straight forward when not using group, the default connection for nodes with the same node is always OR. THis only applies for first level nodes, for grouped nodes it is defined differently. The KQL docs are saying, nodes inside a grouped node, with the same key are connected by a AND edge.

* enhancement: explicit error handling for falsy group nodes and queries with leading binary operator

* enhancement: use optimized grammar for kql parser and toolify pigeon

* enhancement: simplify error handling

* fix: kql implicit 'AND' and 'OR' follows the ms html spec instead of the pdf spec

* enhancement: add support for natural language kql date queries

* enhancement: structure kql parser tests into logical clusters

* fix: time-range error naming
2023-09-15 11:31:41 +02:00
Florian Schade c0553c7273 [full-ci] enhancement: add more kql spec tests and simplify ast normalization (#7254)
* enhancement: add more kql spec tests and simplify ast normalization

* enhancement: kql parser error if query starts with AND

* enhancement: add kql docs and support for date and time only dateTimeRestriction queries

* enhancement: add the ability to decide how kql nodes get connected

connecting nodes (with edges) seem straight forward when not using group, the default connection for nodes with the same node is always OR. THis only applies for first level nodes, for grouped nodes it is defined differently. The KQL docs are saying, nodes inside a grouped node, with the same key are connected by a AND edge.

* enhancement: explicit error handling for falsy group nodes and queries with leading binary operator

* enhancement: use optimized grammar for kql parser and toolify pigeon

* enhancement: simplify error handling

* fix: kql implicit 'AND' and 'OR' follows the ms html spec instead of the pdf spec
2023-09-11 13:49:53 +02:00
Roman Perekhod 158f91b398 fix unary in the beginning 2023-09-07 14:38:26 +02:00
Florian Schade 844783b6f9 [full-ci] - use KQL as default search query language (#7212)
* enhancement: use kql as default search query language

* enhancement: add support for unicode search queries

* fix: escape bleve field query whitespace

* fix: search related acceptance tests

* enhancement: remove legacy search query language

* enhancement: add support for kql dateTime restriction node types

* chore: bump web to v8.0.0-alpha.2

* fix: failing search api test

* enhancement: search bleve query compiler use DateRangeQuery as DateTimeNode counterpart

* enhancement: support for colon operators in dateTime kql queries
2023-09-07 11:13:33 +02:00
Florian Schade 0ec78ee7bb fix: failing tests and filter out specific matches 2023-09-01 12:07:56 +02:00
Florian Schade a0f2adedb5 fix: acceptance tests to include path resource 2023-09-01 12:07:47 +02:00
Florian Schade af9556f8f1 fix: search mount point inclusion 2023-09-01 12:07:38 +02:00
Florian Schade b7f42004bc fix: search share expost 2023-09-01 12:07:31 +02:00
jkoberg bd716156fc let ocis init set the serviceaccounts
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-08-31 12:11:44 +02:00
jkoberg d8c2957c84 use service accounts for search
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-08-31 12:11:43 +02:00
Florian Schade ed0dbce978 enhancement: Keyword Query Language (KQL) search syntax support (#7043)
* feat(search): introduce search query package

With the increasing complexity of how we organize our resources, the search must also be able to find them using entity properties.

The query package provides the necessary functionality to do this.

This makes it possible to search for resources via KQL, the microsoft spec is largely covered and can be used for this.

In the current state, the legacy query language is still used, in a future update this will be deprecated and KQL will become the standard
2023-08-28 16:41:36 +02:00
Daniel Swärd 49fc22d532 Add missing tracing references to multiple services. (#7110) 2023-08-23 15:17:17 +02:00
Christian Richter d7139d4127 remove deprecated variables
Signed-off-by: Christian Richter <crichter@owncloud.com>
2023-08-22 17:25:24 +02:00
jkoberg 49cdcad129 unify eventstream creation
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-08-16 10:14:12 +02:00
Daniël Franke 952ebe7d7d Pass context to event publishing.
To allow tracing propagation via events, we need to pass the context
to the `Publish` function of reva events. This adds the context
everywhere where events are published. If there was no context to pass,
we started a new one with `context.Background()`.
2023-08-11 12:01:19 +02:00
Roman Perekhod b879254fcb Fix the search 2023-08-03 17:02:25 +02:00
Daniel Swärd 6a5e21eff4 Replacing implicit grpc client initialization with explicit package local variables. 2023-07-31 12:57:59 +02:00
Daniel Swärd 82034d34ce Separate out grpc client to package local for search service. 2023-07-28 09:42:37 +02:00
Daniël Franke e2fa2be973 Convert search service to use service tracing.
This converts the search service to use the service tracer.
It also initialises the grpc service with a trace provider.
2023-07-25 11:22:51 +02:00
Jörn Friedrich Dreyer 6bb265fcf0 use correct config struct for jwt token (#6761)
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-07-14 13:22:46 +02:00
Roman Perekhod 99b8cdc7d6 fix the total count 2023-07-12 18:13:58 +02:00
André Duffeck 1aa114c336 Remove false condition 2023-07-12 18:01:06 +02:00
André Duffeck 4bb10ebdf3 Support scoping searches in shares 2023-07-12 18:01:06 +02:00
Roman Perekhod 3487749509 Provide Search filter for locations #OCIS-3705 2023-07-12 18:01:06 +02:00
Martin 721f4e8422 Merge pull request #6723 from owncloud/fix_loglevel_description
[docs-only] Increase readability for log level values in the description
2023-07-07 17:06:38 +02:00
André Duffeck ec8a260119 Handle shares received from project spaces.
Unfortunately searching these kinds of shares can't be fully fixed until
the service accounts have been implemented.
2023-07-07 12:48:00 +02:00
André Duffeck b2f1e849fd Use the owner auth to get the path of shared resources
This fixes searching received shares that were not shared from the space
root.
2023-07-07 10:46:53 +02:00
mmattel 6ad53971ef [docs-only] Increase readability for log level values in the description 2023-07-07 10:33:42 +02:00
mmattel d7b447b791 [docs-only] Increase readability for tracing values in the description 2023-07-07 09:50:39 +02:00
Daniël Franke e43001fb96 Pass context for reva bump.
Also refresh the generated code.
2023-07-03 11:08:45 +02:00
Florian Schade a26aea758a [full-ci] enhancement: add search result content preview and term highlighting. (#6634)
* enhancement: add search result content preview and term highlighting.

* chore: fix changelog

* noop

* enhancement: provide search highlight tests
2023-06-27 15:56:17 +02:00
Jörn Friedrich Dreyer 2ea3b8c400 unmarshal token to filter spaces for current user (#6596)
* unmarshal token to filter spaces for current user

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* Fix tests

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: André Duffeck <andre.duffeck@firondu.de>
2023-06-22 16:15:17 +02:00
Andre Duffeck 20252409ba Handle events asynchronously (#6584) 2023-06-22 09:23:49 +02:00
Andre Duffeck c81f423357 Merge pull request #6512 from aduffeck/fix-case-insensitivity
Always make Name and Tags queries case-insensitive
2023-06-20 08:39:50 +02:00
kobergj 384488b8c7 return permissions also for project spaces (#6528)
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-06-14 16:52:52 +02:00
André Duffeck 80c944b311 Fix: Always make Name and Tags queries case-insensitive 2023-06-13 14:16:38 +02:00
Florian Schade 4f26424db6 [full-ci] enhancement: use reva client pool selectors (#6452)
* enhancement: use reva client pool selectors

register mock service to registry and pass tests

* enhancement: bump reva

* Fix a couple of linter issues

---------

Co-authored-by: Ralf Haferkamp <rhaferkamp@owncloud.com>
2023-06-08 12:41:04 +02:00
Michael Barz 2215d7f5d1 fix search permissions 2023-06-05 18:16:10 +02:00