Commit Graph

182 Commits

Author SHA1 Message Date
Viktor Scharf
eb5a9ceade Merge pull request #9442 from owncloud/full-deployment
 [docs-only] feat: create ocis_full compose deployment
2024-06-28 12:50:56 +02:00
Michael Barz
fd3178c4b3 docs: cleanup docs 2024-06-27 14:34:34 +02:00
jkoberg
01cdc153a5 docu(search): update index spaces command docu
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-06-27 14:22:01 +02:00
jkoberg
4e28fc45dc feat(search): allow indexing all spaces
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-06-25 10:01:37 +02:00
jkoberg
63686d6cd7 feat(search): remove userid from indexspace methods
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-06-25 10:01:37 +02:00
jkoberg
7a819412c2 feat(ocis): move ast and kql pkg to ocis-pkg
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-06-24 16:23:55 +02:00
Roman Perekhod
e3f6f3ee1d The hidden shares have been excluded from a search result 2024-06-18 09:11:31 +02:00
Benedikt Kulmann
21a9992980 feat: add image and photo metadata to search (#8504)
* feat: add image and photo metadata to search
2024-05-21 10:21:15 +02:00
Jannik Stehle
d40a643fbf feat: add remote item id to search report responses
Adds the remote item id to search `REPORT` responses for shared resources and resources that are part of such. This id represents the id of the original resource that has been shared (= the remote item) and is needed for clients to correctly resolve their locations.
2024-05-15 11:26:43 +02:00
Thomas Müller
a8cbc612cc chore: remove unused return value from BindSourcesToStructs (#9033) 2024-04-30 18:18:31 +02:00
Jörn Friedrich Dreyer
e41472234f log and trace fixes
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2024-04-26 17:03:49 +02:00
Thomas Müller
07f0cd5574 fix: typos, naming clashes, error messages and deprecations 2024-04-03 15:34:36 +02:00
Phil Davis
63a6f10c4b chore: set introductionVersion 5.0 in services/search 2024-03-06 17:50:21 +05:45
Phil Davis
9d2be66a85 chore: add introductionVersion pre5.0 to environment variable docs 2024-03-06 17:50:20 +05:45
Florian Schade
6814c61506 [full-ci] enhancement: allow ocis to provide custom web applications (#8523)
* enhancement: allow ocis to provide custom web applications

* enhancement: add an option to disable web apps

* test: add default logger tests

* test: add app loading tests

* test: add asset server tests

* enhancement: make use of dedicated app conf file and app asset paths

* enhancement: adjust asset locations and deprecate WEB_ASSET_PATH

* enhancement: get rid of default logger and use the service level logger instead

* Apply suggestions from code review

Co-authored-by: Benedikt Kulmann <benedikt@kulmann.biz>
Co-authored-by: kobergj <juliankoberg@googlemail.com>

* enhancement: use basename as app id

* Apply suggestions from code review

Co-authored-by: Martin <github@diemattels.at>

* enhancement: use afero as fs abstraction

* enhancement: simplify logo upload

* enhancement: make use of introductionVersion field annotations

---------

Co-authored-by: Benedikt Kulmann <benedikt@kulmann.biz>
Co-authored-by: kobergj <juliankoberg@googlemail.com>
Co-authored-by: Martin <github@diemattels.at>
2024-03-05 14:11:18 +01:00
Jörn Friedrich Dreyer
972adafd29 verify all system accounts are set
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2024-02-29 15:51:37 +01:00
Ralf Haferkamp
3d3f8949f5 Bump mockery to 2.40.2
to address issues when building with go1.22:
https://github.com/vektra/mockery/pull/753
2024-02-09 11:48:45 +01:00
Roman Perekhod
17a799c1fa fix search response 2024-02-09 09:39:07 +01:00
Jörn Friedrich Dreyer
fad94d2038 bump mockery, add test stub for oidc_auth.go, align mock generation (#8321)
* bump mockery, add test stub for oidc_auth.go

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* use .mockery.yaml for all mocks

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* drop legacy go:generate mockery

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* align mock placement

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2024-02-01 10:07:44 +01:00
jkoberg
b8b0d0b533 cleanup search/.../search.go
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-01-17 13:30:08 +01:00
André Duffeck
4b89ede756 Do not error-log when outdated resources can't be indexed anymore
That's an expected, totally valid case
2024-01-15 14:46:39 +01:00
Roman Perekhod
fd388653a9 the race conditions in tests 2024-01-04 13:14:42 +01:00
jkoberg
e1fad5c6e9 make nats-js-kv the default registry
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-12-19 12:13:28 +01:00
jkoberg
3e55223f2d allow authentication for events
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-12-19 10:44:05 +01:00
kobergj
377a23ee7d Non-durable SSE streams (#7986)
* make sse streams non-durable

Signed-off-by: jkoberg <jkoberg@owncloud.com>

* bump reva

Signed-off-by: jkoberg <jkoberg@owncloud.com>

---------

Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-12-18 11:47:25 +01:00
Dominik Schmidt
7dd99cfa69 feat(location): add bleve test 2023-12-06 15:13:09 +01:00
Dominik Schmidt
7f83b5020d feat(location): add tika test 2023-12-06 15:13:09 +01:00
Dominik Schmidt
4c27b365fa feat(graph): add location facet to driveItems 2023-12-06 15:13:09 +01:00
Dominik Schmidt
07edd1e23a chore(search): move audio metadata extraction in tika to dedicated method 2023-12-06 15:13:09 +01:00
kobergj
9057d231a8 fix search service startup (#7795)
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-11-24 08:35:10 +01:00
Christian Richter
1cdd839fc7 add form mime type
Signed-off-by: Christian Richter <crichter@owncloud.com>
2023-11-22 11:37:53 +01:00
Roman Perekhod
7175316292 fix the tgz mime type, bump reva 2023-11-21 17:33:52 +01:00
Roman Perekhod
8a6464798f fix last month search 2023-11-17 10:04:55 +01:00
Roman Perekhod
7ab553e23b add file type filter chip (#7602)
* add file type filter chip

* changed the keyword

* use reva issue-7432-replace

* changed the filter name. fix types

* rework mapBinary

---------

Co-authored-by: Roman Perekhod <rperekhod@owncloud.com>
2023-11-13 18:04:17 +01:00
Florian Schade
643158b67b enhancement: add sharedWithMe graph beta endpoint (#7633) 2023-11-08 20:02:58 +01:00
Dominik Schmidt
db32fb46f9 Audio Metadata (#7490)
* Add audio facet to search protobuf message

* Add audio metadata to search index

* Return audio facet from search if available

* Store audio metadata in arbitrary metadata

* Add audio facet to driveItems listings

* Make tests coding style more consistent

* Fix tests

* Add changelog

* Make valueToString code more defensive

* Log status code as well
2023-11-06 08:56:46 +01:00
Martin
4b86bd0921 [docs-only] Update search README.md (#7655)
References: #7553 (enhancement: improve content extraction stop word cleaning)

Making the term `stop word` and the use of the envvar more clear.
2023-11-03 14:46:02 +01:00
Florian Schade
cdd2100b4b enhancement: improve content extraction stop word cleaning (#7553)
* enhancement: improve content extraction stop word cleaning

* fix: cleanup documentation

Co-authored-by: Martin <github@diemattels.at>

* fix: failing tika stop word unit tests

---------

Co-authored-by: Martin <github@diemattels.at>
2023-10-23 13:40:37 +02:00
Roman Perekhod
acfae80b53 add last modified filter chip (#7455)
* add last modified filter chip

* Update add-last-modified-filter-chip.md

---------

Co-authored-by: Roman Perekhod <rperekhod@owncloud.com>
2023-10-19 18:25:01 +02:00
Christian Richter
e56b23541a remove obsolete cli flags
Signed-off-by: Christian Richter <crichter@owncloud.com>
2023-10-11 16:31:10 +02:00
jkoberg
f189b11ba9 default async uploads
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-10-05 15:33:42 +02:00
Jörn Friedrich Dreyer
3efe843742 prevent panic when user is nil
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-09-21 17:19:18 +02:00
Roman Perekhod
911ea1c0f6 fix kql-bleve search. wildcards are excluded 2023-09-15 17:14:59 +02:00
Florian Schade
0f2b2b9a94 [full-ci] enhancement: add support for natural language kql date ranges (#7263)
* enhancement: add more kql spec tests and simplify ast normalization

* enhancement: kql parser error if query starts with AND

* enhancement: add kql docs and support for date and time only dateTimeRestriction queries

* enhancement: add the ability to decide how kql nodes get connected

connecting nodes (with edges) seem straight forward when not using group, the default connection for nodes with the same node is always OR. THis only applies for first level nodes, for grouped nodes it is defined differently. The KQL docs are saying, nodes inside a grouped node, with the same key are connected by a AND edge.

* enhancement: explicit error handling for falsy group nodes and queries with leading binary operator

* enhancement: use optimized grammar for kql parser and toolify pigeon

* enhancement: simplify error handling

* fix: kql implicit 'AND' and 'OR' follows the ms html spec instead of the pdf spec

* enhancement: add support for natural language kql date queries

* enhancement: structure kql parser tests into logical clusters

* fix: time-range error naming
2023-09-15 11:31:41 +02:00
Florian Schade
c0553c7273 [full-ci] enhancement: add more kql spec tests and simplify ast normalization (#7254)
* enhancement: add more kql spec tests and simplify ast normalization

* enhancement: kql parser error if query starts with AND

* enhancement: add kql docs and support for date and time only dateTimeRestriction queries

* enhancement: add the ability to decide how kql nodes get connected

connecting nodes (with edges) seem straight forward when not using group, the default connection for nodes with the same node is always OR. THis only applies for first level nodes, for grouped nodes it is defined differently. The KQL docs are saying, nodes inside a grouped node, with the same key are connected by a AND edge.

* enhancement: explicit error handling for falsy group nodes and queries with leading binary operator

* enhancement: use optimized grammar for kql parser and toolify pigeon

* enhancement: simplify error handling

* fix: kql implicit 'AND' and 'OR' follows the ms html spec instead of the pdf spec
2023-09-11 13:49:53 +02:00
Roman Perekhod
158f91b398 fix unary in the beginning 2023-09-07 14:38:26 +02:00
Florian Schade
844783b6f9 [full-ci] - use KQL as default search query language (#7212)
* enhancement: use kql as default search query language

* enhancement: add support for unicode search queries

* fix: escape bleve field query whitespace

* fix: search related acceptance tests

* enhancement: remove legacy search query language

* enhancement: add support for kql dateTime restriction node types

* chore: bump web to v8.0.0-alpha.2

* fix: failing search api test

* enhancement: search bleve query compiler use DateRangeQuery as DateTimeNode counterpart

* enhancement: support for colon operators in dateTime kql queries
2023-09-07 11:13:33 +02:00
Florian Schade
0ec78ee7bb fix: failing tests and filter out specific matches 2023-09-01 12:07:56 +02:00
Florian Schade
a0f2adedb5 fix: acceptance tests to include path resource 2023-09-01 12:07:47 +02:00
Florian Schade
af9556f8f1 fix: search mount point inclusion 2023-09-01 12:07:38 +02:00