Commit Graph

183 Commits

Author SHA1 Message Date
Ralf Haferkamp ff6674f97b Fix fallout of reva bump
reva tries to avoid copying proto messages now. This changed some calls
to take pointers now (mainly e.g. FormatResourceId())
2024-07-11 15:21:56 +02:00
Viktor Scharf eb5a9ceade Merge pull request #9442 from owncloud/full-deployment
 [docs-only] feat: create ocis_full compose deployment
2024-06-28 12:50:56 +02:00
Michael Barz fd3178c4b3 docs: cleanup docs 2024-06-27 14:34:34 +02:00
jkoberg 01cdc153a5 docu(search): update index spaces command docu
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-06-27 14:22:01 +02:00
jkoberg 4e28fc45dc feat(search): allow indexing all spaces
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-06-25 10:01:37 +02:00
jkoberg 63686d6cd7 feat(search): remove userid from indexspace methods
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-06-25 10:01:37 +02:00
jkoberg 7a819412c2 feat(ocis): move ast and kql pkg to ocis-pkg
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-06-24 16:23:55 +02:00
Roman Perekhod e3f6f3ee1d The hidden shares have been excluded from a search result 2024-06-18 09:11:31 +02:00
Benedikt Kulmann 21a9992980 feat: add image and photo metadata to search (#8504)
* feat: add image and photo metadata to search
2024-05-21 10:21:15 +02:00
Jannik Stehle d40a643fbf feat: add remote item id to search report responses
Adds the remote item id to search `REPORT` responses for shared resources and resources that are part of such. This id represents the id of the original resource that has been shared (= the remote item) and is needed for clients to correctly resolve their locations.
2024-05-15 11:26:43 +02:00
Thomas Müller a8cbc612cc chore: remove unused return value from BindSourcesToStructs (#9033) 2024-04-30 18:18:31 +02:00
Jörn Friedrich Dreyer e41472234f log and trace fixes
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2024-04-26 17:03:49 +02:00
Thomas Müller 07f0cd5574 fix: typos, naming clashes, error messages and deprecations 2024-04-03 15:34:36 +02:00
Phil Davis 63a6f10c4b chore: set introductionVersion 5.0 in services/search 2024-03-06 17:50:21 +05:45
Phil Davis 9d2be66a85 chore: add introductionVersion pre5.0 to environment variable docs 2024-03-06 17:50:20 +05:45
Florian Schade 6814c61506 [full-ci] enhancement: allow ocis to provide custom web applications (#8523)
* enhancement: allow ocis to provide custom web applications

* enhancement: add an option to disable web apps

* test: add default logger tests

* test: add app loading tests

* test: add asset server tests

* enhancement: make use of dedicated app conf file and app asset paths

* enhancement: adjust asset locations and deprecate WEB_ASSET_PATH

* enhancement: get rid of default logger and use the service level logger instead

* Apply suggestions from code review

Co-authored-by: Benedikt Kulmann <benedikt@kulmann.biz>
Co-authored-by: kobergj <juliankoberg@googlemail.com>

* enhancement: use basename as app id

* Apply suggestions from code review

Co-authored-by: Martin <github@diemattels.at>

* enhancement: use afero as fs abstraction

* enhancement: simplify logo upload

* enhancement: make use of introductionVersion field annotations

---------

Co-authored-by: Benedikt Kulmann <benedikt@kulmann.biz>
Co-authored-by: kobergj <juliankoberg@googlemail.com>
Co-authored-by: Martin <github@diemattels.at>
2024-03-05 14:11:18 +01:00
Jörn Friedrich Dreyer 972adafd29 verify all system accounts are set
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2024-02-29 15:51:37 +01:00
Ralf Haferkamp 3d3f8949f5 Bump mockery to 2.40.2
to address issues when building with go1.22:
https://github.com/vektra/mockery/pull/753
2024-02-09 11:48:45 +01:00
Roman Perekhod 17a799c1fa fix search response 2024-02-09 09:39:07 +01:00
Jörn Friedrich Dreyer fad94d2038 bump mockery, add test stub for oidc_auth.go, align mock generation (#8321)
* bump mockery, add test stub for oidc_auth.go

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* use .mockery.yaml for all mocks

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* drop legacy go:generate mockery

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* align mock placement

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2024-02-01 10:07:44 +01:00
jkoberg b8b0d0b533 cleanup search/.../search.go
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-01-17 13:30:08 +01:00
André Duffeck 4b89ede756 Do not error-log when outdated resources can't be indexed anymore
That's an expected, totally valid case
2024-01-15 14:46:39 +01:00
Roman Perekhod fd388653a9 the race conditions in tests 2024-01-04 13:14:42 +01:00
jkoberg e1fad5c6e9 make nats-js-kv the default registry
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-12-19 12:13:28 +01:00
jkoberg 3e55223f2d allow authentication for events
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-12-19 10:44:05 +01:00
kobergj 377a23ee7d Non-durable SSE streams (#7986)
* make sse streams non-durable

Signed-off-by: jkoberg <jkoberg@owncloud.com>

* bump reva

Signed-off-by: jkoberg <jkoberg@owncloud.com>

---------

Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-12-18 11:47:25 +01:00
Dominik Schmidt 7dd99cfa69 feat(location): add bleve test 2023-12-06 15:13:09 +01:00
Dominik Schmidt 7f83b5020d feat(location): add tika test 2023-12-06 15:13:09 +01:00
Dominik Schmidt 4c27b365fa feat(graph): add location facet to driveItems 2023-12-06 15:13:09 +01:00
Dominik Schmidt 07edd1e23a chore(search): move audio metadata extraction in tika to dedicated method 2023-12-06 15:13:09 +01:00
kobergj 9057d231a8 fix search service startup (#7795)
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-11-24 08:35:10 +01:00
Christian Richter 1cdd839fc7 add form mime type
Signed-off-by: Christian Richter <crichter@owncloud.com>
2023-11-22 11:37:53 +01:00
Roman Perekhod 7175316292 fix the tgz mime type, bump reva 2023-11-21 17:33:52 +01:00
Roman Perekhod 8a6464798f fix last month search 2023-11-17 10:04:55 +01:00
Roman Perekhod 7ab553e23b add file type filter chip (#7602)
* add file type filter chip

* changed the keyword

* use reva issue-7432-replace

* changed the filter name. fix types

* rework mapBinary

---------

Co-authored-by: Roman Perekhod <rperekhod@owncloud.com>
2023-11-13 18:04:17 +01:00
Florian Schade 643158b67b enhancement: add sharedWithMe graph beta endpoint (#7633) 2023-11-08 20:02:58 +01:00
Dominik Schmidt db32fb46f9 Audio Metadata (#7490)
* Add audio facet to search protobuf message

* Add audio metadata to search index

* Return audio facet from search if available

* Store audio metadata in arbitrary metadata

* Add audio facet to driveItems listings

* Make tests coding style more consistent

* Fix tests

* Add changelog

* Make valueToString code more defensive

* Log status code as well
2023-11-06 08:56:46 +01:00
Martin 4b86bd0921 [docs-only] Update search README.md (#7655)
References: #7553 (enhancement: improve content extraction stop word cleaning)

Making the term `stop word` and the use of the envvar more clear.
2023-11-03 14:46:02 +01:00
Florian Schade cdd2100b4b enhancement: improve content extraction stop word cleaning (#7553)
* enhancement: improve content extraction stop word cleaning

* fix: cleanup documentation

Co-authored-by: Martin <github@diemattels.at>

* fix: failing tika stop word unit tests

---------

Co-authored-by: Martin <github@diemattels.at>
2023-10-23 13:40:37 +02:00
Roman Perekhod acfae80b53 add last modified filter chip (#7455)
* add last modified filter chip

* Update add-last-modified-filter-chip.md

---------

Co-authored-by: Roman Perekhod <rperekhod@owncloud.com>
2023-10-19 18:25:01 +02:00
Christian Richter e56b23541a remove obsolete cli flags
Signed-off-by: Christian Richter <crichter@owncloud.com>
2023-10-11 16:31:10 +02:00
jkoberg f189b11ba9 default async uploads
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-10-05 15:33:42 +02:00
Jörn Friedrich Dreyer 3efe843742 prevent panic when user is nil
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-09-21 17:19:18 +02:00
Roman Perekhod 911ea1c0f6 fix kql-bleve search. wildcards are excluded 2023-09-15 17:14:59 +02:00
Florian Schade 0f2b2b9a94 [full-ci] enhancement: add support for natural language kql date ranges (#7263)
* enhancement: add more kql spec tests and simplify ast normalization

* enhancement: kql parser error if query starts with AND

* enhancement: add kql docs and support for date and time only dateTimeRestriction queries

* enhancement: add the ability to decide how kql nodes get connected

connecting nodes (with edges) seem straight forward when not using group, the default connection for nodes with the same node is always OR. THis only applies for first level nodes, for grouped nodes it is defined differently. The KQL docs are saying, nodes inside a grouped node, with the same key are connected by a AND edge.

* enhancement: explicit error handling for falsy group nodes and queries with leading binary operator

* enhancement: use optimized grammar for kql parser and toolify pigeon

* enhancement: simplify error handling

* fix: kql implicit 'AND' and 'OR' follows the ms html spec instead of the pdf spec

* enhancement: add support for natural language kql date queries

* enhancement: structure kql parser tests into logical clusters

* fix: time-range error naming
2023-09-15 11:31:41 +02:00
Florian Schade c0553c7273 [full-ci] enhancement: add more kql spec tests and simplify ast normalization (#7254)
* enhancement: add more kql spec tests and simplify ast normalization

* enhancement: kql parser error if query starts with AND

* enhancement: add kql docs and support for date and time only dateTimeRestriction queries

* enhancement: add the ability to decide how kql nodes get connected

connecting nodes (with edges) seem straight forward when not using group, the default connection for nodes with the same node is always OR. THis only applies for first level nodes, for grouped nodes it is defined differently. The KQL docs are saying, nodes inside a grouped node, with the same key are connected by a AND edge.

* enhancement: explicit error handling for falsy group nodes and queries with leading binary operator

* enhancement: use optimized grammar for kql parser and toolify pigeon

* enhancement: simplify error handling

* fix: kql implicit 'AND' and 'OR' follows the ms html spec instead of the pdf spec
2023-09-11 13:49:53 +02:00
Roman Perekhod 158f91b398 fix unary in the beginning 2023-09-07 14:38:26 +02:00
Florian Schade 844783b6f9 [full-ci] - use KQL as default search query language (#7212)
* enhancement: use kql as default search query language

* enhancement: add support for unicode search queries

* fix: escape bleve field query whitespace

* fix: search related acceptance tests

* enhancement: remove legacy search query language

* enhancement: add support for kql dateTime restriction node types

* chore: bump web to v8.0.0-alpha.2

* fix: failing search api test

* enhancement: search bleve query compiler use DateRangeQuery as DateTimeNode counterpart

* enhancement: support for colon operators in dateTime kql queries
2023-09-07 11:13:33 +02:00
Florian Schade 0ec78ee7bb fix: failing tests and filter out specific matches 2023-09-01 12:07:56 +02:00
Florian Schade a0f2adedb5 fix: acceptance tests to include path resource 2023-09-01 12:07:47 +02:00