Commit Graph

48 Commits

Author SHA1 Message Date
jkoberg 4a911ac047 feat(storage-users): remove metadata backend envvar
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-09-19 12:29:41 +02:00
André Duffeck ffe1946686 Fix default posix root and the description of the according config var
Fixes https://github.com/owncloud/ocis/issues/9910
2024-09-17 10:33:32 +02:00
André Duffeck d199e79c71 Set a default debounce delay 2024-09-17 10:33:32 +02:00
André Duffeck 0028013794 Enable async uploads for posixfs 2024-06-25 08:40:50 +02:00
André Duffeck 126b083eaf Add config var for using the space groups 2024-05-29 12:14:54 +02:00
André Duffeck 8cd39754c7 Add config vars for space path templates 2024-05-29 12:14:54 +02:00
André Duffeck 96645322e7 Configure project spaces layout 2024-05-29 12:14:53 +02:00
André Duffeck aab219a38f Initial support for the posixfs 2024-05-29 12:14:53 +02:00
Christian Richter fe4cd7a901 make code more readable
Signed-off-by: Christian Richter <crichter@owncloud.com>
2024-03-19 14:21:21 +01:00
Christian Richter b5ca297f54 prevent nil pointer
Signed-off-by: Christian Richter <crichter@owncloud.com>
2024-03-19 13:56:10 +01:00
Christian Richter 72916dc53c adapt cors headers
Signed-off-by: Christian Richter <crichter@owncloud.com>
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2024-03-19 10:54:58 +01:00
jkoberg f1a6472a6d disable multiparts uploads
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-03-15 15:59:57 +01:00
Jörn Friedrich Dreyer 5ed57cc09a Bump reva deps (#8412)
* bump dependencies

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* bump reva and add config options

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2024-02-21 10:20:36 +01:00
Christian Richter 2269d2cf27 change default for MaxConcurrency
Signed-off-by: Christian Richter <crichter@owncloud.com>
2024-01-29 14:22:26 +01:00
jkoberg cec6ea50eb remove unused stat cache
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-01-24 10:39:32 +01:00
Roman Perekhod 367f1ff9e8 trash-bin cli has been exteneded by the list and restore commands (#7917)
* trash-bin cli has been exteneded by the list and restore commands

* v4 to v5 changes

---------

Co-authored-by: Roman Perekhod <rperekhod@owncloud.com>
2023-12-19 15:44:28 +01:00
kobergj dbc50a655b use different dbs for filemetadata caches
Co-authored-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-12-14 11:08:10 +01:00
jkoberg d62cb9d34b use inmemory cache by default
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-12-13 12:49:54 +01:00
jkoberg ad87ac955a configure services individually
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-12-13 12:49:54 +01:00
jkoberg bbc4f83f7d bump dependencies
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-12-13 12:49:53 +01:00
jkoberg 003310a2b0 use nats-js cache
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-12-13 12:48:27 +01:00
jkoberg f189b11ba9 default async uploads
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-10-05 15:33:42 +02:00
André Duffeck e8a7872d29 Add default propagator config 2023-07-31 10:26:19 +02:00
Ralf Haferkamp e32aef17cd storage-users: Add config option for graceful shutdown timeout
Add STORAGE_USERS_GRACEFUL_SHUTDOWN_TIMEOUT setting to allow a graceful
shutdown of the storage-users service. This currently only applicable
when running storage-user as a sepearate service.

Setting STORAGE_USERS_GRACEFUL_SHUTDOWN_TIMEOUT to a non-zero value
gives the storage-users service a chance to cleanly shutdown and finish
any in progess tasks (e.g. metadata propagation) before exiting.

Partial-Fix: #6602
2023-07-18 16:47:26 +02:00
Florian Schade 4f26424db6 [full-ci] enhancement: use reva client pool selectors (#6452)
* enhancement: use reva client pool selectors

register mock service to registry and pass tests

* enhancement: bump reva

* Fix a couple of linter issues

---------

Co-authored-by: Ralf Haferkamp <rhaferkamp@owncloud.com>
2023-06-08 12:41:04 +02:00
mmattel e5746d8176 [docs-only] Fix wrong default metadata backend 2023-05-12 13:34:13 +02:00
mmattel 037422ba1f [docs-only] Set messagepack as default metadata backend 2023-05-03 12:22:09 +02:00
Andre Duffeck 129489203b Cleanup and improve the caching config (#6148)
* Cleanup and improve the caching config

* bump reva

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* disable stat cache

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* Bump reva

* Linter fixes

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-04-27 12:35:30 +02:00
Andre Duffeck 77bb3d8bcd [full-ci] Refactor stores (#6019)
* Streamline the store implementation with and into reva

* Adapt to the cache/store refactoring in reva

* Streamline config options and their env vars

* Apply suggestions from code review

Co-authored-by: Martin <github@diemattels.at>

* Use the same database for all stores

* Bump reva

* Configure stat and filemetadata cache separately

* Fix default config

---------

Co-authored-by: Martin <github@diemattels.at>
2023-04-24 15:13:35 +02:00
David Christofas 924c2ca346 add missing comments 2023-03-06 19:01:16 +01:00
David Christofas 63fa35fa50 reduce duplication in configuration code 2023-03-06 16:52:44 +01:00
Jörn Friedrich Dreyer a5fb068650 [full-ci] Bump reva to include ini metadata backend (#5613)
* bump reva

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* default to ini backend

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* bump reva, add metadata backend config

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* update changelog

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* fix tag

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* Update services/storage-system/pkg/config/config.go

Co-authored-by: kobergj <jkoberg@owncloud.com>

* fix storage user metadata config desc and env var

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: kobergj <jkoberg@owncloud.com>
2023-02-23 10:54:50 +01:00
Florian Schade 5da3df8ffe Space Trash-bin expiration cli (#5500)
* add storage-users trash-bin cli
add task to clean up outdated trash-bin resources
add trash-bin cli purge-expired command to purge expired trash-bin resources
add purge-expired task tests
2023-02-10 12:04:47 +01:00
jkoberg daad94a332 config and tls
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2022-12-08 11:41:31 +01:00
Jörn Friedrich Dreyer 3ac7701a52 decomposedfs increase filelock duration factor
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2022-11-25 13:17:11 +00:00
Michael Barz 7e6b57e138 make storage users mount id configurable (#5091) 2022-11-25 13:47:41 +01:00
Florian Schade 51376b584b add option to configure max_acquire_lock_cycles 2022-11-03 14:22:46 +01:00
Ralf Haferkamp ee974afebf [full-ci] Introduce TLS Settings for go-micro based grpc services and clients (#4901)
* Introduce TLS Settings for go-micro based grpc services and clients

TLS for the services can be configure by setting the OCIS_MICRO_GRPC_TLS_ENABLED"
"OCIS_MICRO_GRPC_TLS_CERTIFICATE" and "OCIS_MICRO_GRPC_TLS_KEY"
enviroment variables.

TLS for the clients can configured by setting the "OCIS_MICRO_GRPC_CLIENT_TLS_MODE"
and "OCIS_MICRO_GRPC_CLIENT_TLS_CACERT" variables.

By default TLS is disabled.

Co-authored-by: Martin <github@diemattels.at>

* Unify TLS configuration for all grpc services

All grpc service (whether they're based on reva) or go-micro use the
same set of config vars now.

TLS for the services can be configure by setting the OCIS_GRPC_TLS_ENABLED,
OCIS_GRPC_TLS_CERTIFICATE and OCIS_GRPC_TLS_KEY enviroment variables.

TLS for the clients can configured by setting the OCIS_GRPC_CLIENT_TLS_MODE
and OCIS_MICRO_GRPC_CLIENT_TLS_CACERT variables.

There are no individual per service config vars currently. If really
needed, per service tls configurations can be specified via config file.

Co-authored-by: Martin <github@diemattels.at>

Co-authored-by: Martin <github@diemattels.at>
2022-11-03 10:17:08 +01:00
Ralf Haferkamp 3d57f5cc21 Introduce TLS Settings for all reva grpc services and clients 2022-10-25 11:50:08 +02:00
Ralf Haferkamp e373e48383 Get rid of duplicated Reva config struct
Consolidate all services to use the Reva config struct for the shared package.
This works because all services (except 'notifications', 'thumbnails' and
'webdav') where using the same config keys and environment variables for
setting the reva gateway.
2022-10-25 11:50:08 +02:00
David Christofas 45b92fc56f add config option to enable or disable TLS for nats 2022-10-21 12:40:21 +02:00
David Christofas 4623b6c8e7 Nats tls (#4781)
* use tls for nats connections

* add config options for nats client tls config

* add nats tls config to CI

* add function to create a certpool

* add option to provide a rootCA to validate the server's TLS certificate

* add option to provide a rootCA to validate the server's TLS certificate

* add option to provide a rootCA to validate the server's TLS certificate

* add option to provide a rootCA to validate the server's TLS certificate

* configure nats clients in reva to use tls
2022-10-12 14:56:47 +02:00
Jörn Friedrich Dreyer 49376178e9 configure reva micro cache store (#4627)
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2022-09-26 13:43:53 +02:00
André Duffeck e35327cdf2 Add a cli for listing and cleaning up expired uploads
Fixes #2622
2022-08-04 09:41:55 +02:00
Ralf Haferkamp 946f3e8feb Remove unused BindEnv code
We dropped this in favour of envdecode a while ago.
2022-07-14 16:34:25 +02:00
Willy Kloucek 8f3b0c50cd Merge branch 'master' into config-doc-descriptions 2022-06-28 13:03:19 +02:00
Christian Richter f8f1320501 refactor extensions -> services
Signed-off-by: Christian Richter <crichter@owncloud.com>
2022-06-27 14:05:36 +02:00
Christian Richter 78064e6bab rename folder extensions -> services
Signed-off-by: Christian Richter <crichter@owncloud.com>
2022-06-27 14:05:36 +02:00