Commit Graph

424 Commits

Author SHA1 Message Date
Ralf Haferkamp
443598c227 ocis init: Add service accountid to settings config 2023-09-07 20:54:14 +02:00
Ralf Haferkamp
6fd0853fcc ocis init: Add service account settings for proxy 2023-09-07 20:54:14 +02:00
jkoberg
732228ed88 add clientlog service
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-09-07 10:56:58 +02:00
jkoberg
8e1b033a63 auto-accept shares in frontend service
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-09-06 15:32:31 +02:00
jkoberg
a42d56a83c bump reva
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-08-31 12:11:44 +02:00
jkoberg
bd716156fc let ocis init set the serviceaccounts
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-08-31 12:11:44 +02:00
jkoberg
90ce1a7ad0 add auth-service
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-08-31 12:11:44 +02:00
Florian Schade
96292ba4b6 enhancement: add sse service skeleton 2023-08-29 13:59:39 +02:00
André Duffeck
6f4b300bbc Remove subcommand from rebuild-jsoncs3-indexes that doesn't belong there 2023-08-08 14:07:42 +02:00
Andre Duffeck
52750bd615 Fail on errors (#6986)
* Return an error when something went wrong

* Add changelog
2023-08-08 13:12:03 +02:00
André Duffeck
dc176e1f74 Improve logging 2023-08-07 10:28:00 +02:00
André Duffeck
e03d7b5644 Cleanup 2023-08-07 09:54:05 +02:00
André Duffeck
407c23edf6 Add command for rebuilding the jsoncs3 share manager indexes 2023-08-07 09:43:18 +02:00
Daniel Swärd
6a5e21eff4 Replacing implicit grpc client initialization with explicit package local variables. 2023-07-31 12:57:59 +02:00
André Duffeck
201caca5ec Incorporate review suggestions 2023-07-31 08:17:42 +02:00
André Duffeck
c8ab49dc2d Add support for running/rolling back decomposedfs migrations 2023-07-31 08:17:42 +02:00
Daniël Franke
e43001fb96 Pass context for reva bump.
Also refresh the generated code.
2023-07-03 11:08:45 +02:00
Ralf Haferkamp
563bf34870 Fix output formatting of 'decomposedfs treesize-check` command
Add linebreak after errormessages
2023-06-27 17:42:07 +02:00
Christian Richter
b06f7ec131 Merge pull request #6577 from dragonchaser/issue-192-disable-thumbnailer
[full-ci] allow to disable previews in webdav & web
2023-06-27 14:01:37 +02:00
Christian Richter
15ced8a6df incorporate requested changes
Signed-off-by: Christian Richter <crichter@owncloud.com>
2023-06-23 13:29:49 +02:00
Ralf Haferkamp
4af4bba8b1 Add cli tool for verifing and repairing treesizes in decomposedfs 2023-06-22 15:58:52 +02:00
Christian Richter
b3fd53d5a3 disable thumbnail service when web prevents previews
Signed-off-by: Christian Richter <crichter@owncloud.com>
2023-06-22 15:44:15 +02:00
Ralf Haferkamp
046ff50f52 Fix 'decomposedfs meta set' value handling
Don't strip off the first two characters of the target
value to set unconditionally. Also print an error if
decoding hex/base64 values fails (falling back to treating
the values as strings).
2023-06-14 11:18:41 +02:00
jkoberg
09f4b6f9f3 fix ocis
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-06-06 14:25:10 +02:00
jkoberg
d347448ec0 remove duplicated sutureservice code
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-06-02 12:02:27 +02:00
jkoberg
d3f1012fea remove code duplication
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-06-02 12:02:27 +02:00
Andre Duffeck
77bb3d8bcd [full-ci] Refactor stores (#6019)
* Streamline the store implementation with and into reva

* Adapt to the cache/store refactoring in reva

* Streamline config options and their env vars

* Apply suggestions from code review

Co-authored-by: Martin <github@diemattels.at>

* Use the same database for all stores

* Bump reva

* Configure stat and filemetadata cache separately

* Fix default config

---------

Co-authored-by: Martin <github@diemattels.at>
2023-04-24 15:13:35 +02:00
Michael Barz
e73d5493db add optional services and fix config slice parser 2023-04-18 11:58:02 +02:00
Jörn Friedrich Dreyer
f805cca363 initial invitations skeleton
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-03-24 11:42:48 +01:00
kobergj
6c00708dbc improve antivirus documentation
Co-authored-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-03-22 13:50:42 +01:00
jkoberg
f4ba4e0f64 backport antivirus from experimental
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-03-21 10:04:11 +01:00
Andre Duffeck
7bd735f615 Add command for inspecting and manipulating node metadata (#5858)
* Add command for inspecting and manipulating node metadata

* Add changelog

* Bump reva
2023-03-17 12:31:07 +01:00
Florian Schade
f38a9f4385 Introduce Policies-Service (#5716)
* add policies service
add policies proxy middleware
add policies event service
add policies grpc service
prepare ci and git environments (ci, make, readme, doc)

* add webfinger to the drone conf

* fix docs
remove not used virus scan postprocessing step

* relocate example rego file
implicitly enable and disable proxy and postprocessing policy checking by setting the query.
update configuration descriptions

* move policies
update readme

* use converter func to convert pp environment to actual environment
expose and test custom rego functions
add engine unit tests
add opa unit tests
update policies readme

Co-authored-by: Martin <github@diemattels.at>

* relocate sample policies to the deployments folder
change and document policies service port

* update index.md and small fix

* add health command
add version command
add debug server

---------

Co-authored-by: Martin <github@diemattels.at>
2023-03-14 16:08:22 +01:00
Jörn Friedrich Dreyer
43547cc681 Benchmark options (#5684)
* make benchmark clients remember cookies

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* add --rate option for benchmark clients

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* create a new request on every request to fix vanishing data

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* use corret minute unit

Co-authored-by: Florian Schade <f.schade@icloud.com>

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: Florian Schade <f.schade@icloud.com>
2023-03-07 11:37:14 +01:00
jkoberg
a1fbbbb82b add commands for missing services
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-03-01 15:05:37 +01:00
Jörn Friedrich Dreyer
ddae4f67f5 Benchmark cli (#5652)
* cli to benchmark low level syscalls

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

add benchmark client & syscall commands

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* update the oidc-agent docs

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* Update ocis/pkg/command/benchmark.go

Co-authored-by: Martin <github@diemattels.at>

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: Martin <github@diemattels.at>
2023-02-28 09:14:53 +01:00
jkoberg
d56565555b introduce userlog service
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-02-21 14:25:21 +01:00
jkoberg
c9dfb778a9 sharpen eventhistory service
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-02-21 10:51:32 +01:00
Jörn Friedrich Dreyer
2c98d3246c minimal webfinger (#5373)
* initial webfinger stub

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* add webfinger to proxy, return current host

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* some cleanup

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* allow passing multiple rel params

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* introduce interfaces

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* parse oidc auth token

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* add templating, drop chain, use map of relation providers

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* fix ocis url yaml

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* fix typos

Co-authored-by: Dominik Schmidt <dschmidt@owncloud.com>

* switch to userinfo claims

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* readme cleanup

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* add TODO.md with ideas

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* replace subject on authenticated request responses

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* Apply suggestions from code review

Co-authored-by: Martin <github@diemattels.at>

* markdown lint

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* return a 401 when bearer token expired, some more docs

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* Apply suggestions from code review

Co-authored-by: Martin <github@diemattels.at>

* fix docs

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* clarify env var

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* extract handler func

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* use correct service in reflex.conf

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* test relations

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* Update services/webfinger/pkg/config/config.go

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: Dominik Schmidt <dschmidt@owncloud.com>
Co-authored-by: Martin <github@diemattels.at>
2023-02-13 11:05:20 +01:00
Jörn Friedrich Dreyer
078698fdf4 graph: add appRoleAssignments and minimal application resource (#5318)
* bump libregraph-go lib

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* add appRoleAssignment stubs

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* add get application stub

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* fetch appRoles for application from settings service

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* initial list appRoleAssignments implementation

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* initial create appRoleAssignment implementation, extract assignmentToAppRoleAssignment, configurable app id and displayname

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* initial delete appRoleAssignment implementation, changed error handling and logging

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* initial expand appRoleAssignment on users

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* test user expand appRoleAssignment

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* test appRoleAssignment

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* fix education test by actually using the mocked roleManager

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* test getapplication

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* list assignments

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* use common not exists error handling

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* default to just 'ownCloud Infinite Scale' as application name

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* fix store_test

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* roll application uuid on init

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* fix tests

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* extract method

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* Apply suggestions from code review

Co-authored-by: Michael Barz <mbarz@owncloud.com>

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: Michael Barz <mbarz@owncloud.com>
2023-01-12 16:09:34 +01:00
kobergj
341cdc9dd3 Merge pull request #5207 from kobergj/AsyncPostprocessing
[full-ci] Async Postprocessing
2022-12-16 11:58:24 +01:00
Jörn Friedrich Dreyer
53d15d329e remove deprecated use of ioutil (#5205)
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2022-12-08 14:44:53 +01:00
jkoberg
06f3f5adb3 start pp service in single binary
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2022-12-08 11:49:04 +01:00
Michael Barz
7e6b57e138 make storage users mount id configurable (#5091) 2022-11-25 13:47:41 +01:00
Ralf Haferkamp
ee974afebf [full-ci] Introduce TLS Settings for go-micro based grpc services and clients (#4901)
* Introduce TLS Settings for go-micro based grpc services and clients

TLS for the services can be configure by setting the OCIS_MICRO_GRPC_TLS_ENABLED"
"OCIS_MICRO_GRPC_TLS_CERTIFICATE" and "OCIS_MICRO_GRPC_TLS_KEY"
enviroment variables.

TLS for the clients can configured by setting the "OCIS_MICRO_GRPC_CLIENT_TLS_MODE"
and "OCIS_MICRO_GRPC_CLIENT_TLS_CACERT" variables.

By default TLS is disabled.

Co-authored-by: Martin <github@diemattels.at>

* Unify TLS configuration for all grpc services

All grpc service (whether they're based on reva) or go-micro use the
same set of config vars now.

TLS for the services can be configure by setting the OCIS_GRPC_TLS_ENABLED,
OCIS_GRPC_TLS_CERTIFICATE and OCIS_GRPC_TLS_KEY enviroment variables.

TLS for the clients can configured by setting the OCIS_GRPC_CLIENT_TLS_MODE
and OCIS_MICRO_GRPC_CLIENT_TLS_CACERT variables.

There are no individual per service config vars currently. If really
needed, per service tls configurations can be specified via config file.

Co-authored-by: Martin <github@diemattels.at>

Co-authored-by: Martin <github@diemattels.at>
2022-11-03 10:17:08 +01:00
David Christofas
ab5ceb1928 add nats tls insecure flags to ocis init 2022-10-12 17:24:16 +02:00
David Christofas
3babaf1a4d remove the graph-explorer servier from ocis (#4733) 2022-10-04 15:55:30 +02:00
Ralf Haferkamp
5d121b4bad Do not start auth-bearer service by default
The auth-bearer service is currently not needed by ocis. Reva tookens
for oidc authenticated clients are currently minted via the auth-machine
service.  This commit does not completely remove the service as we shoud
consider to rework the proxy's oidc middleware to use the auth-bearer
service in the future (see #4701)

Fixes: #4692
2022-09-28 12:11:06 +02:00
Ralf Haferkamp
8f2bf0ed9c Default to in-memory registry in single-binary mode
This avoids various issues of the old "mdns" default. At least for the simple
single process setup (#3134, #4597). When starting the services individually we
still default to "mdns".
2022-09-26 16:25:56 +02:00
Willy Kloucek
c997e50b8d add insecure option to ocis init 2022-09-26 09:26:04 +02:00