Commit Graph

21939 Commits

Author SHA1 Message Date
fschade
098a220626 enhancement(search): implement kql to os dsl structure compilation and add basic tests 2025-08-28 09:30:59 +02:00
fschade
37d8b1d608 enhancement(search): implement engine search skeleton 2025-08-28 09:30:59 +02:00
fschade
492340f6f7 enhancement(search): implement engine docCount 2025-08-28 09:30:59 +02:00
fschade
bd5dec7327 enhancement(search): implement engine restore 2025-08-28 09:30:59 +02:00
fschade
59b6788b28 enhancement(search): implement engine delete 2025-08-28 09:30:59 +02:00
fschade
c18bfad222 enhancement(search): implement engine purge 2025-08-28 09:30:59 +02:00
fschade
4ad3865d52 enhancement(search): prepare opensearch integration 2025-08-28 09:30:59 +02:00
Christian Richter
60aa99ab8b Merge pull request #1344 from dragonchaser/user-soft-delet
initial skel for user soft delete
2025-08-27 16:42:50 +02:00
Christian Richter
f524d5de91 bump reva
Signed-off-by: Christian Richter <c.richter@opencloud.eu>
2025-08-27 10:36:13 +02:00
Christian Richter
19141c2b71 add user soft delete
Signed-off-by: Christian Richter <c.richter@opencloud.eu>
2025-08-27 10:36:12 +02:00
Ralf Haferkamp
2a76fc22be Merge pull request #1401 from opencloud-eu/dependabot/go_modules/github.com/nats-io/nats.go-1.45.0
build(deps): bump github.com/nats-io/nats.go from 1.44.0 to 1.45.0
2025-08-27 08:02:48 +02:00
Ralf Haferkamp
5821fbde9b Merge pull request #1400 from opencloud-eu/dependabot/go_modules/github.com/stretchr/testify-1.11.0
build(deps): bump github.com/stretchr/testify from 1.10.0 to 1.11.0
2025-08-27 08:02:13 +02:00
dependabot[bot]
f3dd516351 build(deps): bump github.com/nats-io/nats.go from 1.44.0 to 1.45.0
Bumps [github.com/nats-io/nats.go](https://github.com/nats-io/nats.go) from 1.44.0 to 1.45.0.
- [Release notes](https://github.com/nats-io/nats.go/releases)
- [Commits](https://github.com/nats-io/nats.go/compare/v1.44.0...v1.45.0)

---
updated-dependencies:
- dependency-name: github.com/nats-io/nats.go
  dependency-version: 1.45.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-08-26 22:00:57 +00:00
dependabot[bot]
df5a99af37 build(deps): bump github.com/stretchr/testify from 1.10.0 to 1.11.0
Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify) from 1.10.0 to 1.11.0.
- [Release notes](https://github.com/stretchr/testify/releases)
- [Commits](https://github.com/stretchr/testify/compare/v1.10.0...v1.11.0)

---
updated-dependencies:
- dependency-name: github.com/stretchr/testify
  dependency-version: 1.11.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-08-26 21:44:40 +00:00
Artur Neumann
2b430baa58 Merge pull request #1398 from opencloud-eu/watchfsinCI
[full-ci] run tests with STORAGE_USES_POSIX_WATCH_FS
2025-08-26 17:47:06 +05:45
Ralf Haferkamp
b30fd8c9e0 Merge pull request #1376 from opencloud-eu/dependabot/go_modules/github.com/olekukonko/tablewriter-1.0.9
build(deps): bump github.com/olekukonko/tablewriter from 1.0.8 to 1.0.9
2025-08-26 12:58:10 +02:00
Artur Neumann
2ccce301dd run webUI tests with STORAGE_USES_POSIX_WATCH_FS 2025-08-26 14:05:05 +05:45
Artur Neumann
3c84d2a443 run CoreAPI tests with STORAGE_USES_POSIX_WATCH_FS 2025-08-26 14:05:04 +05:45
Artur Neumann
d1e9967319 run API & CLI tests with STORAGE_USES_POSIX_WATCH_FS 2025-08-26 14:05:00 +05:45
dependabot[bot]
5e6fc50e5e build(deps): bump github.com/olekukonko/tablewriter from 1.0.8 to 1.0.9
Bumps [github.com/olekukonko/tablewriter](https://github.com/olekukonko/tablewriter) from 1.0.8 to 1.0.9.
- [Commits](https://github.com/olekukonko/tablewriter/compare/v1.0.8...v1.0.9)

---
updated-dependencies:
- dependency-name: github.com/olekukonko/tablewriter
  dependency-version: 1.0.9
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-08-26 06:40:11 +00:00
Ralf Haferkamp
db583c4644 Merge pull request #1396 from opencloud-eu/dependabot/go_modules/github.com/onsi/ginkgo/v2-2.25.1
build(deps): bump github.com/onsi/ginkgo/v2 from 2.24.0 to 2.25.1
2025-08-26 08:38:36 +02:00
dependabot[bot]
811049e8eb build(deps): bump github.com/onsi/ginkgo/v2 from 2.24.0 to 2.25.1
Bumps [github.com/onsi/ginkgo/v2](https://github.com/onsi/ginkgo) from 2.24.0 to 2.25.1.
- [Release notes](https://github.com/onsi/ginkgo/releases)
- [Changelog](https://github.com/onsi/ginkgo/blob/master/CHANGELOG.md)
- [Commits](https://github.com/onsi/ginkgo/compare/v2.24.0...v2.25.1)

---
updated-dependencies:
- dependency-name: github.com/onsi/ginkgo/v2
  dependency-version: 2.25.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-08-26 04:12:34 +00:00
opencloudeu
17e6153f80 [tx] updated from transifex 2025-08-26 00:02:29 +00:00
Jörn Friedrich Dreyer
100ac1ec36 Merge pull request #1372 from rhafer/watchfs-test
[full-ci] Bump reva to latest main
2025-08-25 11:08:15 +02:00
Ralf Haferkamp
291be49590 Merge pull request #1385 from opencloud-eu/dependabot/go_modules/github.com/prometheus/client_golang-1.23.0
build(deps): bump github.com/prometheus/client_golang from 1.22.0 to 1.23.0
2025-08-25 09:09:44 +02:00
opencloudeu
869871c795 [tx] updated from transifex 2025-08-25 00:02:34 +00:00
opencloudeu
c1565b4d1e [tx] updated from transifex 2025-08-22 00:03:03 +00:00
Ralf Haferkamp
afed8aadae tests: Remove unsupported test case
The collaborative mode of posixfs does currently not support the creation
and removal of spaces directly on the file system. This has to happen
via the graph API.
2025-08-21 11:15:35 +02:00
Ralf Haferkamp
88dd36b636 Drop the unsupported and unused S3 driver
It was dropped from reva in https://github.com/opencloud-eu/reva/pull/309
because of unmaintained dependencies. Remember: We have the decomposeds3
driver.
2025-08-21 11:15:35 +02:00
Ralf Haferkamp
42497b5118 Bump reva to latest main
Fixes: #1368
2025-08-21 11:01:12 +02:00
Ralf Haferkamp
4993336899 Merge pull request #1373 from opencloud-eu/directly-call-frontend
directly connect to frontend
2025-08-21 09:10:41 +02:00
opencloudeu
c89e8fec64 [tx] updated from transifex 2025-08-21 00:02:32 +00:00
dependabot[bot]
e8057caa3c build(deps): bump github.com/prometheus/client_golang
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang) from 1.22.0 to 1.23.0.
- [Release notes](https://github.com/prometheus/client_golang/releases)
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md)
- [Commits](https://github.com/prometheus/client_golang/compare/v1.22.0...v1.23.0)

---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
  dependency-version: 1.23.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-08-20 14:22:51 +00:00
Ralf Haferkamp
45bb103602 Merge pull request #1381 from opencloud-eu/ack-tag-events
ack tag events
2025-08-20 15:47:52 +02:00
Jörn Friedrich Dreyer
2c3ee68f08 ack tag events
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2025-08-20 14:43:46 +02:00
Artur Neumann
4e243f8fc4 Merge pull request #1377 from opencloud-eu/runalsomultiservicenigthly
run also e2e-tests-multi-service pipeline on cron
2025-08-20 16:07:24 +05:45
Ralf Haferkamp
37193396e6 Merge pull request #1375 from opencloud-eu/dependabot/go_modules/github.com/onsi/ginkgo/v2-2.24.0
build(deps): bump github.com/onsi/ginkgo/v2 from 2.23.4 to 2.24.0
2025-08-20 08:22:08 +02:00
Artur Neumann
3765199158 run also e2e-tests-multi-service pipeline on cron 2025-08-20 10:11:18 +05:45
opencloudeu
1228c4ed20 [tx] updated from transifex 2025-08-20 00:02:32 +00:00
dependabot[bot]
84dcc3b7f2 build(deps): bump github.com/onsi/ginkgo/v2 from 2.23.4 to 2.24.0
Bumps [github.com/onsi/ginkgo/v2](https://github.com/onsi/ginkgo) from 2.23.4 to 2.24.0.
- [Changelog](https://github.com/onsi/ginkgo/blob/master/CHANGELOG.md)
- [Commits](https://github.com/onsi/ginkgo/compare/v2.23.4...v2.24.0)

---
updated-dependencies:
- dependency-name: github.com/onsi/ginkgo/v2
  dependency-version: 2.24.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-08-19 22:17:27 +00:00
Jörn Friedrich Dreyer
2751cfee2c directly connect to frontend
The STORAGE_USERS_DATA_GATEWAY_URL env var is used in the `tokens` `datagateway_endpoint` reva configuration. That `DataGatewayEndpoint` is used by the decomposedfs driver to create urls:
```go
// URL returns a url to download an upload
func (session *DecomposedFsSession) URL(_ context.Context) (string, error) {
       // [ ... ]
	return joinurl(session.store.tknopts.DataGatewayEndpoint, tkn), nil
}
```
As the comment points out this URL is internally used when emitting events. Either in:
```go
func (session *DecomposedFsSession) FinishUploadDecomposed(ctx context.Context) error {
                // [ ... ]
		s, err := session.URL(ctx)
		if err != nil {
			return err
		}

		var iu *userpb.User
		if utils.ExistsInOpaque(u.Opaque, "impersonating-user") {
			iu = &userpb.User{}
			if err := utils.ReadJSONFromOpaque(u.Opaque, "impersonating-user", iu); err != nil {
				return err
			}
		}

		if err := events.Publish(ctx, session.store.pub, events.BytesReceived{
			UploadID:          session.ID(),
			URL:               s,
```

or in
```go

// Postprocessing starts the postprocessing result collector
func (fs *Decomposedfs) Postprocessing(ch <-chan events.Event) {
                        // [ ... ]
			s, err := session.URL(ctx)
			if err != nil {
				sublog.Error().Err(err).Msg("could not create url")
				continue
			}

			metrics.UploadSessionsRestarted.Inc()

			// restart postprocessing
			if err := events.Publish(ctx, fs.stream, events.BytesReceived{
				UploadID:      session.ID(),
				URL:           s,
```

So, we do not need to go throught the proxy here.
2025-08-19 14:58:30 +02:00
opencloudeu
20adc6754b [tx] updated from transifex 2025-08-19 00:02:29 +00:00
Ralf Haferkamp
4fe87c25f8 Merge pull request #1359 from opencloud-eu/dependabot/go_modules/github.com/gookit/config/v2-2.2.7
build(deps): bump github.com/gookit/config/v2 from 2.2.6 to 2.2.7
2025-08-18 11:14:15 +02:00
Ralf Haferkamp
10f7ca721f Merge pull request #1356 from opencloud-eu/dependabot/go_modules/golang.org/x/net-0.43.0
build(deps): bump golang.org/x/net from 0.42.0 to 0.43.0
2025-08-18 09:05:12 +02:00
Ralf Haferkamp
80ae9e4259 Merge pull request #1353 from rhafer/issue/1277
fix(proxy): First login fails in auto provision setups
2025-08-18 07:59:15 +02:00
dependabot[bot]
89a7d171ee build(deps): bump github.com/gookit/config/v2 from 2.2.6 to 2.2.7
Bumps [github.com/gookit/config/v2](https://github.com/gookit/config) from 2.2.6 to 2.2.7.
- [Release notes](https://github.com/gookit/config/releases)
- [Commits](https://github.com/gookit/config/compare/v2.2.6...v2.2.7)

---
updated-dependencies:
- dependency-name: github.com/gookit/config/v2
  dependency-version: 2.2.7
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-08-15 14:15:33 +00:00
Viktor Scharf
28770fe20d run all tests with POSIX_WATCH_FS=true (#1342) 2025-08-15 13:44:35 +02:00
Ralf Haferkamp
69c0d21539 Dockerfile cleanup (#1352)
* Dockerfile.multiarch: use bind- and cache-mounts to speedup build

Use a cache mount for go build cache in the build container and mount
the sources as a bind mount as recommended in
https://docs.docker.com/build/cache/optimize/ this largely speeds up the
container build for subsequent builds.

* Use Dockerfile.multiarch for "dev-docker" target

Let's remove some redundancy. AFAICS the Docker.multiarch does
everything the Docker.linux.* files did. And with the build caches
enable it should be just as quick as building on the host.

* Dockerfile.multiarch: Align the alpine version of the base images

* Dockerfile: Reduce build context by adding more files to .dockerignore
2025-08-15 12:41:36 +02:00
Artur Neumann
2c1aa8585e run CI on cron jobs (#1350) 2025-08-15 09:59:29 +05:45
dependabot[bot]
bd982dd55f build(deps): bump golang.org/x/net from 0.42.0 to 0.43.0
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.42.0 to 0.43.0.
- [Commits](https://github.com/golang/net/compare/v0.42.0...v0.43.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-version: 0.43.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-08-14 16:40:32 +00:00