Commit Graph

22502 Commits

Author SHA1 Message Date
Pascal Bleser
46f8d27e42 groupware: improve email sanitization by using the mime package to parse the part type, in order to recognize HTML ones that need sanitization 2025-12-09 09:15:38 +01:00
Pascal Bleser
8a97320494 groupware: add headers Unmatched-Path and Unsupported-Method to make
development of the web UI easier
2025-12-09 09:15:38 +01:00
Pascal Bleser
0507779211 groupware: add markAsSeen=true to mark an email as $seen before it is
retrieved
2025-12-09 09:15:38 +01:00
Pascal Bleser
4dfed5a43e groupware: add the Retry-After header in responses when the session cannot be retrieved 2025-12-09 09:15:38 +01:00
Pascal Bleser
f024c2c9a9 groupware: add searching emails by their Message-Id + retrieving an email by its ID as message/rfc822 2025-12-09 09:15:38 +01:00
Pascal Bleser
0d23867d54 groupware: add email HTML sanitization
* sanitize email text/html body parts using bluemonday

 * deps(groupware):
   - new dependency: github.com/microcosm-cc/bluemonday
   - transitive dependencies:
     - github.com/aymerick/douceur
     - github.com/gorilla/css
2025-12-09 09:15:38 +01:00
Pascal Bleser
1845fa86f4 groupware: add identity deletion 2025-12-09 09:15:38 +01:00
Pascal Bleser
df8b42451a groupware:
* made several email related operations multi-account:
   QueryEmailSnippets, QueryEmails, QueryEmailsWithSnippets

 * add GetIdentitiesForAllAccounts

 * add GetEmailsForAllAccounts

 * jmap: add CreateIdentity, UpdateIdentity; groupware: add
   GetIdentityById, AddIdentity, ModifyIdentity

 * add temporary workaround until Calendars, Tasks, Contacts are
   implemented in Stalwart when determining the default account for
   those: use the mail one in the mean time
2025-12-09 09:15:38 +01:00
Pascal Bleser
633679c8de groupware: add instructions for using stalwart-admin 2025-12-09 09:15:38 +01:00
Pascal Bleser
cb2c6dc661 groupware: fix NPE when one of the accounts is a group account 2025-12-09 09:15:38 +01:00
Pascal Bleser
b580392a4c groupware: fix devtools LDAP passwords, as it was breaking regular opencloud drive authentication 2025-12-09 09:15:38 +01:00
Pascal Bleser
4cb8a8ae18 groupware: DEVELOPER.md: add note explaining LDAPTLS_REQCERT 2025-12-09 09:15:38 +01:00
Pascal Bleser
ecc9e6b34f groupware: accept both '_' and '*' as the 'default account' placeholder 2025-12-09 09:15:38 +01:00
Pascal Bleser
f1972e0e23 groupware: DEVELOPER.md: explain how to set a quota on a user using the Stalwart management API 2025-12-09 09:15:38 +01:00
Pascal Bleser
2efc4fdfce groupware: jmap: don't collpase threads when searching for emails, and add dumping of JMAP request payloads when trace logging is enabled 2025-12-09 09:15:38 +01:00
Pascal Bleser
d3cb741e44 groupware: try an alternative way to configure Stalwart dynamically in the devtools Docker Compose setup, by using separate files and ${STALWART_AUTH_DIRECTORY} to name to file to mount 2025-12-09 09:15:38 +01:00
Pascal Bleser
73fd7e0f78 jmap: add GetInboxNameForMultipleAccounts 2025-12-09 09:15:38 +01:00
Pascal Bleser
96fcf961b8 groupware: add Mermaid diagrams to describe the two setup options 2025-12-09 09:15:38 +01:00
Pascal Bleser
f5ac62859a groupware: implement email updating and email keyword updating endpoints 2025-12-09 09:15:38 +01:00
Pascal Bleser
051b483def docs(groupware): upgrade @redocly/cli 2.3.1 -> 2.4.0 2025-12-09 09:15:38 +01:00
Pascal Bleser
d470b5176b jmap: fix Email/set 2025-12-09 09:15:38 +01:00
Pascal Bleser
925d9b894b groupware: further updates to make everything work with the builtin LDAP and OIDC 2025-12-09 09:15:38 +01:00
Pascal Bleser
3da0debdec groupware: for /accounts/all/emails/latest/summary, rename the ?unread query parameter into ?seen as that is more intuitive 2025-12-09 09:15:38 +01:00
Pascal Bleser
197c8543f2 groupware: make everything also work with the built-in LDAP and IDP 2025-12-09 09:15:38 +01:00
Pascal Bleser
11a69969f6 groupware: devtools: Stalwart: add internal LDAP configuration 2025-12-09 09:15:38 +01:00
Pascal Bleser
d7b675251d groupware: update @redocly/cli from 2.3.0 to 2.3.1 2025-12-09 09:15:38 +01:00
Pascal Bleser
996bc858c7 docs(groupware): fix basepath in OpenAPI, /groupware instead of /groupware/groupware 2025-12-09 09:15:38 +01:00
Viktor Scharf
b369f8b415 fixed connection reset issue. adapted make file to generate swagger docs on mac 2025-12-09 09:15:38 +01:00
Pascal Bleser
7587c54e4e groupware: improve jmap integration tests
* use gofakeit instead of loremipsum, as it can also fake images for
   attachments

 * random emails for testing: generate threads, add attachments
2025-12-09 09:15:38 +01:00
Pascal Bleser
e6abc2d8ff groupware: rewrite JMAP integration test to be more reusable, and upgrade Stalwart container to 0.13.4 2025-12-09 09:15:38 +01:00
Pascal Bleser
0052d6fc4f groupware: upgrade Stalwart in devtools from 0.13.2 to 0.13.4
* changes from 0.13.4:
   - JMAP: Protocol layer rewrite for zero-copy deserialization and
     architectural improvements.
   - IMAP: Unbounded memory allocation in request parser
     (CVE-2025-61600)
   - IMAP: Wrong permission checked for GETACL.
   - JMAP: References to previous method fail when there are no results
     (stalwartlabs#1507).
   - JMAP: Enforce quota checks on Blob/copy.
   - JMAP: Mailbox/get fails without accountId argument (stalwartlabs#1936).
   - JMAP: Do not return invalidProperties when email update doesn't
     contain changes (stalwartlabs#1139)
   - iTIP: Include date properties in REPLY (stalwartlabs#2102).
   - OIDC: Do not set username field if it is the same as the email field.
   - Telemetry: Fix calculateMetrics housekeeper task (stalwartlabs#2155).
   - Directory: Always use rsplit to extract the domain part from email
     addresses.

  * changes from 0.13.3:
   - CLI: Health checks
   - WebDAV: Assisted discovery v2
   - iTIP: Do not send a REPLY when deleting an event that was not
     accepted.
   - iTIP: Include event details in REPLY messages (stalwart#2102).
   - iTIP: Add organizer to iMIP replies if missing to deal with MS
     Exchange 2010 bug.
   - OIDC: Do not overwrite locally defined aliases (stalwart#2065).
   - HTTP: Scan ban should only be triggered by HTTP parse errors.
   - HTTP: Skip scanner fail2ban checks when the proxy client IP can't
     be parsed (stalwart#2121).
   - JMAP: Do not allow roles to be removed from system mailboxes
     (stalwart#1977).
   - JMAP WS: Fix panic when using invalid server url.
   - SMTP: Do no send EHLO twice when STARTTLS is unavailable
     (stalwart#2050).
   - IMAP: Allow ENABLE UTF8 in IMAPrev1.
   - IMAP: Include administer permission in ACL responses.
   - IMAP: Add owner rights to ACL get responses.
   - IMAP: Do not auto-train Bayes when moving messages from Junk to
     Trash.
   - IMAP/ManageSieve: Increase maximum quoted argument size
     (stalwart#2039).
   - CalDAV: Limit recurrence expansions in calendar reports
     (CVE-2025-59045).
   - WebDAV: Do not fix percent encoding on WebDAV FS (stalwart#2036).
2025-12-09 09:15:38 +01:00
Pascal Bleser
2343e7fa83 groupware: add bootstrapping on / with quotas for all accounts 2025-12-09 09:15:38 +01:00
Pascal Bleser
d95b9a8e8f groupware: add /quota for all accounts 2025-12-09 09:15:38 +01:00
Pascal Bleser
a5701ceb83 groupware: improve instructions in DEVELOPER.md 2025-12-09 09:15:38 +01:00
Pascal Bleser
d79f0b3829 groupware: update @redocly/cli: 2.2.2 -> 2.3.0 2025-12-09 09:15:38 +01:00
Pascal Bleser
abb57193ff groupware: add quota API + add support for Accept-Language and Content-Language 2025-12-09 09:15:37 +01:00
Pascal Bleser
01b4a1f751 groupware: minor improvements to the DEVELOPER.md 2025-12-09 09:15:37 +01:00
Pascal Bleser
17b281cadf groupware: add flag to currently ignore session capability checks for calendars, contacts and tasks, as those are not implemented in Stalwart yet; will need to remove it in the future 2025-12-09 09:15:37 +01:00
Pascal Bleser
f4f24664ad groupware: add JMAP capability checking (in part: for contacts, calendars, tasks) 2025-12-09 09:15:37 +01:00
Pascal Bleser
101f38dd0b /auth: add SkipXAccessToken:true 2025-12-09 09:15:37 +01:00
Pascal Bleser
ebd51dba3b groupware: add mock endpoints for tasklists and tasks 2025-12-09 09:15:37 +01:00
Pascal Bleser
ed488b5a01 groupware: implement JMAP Task specification 2025-12-09 09:15:37 +01:00
Pascal Bleser
2c6ff6cd9e groupware: more mock data, added missing JMAP types 2025-12-09 09:15:37 +01:00
Pascal Bleser
eeccb56d19 groupware: add mock endpoints for addressbooks and contacts 2025-12-09 09:15:37 +01:00
Pascal Bleser
04b038a129 opencloud_full: also keep the 'Trace-Id' HTTP header 2025-12-09 09:15:37 +01:00
Pascal Bleser
09f69c5a62 implement JSCalendar (RFC 8984) 2025-12-09 09:15:37 +01:00
Pascal Bleser
85fed11797 services/groupware/DEVELOPER.md: adapt to new path for the opencloud_full deployment 2025-12-09 09:15:37 +01:00
Pascal Bleser
0e3e9607c3 JSContact: refactored after full test coverage, stronger typing for enumerations 2025-12-09 09:15:37 +01:00
Pascal Bleser
e2c9350ea1 Implement JSContact (RFC9553) Model
* add pkg/jscontact with the implementation of the RFC9553 data model

 * add JMAP Calendar session capabilities support in pkg/jmap
2025-12-09 09:15:37 +01:00
Pascal Bleser
5cc98f0792 Docker Compose Groupware improvements
* made a few changes in order to further simplify the setup for
   developers of the Groupware backend

 * add STALWART_DOMAIN to deployments/examples/opencloud_full/.env

 * adapt the Stalwart configuration file to not set server.hostname and,
   instead, pick it up from /etc/hostname, which is set by Docker
   Compose as we can use default values for STALWART_DOMAIN there, in an
   analogous fashion to the other containers in that project

 * add config/keycloak/clients/groupware.json to avoid requiring manual
   configuration of Keycloak via the admin web UI

 * Stalwart container:
   - listen for SMTPS on :1465
   - remove the stalwart-logs volume, not needed (logs are going to
     stdout)

 * updated services/groupware/DEVELOPER.md:
   - refer to a variable OCDIR to make instructions more copy-pasteable
   - remove manual Keycloak configuration section as it is now obsolete,
     replaced by provisioning a configuration file instead
2025-12-09 09:15:37 +01:00