Commit Graph

18 Commits

Author SHA1 Message Date
Aaron Son dfdb4a4b2a go: sqle: cluster: Implement a first pass at dolt_cluster_ack_writes_timeout_secs.
Setting this system variable to a non-zero value on a primary replica in a
sql-server cluster will cause dolt to block a SQL client performing a commit
until that client's commit is fully replicated to the replicas.

If there is a timeout, currently a warning is logged in the logs.
2023-05-11 15:50:43 -07:00
Aaron Son 6e6ed1b77b Fix result ordering in integration test. 2023-05-09 14:08:19 -07:00
Aaron Son acf99f1edf go: sqle: dolt_gc.go: Disable CALL dolt_gc() on a standby replica, where it is not currently safe. Shallow GC is still available. 2023-05-09 13:41:16 -07:00
Zach Musgrave 75b1395510 New integration test ala aaron 2023-05-05 07:42:32 -07:00
Aaron Son 1d0a6001ac go/libraries/doltcore/sqle: database_provider.go: When cloning a remote into a sql-server, always run the InitDatabaseHook on it.
Failing to run the hook means that the cloned database is not appropriately
configured for replication, for example.

Fixes: #5850
2023-05-01 12:42:02 -07:00
Aaron Son f7c69bf881 Merge pull request #4749 from dolthub/aaron/cluster-jwks-auth
go/libraries/doltcore/sqle/cluster: Add JWT authentication for peer communication to cluster replicas.
2022-11-15 12:21:55 -08:00
Aaron Son 6d7a569e61 integration-tests/go-sql-server-driver: Use 385{1,2} instead of 5005{1,2} for cluster remotesapi ports. 2022-11-10 16:34:49 -08:00
Aaron Son b22fbf11f2 go/libraries/doltcore/sqle/cluster: Add JWT authentication for peer communication to cluster replicas.
A remotesapi server running on a cluster replica publishes a JWKS.

Every outbound GRPC call the cluster replica makes includes a JWT signed with a
private key.

remotesapi servers running on cluster replicas require and validate incoming
JWTs for cluster traffic. The set of valid signing keys is taken from the
JWKSes which are published at /.well-known/jwks.json on the standby replica
hosts.

It is possible to configure tls_ca on cluster remotesapi to configure the set
of trusted roots for outbound TLS connections. Because the JWKSes are served
over the same connection, and becuase signed JWTs are not replay resistent, TLS
is recommended for all deployment topologies.
2022-11-10 09:26:38 -08:00
Aaron Son 248be8b21a go/libraries/doltcore/sqle/cluster: Add the ability to configure SAN assertions on URIs and DNS names in the server certificate when configuring TLS. 2022-10-28 10:31:14 -07:00
Aaron Son 27a528e498 go/libraries/doltcore/sqle/cluster: Add support for configured tls_{cert,key,ca} on the cluster.remotesapi.
For now, this is server-side TLS, not mTLS.

If a tls_ca is configured, the certificates in that file are PEM encoded. They
are the only trusted roots for server certificate verification on both gRPC and
HTTP connections. If tls_ca is set, no server name verification is done for
now.
2022-10-26 16:13:51 -07:00
Aaron Son 995e3818cd go: sqle: remotesrv: Successfully replicate CREATE DATABASE commands by instantiating new databases on the standby on demand. 2022-10-05 12:37:39 -07:00
Aaron Son cc82355269 integration-tests/go-sql-server-driver: Fix JSON test for LD_1. 2022-10-04 11:49:11 -07:00
Aaron Son c56b0630a9 integration-tests/go-sql-server-driver: Finish transitioning the rest of the sql-server-cluster tests. 2022-10-04 10:22:38 -07:00
Aaron Son fa7db054ad integration-tests/go-sql-server-driver: Convert some more sql-server-cluster.bats tests. 2022-10-03 17:23:53 -07:00
Aaron Son bf7480eb1b integration-tests/go-sql-server-driver: sql-server-cluster.yaml: Fix dolt_assume_cluster_role tests for new behavior of not breaking connection when role does not change. 2022-10-03 15:02:40 -07:00
Aaron Son 7ebc1bb45f integration-tests/go-sql-server-driver: Move Server definitions to TestRepo/MultiRepo, instead of a separate top-level field. 2022-10-03 12:04:35 -07:00
Aaron Son 87de2bb7d9 integration-tests/go-sql-server-driver: Add retry_attempts functionality, drop sleep_millis. Add some documentation. 2022-10-03 11:38:01 -07:00
Aaron Son cf639c3585 integration-tests/go-sql-server-driver: Start converting some sql-server bats tests. 2022-10-03 10:01:47 -07:00