Commit Graph

4678 Commits

Author SHA1 Message Date
Damandeep Singh 5ce7ea7aa0 chore: added test case for log_format 2025-02-27 21:23:51 +05:30
Damandeep Singh fd2757a8d4 chore: changes for adding test case for log_format 2025-02-27 20:50:28 +05:30
Damandeep Singh 1b54546db8 Added missing ',' 2025-02-26 15:53:14 +05:30
Damandeep Singh 20fadb718b typo fix 2025-02-26 13:06:44 +05:30
Damandeep Singh bd70972cdf configured logger for logFormat 2025-02-26 12:27:49 +05:30
Damandeep Singh c723ce55d1 changes for log_format 2025-02-26 02:29:11 +05:30
Aaron Son df991698ec go: sqle/auto_gc: Add some simple tests for controller and hook. 2025-02-23 11:46:12 -08:00
Aaron Son 36b39dfc25 Merge remote-tracking branch 'origin/main' into aaron/autogc 2025-02-22 15:27:49 -08:00
coffeegoddd cd1ed7276b [ga-bump-release] Update Dolt version to 1.49.3 and release v1.49.3 2025-02-21 19:07:30 +00:00
Aaron Son 20f38cae6f Merge remote-tracking branch 'origin/main' into aaron/autogc 2025-02-19 13:30:33 -08:00
coffeegoddd f9a5d44353 [ga-bump-release] Update Dolt version to 1.49.2 and release v1.49.2 2025-02-17 20:37:56 +00:00
Aaron Son 7c9c808bf3 Merge remote-tracking branch 'origin/main' into aaron/autogc 2025-02-13 17:32:18 -08:00
Aaron Son 2a47d402b2 go: sqle: auto_gc: Responding to PR feedback. Comments and cleanup. 2025-02-13 17:24:03 -08:00
Aaron Son 9b53d20c7c go: cmd: sqlserver: Fix nil SIGSEGV on AutoGCBehavior read in init. 2025-02-10 20:55:21 -08:00
Aaron Son dc4b94d68d sql-server: Add behavior: auto_gc_behavior: enable.
When Auto GC is enabled, the running sql-server will periodically
collect a Dolt database that is growing in size. This behavior
is currently experimental. Tuning the behavior around how often to collect is
ongoing work.
2025-02-10 19:54:44 -08:00
Aaron Son db1878d5a0 go: sqle: Move replication hook thread start to a separate phase of initialization.
Do not do it immediately when we create the hook itself, since at
that time we may not have all the machinery in place to get the
dependencies of the threads.

Also moves the installation of the replication hook init database hook to a
separate call on the DoltDatabaseProvider, instead of always installing those
hooks.
2025-02-10 19:50:25 -08:00
Aaron Son ac6d4d4ad2 Merge pull request #8816 from dolthub/aaron/cluster-push-hook-sql-session-lifecycle
[no-release-notes] go: sqle/cluster: commithook: Create a sql session and make lifecycle callbacks when accessing srcDB.
2025-02-10 18:38:34 -08:00
Aaron Son b8a6bc75e0 Merge remote-tracking branch 'origin/main' into aaron/cluster-push-hook-sql-session-lifecycle 2025-02-10 17:26:44 -08:00
Aaron Son c248410b4a Merge remote-tracking branch 'origin/main' into aaron/doltdb-commit-hooks-sqle 2025-02-10 17:21:48 -08:00
Aaron Son 209e669ce2 Merge pull request #8830 from dolthub/aaron/sqle-database-replication-fix-double-hook
[no-release-notes] go: sqle: DatabaseProvider: Fix double-creation of push-on-write commit hooks in registerNewDatabase.
2025-02-10 17:09:18 -08:00
James Cor 2d8f6d4ad0 move status messages from parquet to stderr (#8842) 2025-02-10 15:50:05 -08:00
coffeegoddd 13d1c2d3de [ga-bump-release] Update Dolt version to 1.49.1 and release v1.49.1 2025-02-07 22:50:52 +00:00
Aaron Son 5a6caadf1c [no-release-notes] go: sqle: DatabaseProvider: Fix double-creation of push-on-write commit hooks in registerNewDatabase. 2025-02-06 14:55:35 -08:00
Aaron Son 9640010943 go: sqle,doltdb: Move commit hooks from doltdb to sqle. 2025-02-05 17:49:43 -08:00
Neil Macneale IV cc437256f0 fix build break (#8819) 2025-02-05 12:06:02 -08:00
coffeegoddd 8cc323e7f3 [ga-bump-release] Update Dolt version to 1.49.0 and release v1.49.0 2025-02-05 17:42:53 +00:00
Jason Fulghum d7662062a8 Merge pull request #8800 from dolthub/fulghum/rm-sql-server-user
Remove `user` and `password` options for sql-server
2025-02-05 09:09:38 -08:00
Aaron Son dce03debf9 [no-release-notes] go: sqle/cluster: commithook: Create a sql session and make lifecycle callbacks when accessing srcDB.
As part of GC safepoint establishment, we need lifecycle callbacks
around all the places we access the database. This PR adds those
callbacks to the cluster replication commithook.

Lifecycle on registering the commit hooks on the database versus
creating the SqlEngine instance is a little wonky. Concretely,
we register the hooks before we create the SqlEngine, but we
we change things so that we start running them after the SqlEngine
is created and can supply the appropriate factory for the
sql.Context.
2025-02-04 16:59:06 -08:00
Nick Tobey b4b6d7110a Merge pull request #8783 from dolthub/nicktobey/lazy-load
Avoid loading DB for commands where it's not necessary.
2025-02-03 15:02:48 -08:00
LiuLiu 00cacf4ea6 printf 2025-02-03 13:54:04 -08:00
Jason Fulghum 9dd401c286 Deprecate user and pass options for sql-server 2025-02-03 13:21:07 -08:00
LiuLiu 3cf7df20d9 print start server log 2025-02-03 13:14:03 -08:00
Nick Tobey 2911085fc0 Merge remote-tracking branch 'origin/main' into nicktobey/lazy-load 2025-02-03 12:45:10 -08:00
Aaron Son 52b625f3f2 Merge remote-tracking branch 'origin/main' into aaron/dsess-lifecycle 2025-02-03 10:01:27 -08:00
Aaron Son 0ef447e2a0 Merge pull request #8797 from dolthub/aaron/sql-server-remotesapi-session-lifecycle
[no-release-notes] go: sqle,remotesrv: Implement sql.Session lifecycle callbacks for sql.Contexts used in remotesrv RPCs.
2025-01-31 13:27:17 -08:00
Nick Tobey b1aa361eed Merge remote-tracking branch 'origin/main' into nicktobey/lazy-load 2025-01-30 15:21:30 -08:00
Aaron Son b9f6a56cf9 go: sqle: dprocedures: dolt_gc: Get the safepoint controller from the session. Fixes special-case lifecycle for dolt_gc procedure. 2025-01-30 13:44:33 -08:00
Aaron Son 13c9ddf104 go: sqlserver,binlogreplication: Clean up session usage a little to have more principled lifecycle. Starting replication never uses the replcation execution context. 2025-01-28 16:58:38 -08:00
Aaron Son 915e392b10 go: sqle: dsess: Make DoltSession Lifecycle aware. Move towards a GCSafepointController which can work with it. 2025-01-28 15:12:54 -08:00
Aaron Son 366e466a7e go: sqle/dprocedures: dolt_gc: Move to an intantiated instance.
Allows dolt_gc implementation to carry state, such as a session
manager. This prepares for it to implement more robust GC safepoints.
2025-01-28 15:12:54 -08:00
Aaron Son c401029a75 Merge pull request #8794 from dolthub/aaron/sql-replication-session-lifecycle
[no-release-notes] go: binlogreplication: Add Session{{Begin,End}Command,End} lifecycle callbacks to the replica controller execution context session.
2025-01-28 14:55:12 -08:00
Aaron Son a6b1a269c9 go: sqle,remotesrv: Implement sql.Session lifecycle callbacks for sql.Contexts used in remotesrv RPCs.
This PR changes each RPC invocation against the gRPC and HTTP servers
implementing remotesapi and cluster replication to create a sql.Context
which lives the duration of the call. The Session for that call gets
SessionCommand{Begin,End} and SessionEnd lifecycle callbacks so that it
can participate in GC safepoint rendezvous appropriately.

Previously the remotesrv.DBCache and the user/password remotesapi
authentication implementation would simply create new sql.Contexts
whenever they needed them. There could be multiple sql.Contexts for the
single server call.
2025-01-28 14:28:44 -08:00
Aaron Son 5b55d324e3 go: sqlserver: Clean up how remotesrv gets a handle to the mrEnv.FileSystem, remove the confusing indirection through ctxFactory. 2025-01-28 13:30:47 -08:00
Aaron Son 89eb2afb7c go: cmd/dolt: sqlengine: Actually call DoltBinlogReplicaController.Close when closing the SqlEngine. 2025-01-27 17:57:35 -08:00
coffeegoddd bde0bf9fe0 [ga-bump-release] Update Dolt version to 1.48.0 and release v1.48.0 2025-01-28 00:01:37 +00:00
Nick Tobey f78cc0d6b9 Merge remote-tracking branch 'origin/main' into nicktobey/lazy-load 2025-01-24 15:14:12 -08:00
coffeegoddd 7e5e325bbd [ga-bump-release] Update Dolt version to 1.47.2 and release v1.47.2 2025-01-24 21:35:09 +00:00
Nick Tobey 411b676af4 Respond to PR feedback. 2025-01-23 16:54:54 -08:00
Nick Tobey d43ce7f159 Merge remote-tracking branch 'origin/main' into nicktobey/lazy-load 2025-01-23 12:47:34 -08:00
Nick Tobey e89385dfe9 Add url parameter to LoadWithoutDB and remove LoadWithDeferredDB 2025-01-23 12:13:58 -08:00