c3af0c6b84
go/store/nbs: aws_table_persister.go: Convert to using s3manager.Uploader instead of hand rolled multipart upload.
...
s3manager.Uploader gets us pooled byte slices, sane sizing and concurrency
limits, optimizations to use io.ReadSeeker when it's available, etc.
Fixes a bug where aws_table_persister could have unbounded memory usage,
proportional to the size of the file, when uploading large table files to S3.
2023-10-25 16:27:58 -07:00
21c1a1329c
go/store/nbs: Convert to use s3iface.S3API as the minimally mockable interface for our S3 client.
2023-10-25 15:19:17 -07:00
6995bad390
go/store/nbs: aws_table_persister.go: Thread the io.Reader to uploadParts.
2023-10-25 15:09:59 -07:00
b6a077ceb9
Prolly stats ( #6794 )
...
* Prolly tree stats
* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh
* test fix
* bump
* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh
---------
Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com >
2023-10-16 08:47:31 -07:00
c904f25c4e
Cleaning up
2023-10-11 15:47:52 -07:00
3335a3ffa1
Turning panic back on to get log output from CI tests
2023-10-11 15:19:51 -07:00
535842d8d4
Debug output
2023-10-11 15:04:09 -07:00
044a2a5b69
Cleaning up debugging output
2023-10-11 15:01:03 -07:00
960f24df8a
More debugging
2023-10-11 14:20:59 -07:00
52932c5577
Debugging windows-specific erorr about chunk journal being closed multiple times
2023-10-11 12:32:35 -07:00
b27db84190
Merge pull request #6703 from dolthub/nicktobey/tuples
...
When a three-way merge contains an altered column, convert values to the new column type in order to prevent conflicts.
2023-10-03 14:49:09 -07:00
645c9e2835
Update callback method signature in tests.
2023-10-03 10:54:42 -07:00
6f93045954
Allow error propagation when merging cells in schema merges.
2023-10-02 16:07:44 -07:00
d6b8936a30
Merge remote-tracking branch 'origin/main' into aaron/fix-hasCache-dangling-references-bug
2023-09-29 10:18:27 -07:00
e72a0abc61
go/store/nbs: store.go: Clean up how we update hasCache so that we only update it after successfully writing the memtable.
2023-09-28 15:47:27 -07:00
880a9f9c74
store/nbs/store.go: Fix a data corruption bug involving concurrent gc and failure to invalidate caches when we throw partially written data away.
2023-09-28 15:15:24 -07:00
4afa2864ca
[ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh
2023-09-28 21:23:31 +00:00
ab8050d69c
Suport for DOLT_AUTHOR_DATE in dolt commit
2023-09-26 12:00:00 -07:00
5460b9ddba
Fixed a reference to committer time that should have been user time
2023-09-26 12:00:00 -07:00
3e58b2e575
Merge branch 'zachmu/timestamp-commit' into zachmu/timestamp-commit2
2023-09-26 12:00:00 -07:00
f05857d734
Standardizing how we get commit timestamps
2023-09-26 12:00:00 -07:00
b435203659
Fixed bats tests
2023-09-26 12:00:00 -07:00
9c57399740
[ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh
2023-09-27 22:14:05 +00:00
4d9d2c9446
Moved all env constants to a new dconfig package
2023-09-26 12:00:00 -07:00
b77e97785f
Fixed tag human readable serialization
2023-09-26 12:00:00 -07:00
8886f5bff2
Moving all environment variables to consts in the same file
2023-09-26 12:00:00 -07:00
ea172506fd
Added missing fields to commit output
2023-09-26 17:15:24 -07:00
d14436ef4b
Add Context parameter to processColumn.
2023-09-21 23:05:41 -07:00
25fa4f6e88
Return not found for non-existent DB refs
2023-09-18 11:34:41 -07:00
cc242a6f3f
Fixing bugs for building a prefix index with existing table data
2023-08-24 14:41:46 -07:00
b09149fc96
Tidying up
2023-08-22 15:00:21 -07:00
04c9cdde66
[ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh
2023-08-16 22:48:37 +00:00
460b538ef8
Merge main
2023-08-16 15:25:27 -07:00
a24d47bb7a
Added schema output to noms show
2023-08-15 18:32:32 -07:00
bd644b8774
Bug fix for panic in schema merge when schema contains BLOB columns
2023-08-15 13:39:10 -07:00
83c3f3f807
Tidying up
2023-07-21 16:55:34 -07:00
e5a20ca89d
Saving/loading IsCherryPick with flatbuffers
2023-07-21 15:30:22 -07:00
ea9c26520a
First pass on fixing incorrect, multiple parents for cherry-picked commits when conflicts need to be resolved.
2023-07-21 14:39:24 -07:00
f977c89b31
typo fix
2023-07-17 14:11:26 -07:00
c244ff1c24
Tidying up
2023-07-17 11:48:15 -07:00
695a3a4fdc
First pass at updating unique constraint violation artifacts when we see row delete events come in
2023-07-13 16:31:35 -07:00
fb181cbd39
fixes infinite loop related
2023-06-28 15:32:10 -07:00
16661ec105
Merge pull request #6244 from dolthub/aaron/fix-dolt-clone-on-sqlserver-with-gc
...
dolt clone: Fix dolt clone run against a sql-server where the database has been GCd.
2023-06-28 09:10:49 -07:00
c0b0cc42d1
dolt clone: Fix dolt clone run against a sql-server where the database has been GCd.
...
A long-standing bug in the remotesapi which the sql-server exposes could cause
a `dolt clone` to fail when running against a database which had been garbage
collected. This change fixes the bug in the server. It also patches the client
behavior so that it will tolerate responses from older versions of dolt.
2023-06-27 16:41:22 -07:00
bab16e35c0
chore: fmt modify
2023-06-27 17:00:01 +08:00
358594ec76
update licenses
2023-06-01 11:32:02 -07:00
44633e6ee9
replace encoding/json with goccy/go-json for improved unmarshalling
2023-05-31 17:01:55 -07:00
f1eda2b3e8
go/store/nbs: table_reader: Pick up binary search for index lookup in the getMany path as well.
2023-05-26 11:41:03 -07:00
0bfd57ae4d
[no-release-notes] Pushdown refactor, deprecate sql.FilteredTable, ColumnDiffTable correctness ( #6024 )
...
* [no-release-notes] Pushdown refactor, deprecate sql.FilteredTable,
ColumnDiffTable correctness
Pushdown splitting into two phases uncovered bugs. sql.FilteredTable
is now deprecated. ColumnDiffTable correctness tests were never run
through the indexing path before, which are broken. This disables the
indexing path and runs the proper test suites.
* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh
* bump
* tidy
* missing interface method
* mod tidy
* formatter
---------
Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com >
2023-05-24 16:32:20 -07:00
af3bbbbcd7
go/store/nbs: swapTables: Add a comment about why we call hasCache.Purge() here.
2023-05-24 11:10:21 -07:00
Aaron Son