41d7a93c6b
Load darc files in fileTableReader
2024-05-23 09:19:52 -07:00
864f9621e0
[store] use hasCache to minimize pendingRef pool ( #7672 )
...
* [store] use hasCache to minimize pendingRef pool
* better interfaces
* fmt
* vet
2024-04-02 14:53:31 -07:00
053e6caa24
[store] one hashset for child ref checks ( #7654 )
...
* [store] one hashset for child ref checks
* tests
* rename, docstring
2024-04-01 11:16:28 -07:00
06a99f8e7d
[ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh
2024-03-13 00:45:21 +00:00
3535a4908e
Drop nbs.addr type in favor of hash.Hash type
2024-03-12 17:35:24 -07:00
e72a0abc61
go/store/nbs: store.go: Clean up how we update hasCache so that we only update it after successfully writing the memtable.
2023-09-28 15:47:27 -07:00
91db6fecc9
Godeps and repofmt.
2023-05-24 09:47:00 -07:00
6806302c7e
go/nbs/store: Add a two queue LRU cache for recently validated present refs.
...
Improves the performance of the sanity checks we run when adding new chunks to
the chunk store.
2023-05-24 09:02:52 -07:00
af5c3cbebf
go/store/nbs: Rework tablePersister.Exists checks to only do them when we add files external to the NomsBlockStore.
2023-02-28 16:01:20 -08:00
db5c420020
[no-release-notes] SIGINT gracefully shuts down merge ( #5426 )
...
* [no-release-notes] SIGINT gracefully shuts down merge
del
* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh
* aaron's comments
* another aaron comment
* dont reuse ctx in migrate
---------
Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com >
2023-02-24 14:39:04 -08:00
a8bf4f6399
go/store/nbs: store.go: Ensure we clear nbs.mt when we see a dangling ref.
2023-01-31 18:43:06 -08:00
5253e3c85a
go/store/nbs: store.go: Change memtable reference sanity check to happen at table_set.append() instead of trying to check novel chunk sources.
...
Removes enforce completeness functionality from ValueStore, which becomes
superfluous.
2023-01-31 17:02:58 -08:00
c049744795
go/store/nbs: Update table-file-exists sanity check to not check for files which are already in our view of upstream.
2023-01-27 09:55:05 -08:00
210903f177
pr feedback
2023-01-25 12:29:08 -08:00
bebcd8065a
go/store/nbs: fix race in table existence check
2023-01-25 08:22:12 -08:00
6a30d36b78
go/store/nbs: add concurrency toblobstore persister operations
2023-01-24 18:43:43 -08:00
d3e960e927
refactored chunkSource interface
2022-12-07 18:07:42 -08:00
edcc243c13
added chunkJournal, journalWriter, and journalChunkSource
2022-11-28 14:54:11 -08:00
b66f5b1600
fix race in tableSet
2022-11-23 14:10:07 -08:00
45acdc0c6a
swap chunkSources for chunkSourceSet in tableSet
2022-11-23 14:01:50 -08:00
1f5287fe4b
sort table specs by address
2022-11-23 13:59:44 -08:00
24d1e16e16
added error return to tableSet.prepend()
2022-11-23 13:59:44 -08:00
0324e0752e
go/store/nbs: remove unused error from chunkSource.hash()
2022-11-23 12:06:24 -08:00
cab0997abd
Some fixes
2022-11-22 16:05:25 -08:00
23ad8ea58c
Add check to UpdateManifest that all table files exist before updating manifest
2022-11-22 15:59:20 -08:00
2d38c8a2b1
refactored tableSet.rebase(), improved memory quota accounting for tests
2022-11-03 17:03:51 -07:00
90fd4e6788
refactored MemoryQuotaProvider to manage buffers more directly
2022-11-03 17:03:51 -07:00
36c83f1b85
removed chunkReader.extract(), converted public method to private for chunkReader, chunkSource and tableSet
2022-10-26 14:27:12 -07:00
7f66f4c7e3
remove chunkReadPlanner interface
2022-10-25 13:43:12 -07:00
6bb8889545
remove calcReads from chunkSource interface
2022-10-25 11:31:20 -07:00
a104e83b02
fix rebase when specs are duplicated
2022-04-13 16:48:52 -07:00
776182eca3
close opened chunk sources if we are cancelled during a rebase.
2022-04-13 11:25:17 -07:00
f3ba18564c
fix test
2022-04-08 15:22:55 -07:00
0a1df15cce
AcquireQuota in single block
2022-04-08 15:12:00 -07:00
783a6f2fe9
optimize index usage and fix acquire quota underestimate
2022-04-07 13:22:07 -07:00
69c8021920
Push ReleaseQuota down into onHeapTableIndex Close()
2022-03-28 16:06:33 -07:00
2e38b25dbc
thread memory quota provider through tableSet
2022-03-24 12:27:41 -07:00
0ce0d2c03c
Fix found gcs bug
2022-03-11 11:19:19 -08:00
521d4f2728
change tableIndex interface to return errors
2022-02-09 19:03:12 -08:00
abffd995df
go/libraries/doltcore/remotestorage: Interface for cache returns true if cache is full / truncated in size.
2021-10-04 16:51:58 -07:00
39d7ad7eaf
/go/store/nbs/table_set.go: pr feedback changes
2021-05-14 14:37:19 -07:00
546cb84bb0
/go/store/nbs/table_set.go: open tables in order
2021-05-14 11:43:20 -07:00
84c3066348
go/**/*.go: Update copyright headers for company name change.
2020-11-02 10:17:02 -08:00
40612402b9
go/store/nbs: table_set.go: Slightly clean up getMany, getManyCompressed err handling.
2020-10-14 19:07:12 -07:00
623606c07c
format_repo.sh
2020-10-14 17:06:32 -07:00
c713363972
go/store/nbs: Convert chunkReader interfaces from atomicerr/waitgroup to errgroup.
2020-10-14 16:17:08 -07:00
743539113a
go/store/nbs: table_reader.go: Small cleanup on unused reqs param in some read functions.
2020-10-14 15:19:00 -07:00
6963134640
go/store/nbs: Convert GetManyCompressed to callback instead of output channel.
2020-10-14 14:46:50 -07:00
cbc28198b9
go/store/chunks: Convert ChunkStore GetMany interface to send results to callback instead of output channel.
2020-10-14 14:28:18 -07:00
b5bb663233
Reference new org name and updated trigger logic
2020-09-25 15:35:04 -07:00
Neil Macneale IV