Files
dolt/types
Benjamin Kalman 338de4e583 Correctly distinguish between chunking window size and buzhash window size.
Previously the buzhash boundary checker used a single value for the
window size, both as the buzhash buffer size when constructing a hash
object, and reported as its window size to the boundary checker
interface. This was wrong because we don't always pass single byte
values to the hasher, for example refs are 20 bytes.

The compound list chunking compensated for this by only passing the
first byte of each list leaf's ref rather than the full ref. This is bad
because there is obviously less entropy in 1 byte vs 20 bytes.

The meta sequence chunking compensated for this by multiplying the
chunking window size by 20, but this also had the effect of
unnecessarily considering 20 times more chunked elements than would fit
in the buzhash buffer.
2015-12-03 14:58:35 -08:00
..
2015-11-09 08:26:32 -08:00
2015-10-28 12:38:30 -04:00
2015-10-28 12:38:30 -04:00
2015-11-13 17:54:53 -05:00
2015-11-13 17:54:53 -05:00
2015-11-13 17:54:53 -05:00
2015-10-28 12:38:30 -04:00
2015-11-13 17:54:53 -05:00
2015-11-20 16:40:19 -08:00
2015-11-13 17:54:53 -05:00
2015-11-13 17:54:53 -05:00
2015-11-13 17:54:53 -05:00
2015-11-09 08:26:32 -08:00
2015-11-13 17:54:53 -05:00
2015-11-13 17:54:53 -05:00
2015-11-13 17:54:53 -05:00
2015-11-16 11:27:47 -08:00
2015-11-13 17:54:53 -05:00
2015-11-13 17:54:53 -05:00
2015-11-13 17:54:53 -05:00
2015-11-13 17:54:53 -05:00
2015-11-13 17:54:53 -05:00
2015-11-13 17:54:53 -05:00
2015-11-13 17:54:53 -05:00
2015-11-13 17:54:53 -05:00
2015-11-13 17:54:53 -05:00