Commit Graph

2077 Commits

Author SHA1 Message Date
Dan Willhite
2f37146f78 Noms command polish.
Fixes #1424
2016-05-05 11:51:22 -07:00
Dan Willhite
014c06bc1c Add paging to noms output. 2016-05-04 16:56:26 -07:00
Dan Willhite
b1257f71e5 Merge pull request #1409 from willhite/work
Implement noms command.
2016-05-04 12:09:05 -07:00
Dan Willhite
db8dd1ba51 Implement noms command.
Fixes #1152.
2016-05-04 11:59:21 -07:00
Erik Arvidsson
c9d176cb28 Cleanup serialization of types (#1410)
We used to serialize types in two different ways, depending on whether
the type was used as a tag or as a value. Now we serialize it the same
way.

Also, remove makeCompoundType completely.

And remove some dead code.
2016-05-04 11:35:33 -07:00
cmasone-attic
a6da38f91d Merge pull request #1412 from cmasone-attic/fix
Remove EncodedHumanReadable() call in checkChunksInCache
2016-05-04 11:11:54 -07:00
Chris Masone
202596169f Guard EncodedHumanReadable() call in checkChunksInCache
Turns out this can crash sometimes and is always
very expensive. Remove it.
2016-05-04 11:10:32 -07:00
Aaron Boodman
7bea08b070 Update fs to noms v22 (#1407) 2016-05-04 09:41:58 -07:00
Erik Arvidsson
963fbdaad6 Write type with value (#1406)
Write type for all values

Fixes #1308
2016-05-03 16:52:22 -07:00
Rafael Weinstein
e69b163c6d Abstract JS list tests (#1398) 2016-05-03 14:28:28 -07:00
cmasone-attic
12ae0d7e89 Merge pull request #1403 from cmasone-attic/keep-cache
Maintain validation cache on DataStore across Commit
2016-05-03 13:15:39 -07:00
Chris Masone
aa0b0fd658 JS: Maintain validation cache on DataStore across Commit
While this causes the cache to potentially grow infinitely, having a
DataStore keep track of every value it's read or written makes it
simpler to program with. Once RefValues can only come to be by being
read out of a DataStore, we can do away with this altogether.

The big changes here are that DataStore now has a ValueStore, instead
if extending ValueStore. The DataStore constructor now takes a
ValueStore, so that new instances re-use the same ValueStore can be
constructed on Commit. Since callers don't care about that detail,
this change exports NewDataStore(), which still takes a BatchStore.
2016-05-03 13:11:01 -07:00
Chris Masone
9684881b5f Go: Maintain validation cache on DataStore across Commit
While this causes the cache to potentially grow infinitely,
having a DataStore keep track of every value it's read or written
makes it simpler to program with. Once types.Ref can only come to
be by being read out of a DataStore, we can do away with this
altogether.
2016-05-03 10:19:24 -07:00
Aaron Boodman
f8026d9de4 counter-js: match formatting to counter (#1401) 2016-05-02 23:52:45 -07:00
Aaron Boodman
ff95041191 server: fix bug where usage gets printed out twice (#1400) 2016-05-02 23:46:11 -07:00
Erik Arvidsson
ef52bcac1c Upgrade counter to latest version (#1396)
This picks up a change where the order of the struct fields was
not working as expected.

Fixes #1394
2016-05-02 16:07:33 -07:00
Dan Willhite
c2c6ee037c Merge pull request #1393 from willhite/work
Implement noms-show. Fixes #1148.
2016-05-02 16:04:29 -07:00
cmasone-attic
78bd9c32f6 Merge pull request #1395 from kalman/go-commit
Go: change Datastore/Dataset Commit to use Ref<Commit> for parents
2016-05-02 15:57:41 -07:00
Dan Willhite
ab3ebf52d3 Implement noms-show. Fixes #1148. 2016-05-02 15:56:41 -07:00
Benjamin Kalman
d1484690ff Go: change Datastore/Dataset Commit to use Ref<Commit> for parents
The goal is to remove places where we construct a types.Ref from a
ref.Ref, so that we can attach a height to it later. This should also
make it unnecessary to read in the Commit values at all (which is the
case in the JS SDK) but commit validation prevents that for now.
2016-05-02 15:42:01 -07:00
Erik Arvidsson
3032c76a39 Use a map for the struct fields
Fixes #1368
2016-05-02 15:35:27 -07:00
cmasone-attic
0910829f33 Merge pull request #1391 from cmasone-attic/racy
Debugging
2016-05-02 14:48:11 -07:00
Chris Masone
12c08dc969 Go: Add hashes seen to HTTP error in writeValue handler
We're seeing some raciness in RemoteDataStore tests that don't
repro locally. This adds the hashes of all chunks seen prior to the
failure to the error response sent back by the DataStoreServer.
Hopefully, this will help debug the raciness.
2016-05-02 14:10:59 -07:00
cmasone-attic
eade0710c6 Merge pull request #1390 from cmasone-attic/roll
Roll clients to new noms SDK
2016-05-02 13:50:01 -07:00
Chris Masone
57c222a1ee Roll clients to new noms SDK
This updates clients to use the SDK version that sends network data in
network byte order.
2016-05-02 13:07:53 -07:00
cmasone-attic
0667228215 Merge pull request #1389 from cmasone-attic/issue1370
Fix JS chunk serialization to use network byte order
2016-05-02 12:59:50 -07:00
Chris Masone
9626ad5b42 Fix JS chunk serialization to use network byte order
Fixes #1370
2016-05-02 12:32:59 -07:00
cmasone-attic
848b030a4b Merge pull request #1383 from cmasone-attic/issue1377
Align Go and JS implementations of ValueStore.WriteValue()
2016-05-02 12:05:10 -07:00
Chris Masone
5eda7e8243 Align Go and JS implementations of ValueStore.WriteValue()
Fixes #1377
2016-05-02 11:54:23 -07:00
cmasone-attic
162b495cd0 Merge pull request #1388 from cmasone-attic/new_sdk
Manually update new version for JS SDK
2016-05-02 11:52:49 -07:00
Chris Masone
e45aa532a3 Manually update new version for JS SDK 2016-05-02 11:52:12 -07:00
Rafael Weinstein
4468625ce0 Update flow to 24.1 (#1385)
Update flow to 24.1
2016-05-02 11:45:49 -07:00
cmasone-attic
7ef62df1f4 Switch to network-byte-order in DataStore wire format (#1386)
* Switch to network-byte-order in DataStore wire format

Fixes #1370
2016-05-02 11:44:53 -07:00
Ben Kalman
8cc0c35829 Change MetaTuple to work with RefValue, not Ref (#1372)
Change MetaTuple to work with RefValue, not Ref
2016-05-02 11:17:18 -07:00
Aaron Boodman
53fc7cb6cd Update clients/fs to newest version of noms: (#1359)
- Use DatasetDesc to parse input
- Get rid of codegen
2016-05-02 11:01:17 -07:00
Dan Willhite
ed223d80e5 Merge pull request #1384 from willhite/work
Factor out test_utils.
2016-05-02 10:55:08 -07:00
cmasone-attic
c91d8b5abf Merge pull request #1382 from cmasone-attic/issue1280
Update splore to use HttpBatchStore
2016-05-02 10:45:41 -07:00
Dan Willhite
48640d949b Factor out test_utils.
Necessary to prevent accidential inclusion of test flags.
2016-05-02 10:43:04 -07:00
Dan Willhite
58f50b9162 Merge pull request #1301 from willhite/work
Remove -store arg. Make flags consistent to world without -store.
2016-05-02 10:39:14 -07:00
Rafael Weinstein
2caf525d9b Merge pull request #1379 from rafael-atticlabs/blobTests
Abstract & unify blob tests
2016-05-02 10:35:50 -07:00
Chris Masone
8086000d9a Update splore to use HttpBatchStore 2016-05-02 10:35:39 -07:00
Rafael Weinstein
93f9941b9f Abstract & unify blob tests 2016-05-02 10:34:41 -07:00
Dan Willhite
49917b6633 Remove -store arg and add flags library. 2016-05-02 10:33:11 -07:00
cmasone-attic
337bc35565 Merge pull request #1381 from arv/roll-splore
Update Splore to latest JS SDK
2016-05-02 10:24:09 -07:00
Chris Masone
8bce49c838 Fix noms npm package version 2016-05-02 10:22:23 -07:00
cmasone-attic
56913f8769 Merge pull request #1351 from cmasone-attic/issue1280
JS: Implement new DataStore client protocol
2016-05-02 10:14:09 -07:00
Erik Arvidsson
5fb43b308a Update Splore to latest JS SDK 2016-05-02 10:13:27 -07:00
Ben Kalman
42f34943b4 Add sha1 and utf8 tests, make implementations simpler (#1369) 2016-05-02 10:08:13 -07:00
Chris Masone
f26a94584c JS: Implement new DataStore client protocol
This replaces the HTTP ChunkStore implementation with an implementation of
our new DataStore client protocol. It migrates much of the batching logic
from RemoteStore into the new BatchStore, which is analogous to a class we
have on the Go side, but continues to use a Delegate to handle all the HTTP
work.

This patch also introduces ValueStore, which handles validating Values as
they're written. Instead of handling Value reading and writing itself,
DataStore now extends ValueStore.

Towards #1280
2016-05-02 09:52:36 -07:00
cmasone-attic
a9b523ac58 Merge pull request #1378 from cmasone-attic/revert
Revert renaming datastore to database
2016-05-02 09:18:21 -07:00