Commit Graph

26 Commits

Author SHA1 Message Date
Aaron Boodman
cff0de3696 non-vendor changes 2016-02-08 23:15:09 -08:00
Erik Arvidsson
5282014bb2 Add a Dynamo DB Store
This DynamoDB store borrows some logic from HttpStore, in that Get,
Has and Put requests are dumped into channels that are watched by
code in goroutines and batched up to be sent to the backend.
A few structs have been factored out of http_store.go and moved to
remote_requests.go, where they are enhanced so that DynamoStore can use
them as well.
2016-01-14 12:19:14 -08:00
Aaron Boodman
550462ae38 shove: allow pulling from ref or ds head, like Git 2015-12-16 20:40:22 -08:00
Rafael Weinstein
e75f5097c7 Allow Map & Set to order by natural ordering of element type if available. 2015-11-16 14:30:30 -08:00
Benjamin Kalman
f08056555a Add initial version of the new chunked Set implementation.
So far:
- It does not support Put. It can only be constructed with a SetBuilder,
  then queried e.g. Has.
- It only supports ref.Refs as values.
- I'm not convinced about the naming. Perhaps SetChunker rather than
  SetBuilder, FlatLevel rather that FlatSet, etc. I expect they will change.
- The test is fairly simplistic but there isn't much point testing this
  exhaustively, since once we support mutation, the testing abstraction
  will probably be with an Iterator.
2015-10-26 11:15:27 -07:00
Dan Willhite
bb2f983446 Add IsEmpty() function on ref.Ref.
Fixes #337.
2015-10-21 12:07:34 -07:00
Dan Willhite
43d9a6f4fb Remove commit lineage from datastore head.
Replace datastore head with a map of datasetID's to commits. Each commit in the map represents that dataset's head. Fixes #402. Fixes #60. Filed #404 about small window of potential conflict with updating root that needs to be resolved at some point. # Please enter the commit message for your changes. Lines starting
2015-10-14 11:04:13 -07:00
Dan Willhite
d6b221444a Simplify logic in doCommit as per Raf's suggestions. Define ref.EmptyRef variable. 2015-10-12 10:53:12 -07:00
Rafael Weinstein
591026bcfa Chunk 2015-09-21 13:24:41 -07:00
Dan Willhite
ab34143ba5 Pin dependencies using godep tool. Rewrite dep urls. 2015-08-26 14:05:40 -07:00
Rafael Weinstein
0e7d61efc6 Remove errors from ChunkStore and Ref 2015-08-18 16:24:26 -07:00
Aaron Boodman
214b37eccf Remove global imports of dbg package
Fixes #179
2015-08-08 23:57:37 -07:00
Chris Masone
bd3a5ee878 Fix comments about hot paths to refer to a bug instead 2015-07-20 15:23:25 -07:00
Chris Masone
0c58895cde Add a few reminder comments about hot-paths 2015-07-20 10:49:09 -07:00
Chris Masone
4632a73bc2 Performance improvements, given the xml_importer workload
1) Get rid of temp file usage in FileStore. Instead, write to a buffer and then
   dump to disk on Close().
2) Chk.Equals() uses reflection even if you call it on primitive types, which
   can be surprisingly costly. Switch to a Chk.True() in a couple of hot paths.
2015-07-17 14:14:42 -07:00
Chris Masone
3a5397a609 Fix input path of sha1 package in ref_test.go
This was incorrectly set to go/pkg/src/crypto/sha1,
but should just be crypto/sha1
2015-07-07 11:06:21 -07:00
Aaron Boodman
369e2a1cda Add test for ref.FromHash 2015-07-01 23:08:47 -07:00
Aaron Boodman
302042e387 Add a test for Ref::Digest() 2015-07-01 23:02:14 -07:00
Rafael Weinstein
153d83600e remove named TODOs 2015-06-25 09:47:54 -07:00
Aaron Boodman
129798c006 Support any type of Value for keys of maps 2015-06-15 15:57:33 -07:00
Aaron Boodman
08a53bb48f add types.Set 2015-06-13 23:25:48 -07:00
Aaron Boodman
53003f23f2 Add Value::Ref() 2015-06-12 15:22:27 -07:00
Aaron Boodman
554f7b6fed wip: added some testing for json_encode.go 2015-06-09 16:21:37 -07:00
Aaron Boodman
47eb88b3dd Convert ref.Ref to a pure value type 2015-06-03 16:34:34 -07:00
Aaron Boodman
1755cbc861 Add FileStore::Put() 2015-06-03 16:24:39 -07:00
Aaron Boodman
6a4fa364dd Add ref.go and test 2015-06-03 13:56:44 -07:00