Commit Graph

80 Commits

Author SHA1 Message Date
Dan Willhite
2018863432 Add hasCache to datastore.
Fixes #693.
2015-12-08 11:22:50 -08:00
Dan Willhite
bdb3fdf95d Revisions to http store. 2015-12-03 17:45:55 -08:00
Dan Willhite
008047fb3d Limit concurrent requests to 'requestLimit'. 2015-12-03 14:10:29 -08:00
Dan Willhite
ede5f1704b Increase max number of keep-alive connections in http_store. 2015-12-03 14:10:29 -08:00
Dan Willhite
afc3944341 Add top-down sync strategy. 2015-12-01 12:39:42 -08:00
Aaron Boodman
c813010e6d fix build 2015-10-23 13:28:29 -07:00
Aaron Boodman
ebcd68cedf Break the build more to test travis integration 2015-10-23 13:25:11 -07:00
Aaron Boodman
f40a5a5403 Break the build to test travis integration 2015-10-23 13:21:34 -07:00
Dan Willhite
bb2f983446 Add IsEmpty() function on ref.Ref.
Fixes #337.
2015-10-21 12:07:34 -07:00
Rafael Weinstein
6c5b2eb6f4 Avoid Excess Ref Computation 2015-09-26 11:33:04 -07:00
Rafael Weinstein
4ba824739a Protect readBatch map with a rateLimiter 2015-09-25 14:35:37 -07:00
Rafael Weinstein
ec8461e8fd RemoteDataStore / CopyReachableChunksP 2015-09-24 11:06:50 -07:00
Rafael Weinstein
691f71ec08 Add LevelDBStore.dumpStats 2015-09-23 14:10:27 -07:00
Rafael Weinstein
ee47fb0bf2 Reland: limit write concurrency of leveldb to max open file handles limit 2015-09-23 11:54:21 -07:00
Rafael Weinstein
b661beceae Revert "limit write concurrency of leveldb to max open file handles limit"
This reverts commit 8d2d380676.
2015-09-23 11:49:00 -07:00
Rafael Weinstein
8d2d380676 limit write concurrency of leveldb to max open file handles limit 2015-09-23 11:32:02 -07:00
Rafael Weinstein
adabda61a4 Make DataStore an interface 2015-09-22 17:30:14 -07:00
Rafael Weinstein
591026bcfa Chunk 2015-09-21 13:24:41 -07:00
Rafael Weinstein
8d56b8c968 Reland: ChunkSource.Get() now returns a []byte. chunks.Serialize takes a stream of Chunks 2015-09-17 12:31:25 -07:00
Rafael Weinstein
a62cf1bbb8 Revert "ChunkSouce.Get() now returns []byte"
This reverts commit 2be269acf4.
2015-09-16 20:47:36 -07:00
Rafael Weinstein
2be269acf4 ChunkSouce.Get() now returns []byte 2015-09-16 16:42:36 -07:00
Rafael Weinstein
0df9f46a2e Remove http_store (someone got lost in recent patch) 2015-09-16 12:55:55 -07:00
Rafael Weinstein
9c6effe19f split chunks/http_store into http/http_client & http/http_server 2015-09-16 10:56:43 -07:00
Rafael Weinstein
10350dbd7e switch js to use buffer reads 2015-09-11 14:41:51 -07:00
Rafael Weinstein
ae4e35d9d1 possible fix for continuous build 2015-09-11 12:18:58 -07:00
Rafael Weinstein
a877c6fac9 use MemoryStore rather than ChunkBuffer 2015-09-10 12:48:27 -07:00
Rafael Weinstein
cdcd60c8ea Short-term fix for parallel writes 2015-09-09 18:11:22 -07:00
Rafael Weinstein
9bac46b7f3 better read buffering 2015-09-09 10:58:29 -07:00
Rafael Weinstein
89fa402ea1 buffer pending reads 2015-09-08 17:43:32 -07:00
Aaron Boodman
326dfb7953 ldbstore: Reduce the max number of open file handles, but make configurable. 2015-09-03 13:21:46 -07:00
Rafael Weinstein
68ce9c1391 Merge pull request #253 from rafael-atticlabs/fixHttpStoreTest
fix http_store test
2015-09-03 05:39:56 -07:00
Rafael Weinstein
b58e20eb8c fix http_store test 2015-09-02 13:20:34 -07:00
Rafael Weinstein
45c6bc586b limit number of open files for leveldb store 2015-09-02 13:13:14 -07:00
Rafael Weinstein
d7e73f8ea8 Put back CORS directive (broke in change to ServeMux 2015-08-30 20:48:57 -07:00
Rafael Weinstein
ae7dee8eaa buffer http puts 2015-08-30 10:48:08 -07:00
Rafael Weinstein
925d268f0b Use built-in ServeMux 2015-08-28 11:30:06 -07:00
Rafael Weinstein
834445954a Fully shutdown server 2015-08-28 10:51:59 -07:00
Rafael Weinstein
29af6c47a8 Fix chunkstore breakage after removing AWS/FileStore 2015-08-27 13:51:47 -07:00
Rafael Weinstein
3deeae09df Remove AWSStore, FileStore, StdoutWriter and deps 2015-08-27 13:44:22 -07:00
Rafael Weinstein
55c9f7a6f2 chunk_writer shouldnt decide to check whether a chunk exists before writing it 2015-08-27 13:07:00 -07:00
Rafael Weinstein
a21d121d71 Dont bind directly to loopback addr; TBR=aa 2015-08-27 10:27:44 -07:00
Dan Willhite
ab34143ba5 Pin dependencies using godep tool. Rewrite dep urls. 2015-08-26 14:05:40 -07:00
Rafael Weinstein
abc7102ad6 Clean following HttpStore implementation 2015-08-24 10:57:50 -07:00
Rafael Weinstein
0b57427496 Remove default hostname for httpstore 2015-08-21 14:34:23 -07:00
Rafael Weinstein
f6490cbbe5 Add HttpStore implementation 2015-08-21 14:22:45 -07:00
Rafael Weinstein
b6ebb67e91 Fix AWS update breakage 2015-08-21 14:21:04 -07:00
Rafael Weinstein
06c5bc6c1b Abstract ChunkStoreWriter 2015-08-20 10:58:41 -07:00
Rafael Weinstein
94e7c3b73a Abstract a bunch of (haphazzardly) duplicated tests into chunk_store_test 2015-08-19 18:23:09 -07:00
Rafael Weinstein
0e7d61efc6 Remove errors from ChunkStore and Ref 2015-08-18 16:24:26 -07:00
Rafael Weinstein
0222b95ff2 LevelDBStore 2015-08-18 11:20:17 -07:00