Commit Graph

248 Commits

Author SHA1 Message Date
Erik Arvidsson 3fdc008f5c Codegen: Add support for noms types
This makes it possible to do a List of Bool or Map of Int32 etc
2015-07-22 12:24:27 -07:00
Aaron Boodman 5b8d2a1d47 Merge pull request #99 from aboodman/dupe-insert
Dupe insert
2015-07-22 11:36:19 -07:00
Aaron Boodman 1cd3b597ed Merge pull request #103 from aboodman/index
Some small refactoring to pitchmap/index
2015-07-22 11:21:58 -07:00
Aaron Boodman e58b54fa1c Some small refactoring to pitchmap/index
This is in prep for sending year2k (tm) version of this program,
to make the diff more smaller and meaningful.
2015-07-22 10:10:02 -07:00
Erik Arvidsson 1b23a779a1 Merge pull request #94 from arv/read-through-store
Add a ReadThroughStore which caches the values in a caching store
2015-07-21 14:18:29 -07:00
Erik Arvidsson 77681f78fe Add a ReadThroughStore which caches the values in a caching store 2015-07-21 14:15:59 -07:00
Erik Arvidsson 850ab9516a Merge pull request #97 from arv/chunk-store-get-nil
Make sure that FileStore returns no error for missing refs
2015-07-21 13:52:39 -07:00
Aaron Boodman 38e205c6fc Change bug comment syntax 2015-07-21 13:48:57 -07:00
Aaron Boodman 470d5bb4cd Fix duplicate map inserts.
Also happened to uncover a nasty bug with Map.Remove() O_o.
2015-07-21 13:45:27 -07:00
Aaron Boodman 81b9c27193 Fix duplicate set inserts 2015-07-21 13:43:58 -07:00
Erik Arvidsson f08e7f0f5e Make sure that FileStore returns no error for missing refs 2015-07-21 13:13:46 -07:00
Aaron Boodman 2c09daf644 Merge pull request #96 from aboodman/docs
Various cleanups to heatmap UI and docs.
2015-07-21 12:46:18 -07:00
Aaron Boodman 0e199158a6 Various cleanups to heatmap UI and docs. 2015-07-21 11:23:49 -07:00
Aaron Boodman 83bb5ee4d8 Merge pull request #93 from aboodman/server-fix
Fix startup crash in server binary.
2015-07-21 10:17:01 -07:00
Aaron Boodman 4182ad0a33 Fix startup crash in server binary.
Also change ChunkStore from being embedded in server to being a field of it. It is equivalent, but this feels more semantically correct and it's less code anyway.
2015-07-21 10:12:42 -07:00
Aaron Boodman 941ebae87e Merge pull request #76 from aboodman/order
Switch Map and Set from using a hashtable internally to a sorted list
2015-07-21 09:49:05 -07:00
Erik Arvidsson c49499cff2 Merge pull request #91 from arv/memory-store-close
Fix MemoryStore to get the ref in close
2015-07-21 09:47:04 -07:00
Erik Arvidsson 8b566139d0 Fix MemoryStore to get the ref in close 2015-07-21 09:37:07 -07:00
Aaron Boodman 409fd1b076 Map and Set: Compare using future.Val() when possible.
This can be more efficient than comparing by ref for primitives.
2015-07-21 09:26:38 -07:00
Rafael Weinstein e20ed5c289 Babelify within noms js module 2015-07-20 17:59:42 -07:00
Rafael Weinstein 0087a45df9 Reorg js code into common module 2015-07-20 17:14:30 -07:00
Erik Arvidsson 2789d477e2 Add an RPC call to server to get the dataset root
And use that in the heatmap ui
2015-07-20 17:08:28 -07:00
cmasone-attic b221d976dc Merge pull request #86 from cmasone-attic/issue82
Fix typo that makes pitchmap/index ignore all pitches
2015-07-20 16:55:33 -07:00
Aaron Boodman 5ae553db81 Set: Optimize adding multiple values at once. 2015-07-20 16:03:05 -07:00
Chris Masone 5dce937983 Fix typo that makes pitchmap/index ignore all pitches
Whoops.
2015-07-20 15:34:32 -07:00
cmasone-attic c17f0273af Merge pull request #84 from cmasone-attic/issue83
Fix comments about hot paths to refer to a bug instead

Relevant to issue #83
2015-07-20 15:28:34 -07:00
Chris Masone bd3a5ee878 Fix comments about hot paths to refer to a bug instead 2015-07-20 15:23:25 -07:00
Aaron Boodman 2bd7cd2781 Map: Optimize adding multiple values at once. 2015-07-20 11:01:48 -07:00
cmasone-attic d22bdddf34 Merge pull request #79 from cmasone-attic/profiling
Fix up the indexer to tolerate more edge cases
2015-07-20 10:59:28 -07:00
cmasone-attic d228a8d2be Merge pull request #78 from cmasone-attic/reminders
Add a few reminder comments about hot-paths
2015-07-20 10:56:01 -07:00
Chris Masone 9558439518 Fix up the indexer to tolerate more edge cases
And also add a cpu profiling flag.
2015-07-20 10:52:10 -07:00
Chris Masone 0c58895cde Add a few reminder comments about hot-paths 2015-07-20 10:49:09 -07:00
cmasone-attic a30f98b35f Merge pull request #74 from cmasone-attic/benchmark
Changes to xml_importer.go to allow for naive benchmarking
Towards issue #67
2015-07-20 10:09:03 -07:00
Chris Masone a22b9de144 Changes to xml_importer.go to allow for naive benchmarking
Introduce the 'NopStore', which is a sorta-ChunkStore that throws away
all written data. Get() can't really be called on it, as a result,
but it's useful for taking IO totally out of the equation when testing
our code for performance.

Towards issue #67
2015-07-20 10:08:00 -07:00
Aaron Boodman 2d8aed9753 Regenerate everything after change to map iteration order.
Fixes #62.
2015-07-20 09:29:51 -07:00
Aaron Boodman 636708e302 Switch Set from using a Map to a sorted set internally. 2015-07-20 09:28:53 -07:00
Aaron Boodman 69cef43527 Switch Map from using a hashtable to a sorted list internally. 2015-07-20 09:28:38 -07:00
Erik Arvidsson 07b5aebd98 Merge pull request #70 from arv/explorer-show-ref
Update Explorer UI to show the ref
2015-07-17 14:45:52 -07:00
Erik Arvidsson cbcab63182 Update Explorer UI to show the ref
The ref is shown on hover.
2015-07-17 14:45:15 -07:00
Erik Arvidsson 190e11bfcc Merge pull request #65 from arv/pitchmap-load-data
Heatmap UI: Extract the pitchers and pitch locations from the dataset
2015-07-17 14:36:16 -07:00
Erik Arvidsson 8940588187 Heatmap UI: Extract the pitchers and pitch locations from the dataset 2015-07-17 14:35:24 -07:00
cmasone-attic 93b7f66806 Merge pull request #72 from cmasone-attic/issue52
Performance improvements, given the xml_importer workload
2015-07-17 14:15:00 -07:00
Chris Masone 4632a73bc2 Performance improvements, given the xml_importer workload
1) Get rid of temp file usage in FileStore. Instead, write to a buffer and then
   dump to disk on Close().
2) Chk.Equals() uses reflection even if you call it on primitive types, which
   can be surprisingly costly. Switch to a Chk.True() in a couple of hot paths.
2015-07-17 14:14:42 -07:00
Rafael Weinstein f18ae3ef22 Avoid loading full commit history of all new commits superceed at least one current root 2015-07-17 13:59:20 -07:00
Aaron Boodman 04fea40e72 Merge pull request #71 from rafael-atticlabs/fix
Fix TestDatasetRootTracker
2015-07-17 13:28:16 -07:00
Rafael Weinstein ed9f5fc9c2 Fix TestDatasetRootTracker 2015-07-17 13:21:23 -07:00
Rafael Weinstein 565115a3a1 Fix datastore concurrency bug 2015-07-17 11:08:33 -07:00
Erik Arvidsson 5755bb6d89 Update .gitignore for clients/pitchmap/index 2015-07-17 09:30:12 -07:00
Erik Arvidsson 7bf32977ec Fix error from promise cleanup 2015-07-16 13:11:27 -07:00
Aaron Boodman c8f5cf8b8f Merge pull request #63 from aboodman/s3head
Make AWSStore not put duplicate objects.
2015-07-16 13:00:25 -07:00