Commit Graph

703 Commits

Author SHA1 Message Date
Erik Arvidsson
9cb7596409 NomDL: Make NomsValue a Value
This means that when we ReadValue we can now return a NomsValue

Towards #281
2015-10-06 16:38:11 -07:00
Erik Arvidsson
2dec53453e NomDL: Add new serialization format
The new serialization format use "t " as in typed. The rest of the
message is a JSON array describing the typed data. The type is
described by types.TypeRef

Fixes #384
Issues #281, #304
2015-10-06 15:56:10 -07:00
cmasone-attic
e64e313498 Merge pull request #383 from cmasone-attic/issue294
Add functions to codegen.go for generating dependency code
2015-10-06 09:06:43 -07:00
Chris Masone
646519131c Address comments 2015-10-05 15:40:35 -07:00
Erik Arvidsson
72f4cd3a7a NomDL Codegen: Make the TypeRef return a package ref
The TypeRef function for a Noms Struct should be the (Name, PkgRef) and
not the description of the struct fields. This is important because
when serializing we need to write the package ref.

Towards #281 #304
2015-10-05 14:24:25 -07:00
Dan Willhite
46307027e1 Merge pull request #381 from willhite/iterallp
Issue #379 - Add IterAllP function to types.go.
2015-10-05 10:53:19 -07:00
Chris Masone
3dc61b673c Add functions to codegen.go for generating dependency code
This adds code for finding imported type packages and generating
code for them, but does not yet handle generating code that uses
those types.

Towards issue #294
2015-10-04 18:05:50 -04:00
Dan Willhite
b3ae2f89a9 Issue #379 - Add IterAllP function to types.go. 2015-10-02 11:29:08 -07:00
Erik Arvidsson
096ac4a224 Add index to List Iter, IterAll, Map, MapP
Fixes #376
2015-10-01 17:53:21 -04:00
Dan Willhite
a997e7bc95 Merge pull request #378 from willhite/issue-368
Use channel to protect access to datastore_server's connection map.
2015-10-01 09:39:31 -07:00
Dan Willhite
42688454f6 Use channel to protect access to datastore_server's connection map. 2015-10-01 09:17:04 -07:00
Aaron Boodman
8160817ee7 Merge pull request #375 from aboodman/delete
explore: say buh-bye
2015-09-30 20:24:35 -07:00
Aaron Boodman
9189479adf Merge pull request #373 from aboodman/progress
sfcrime_search: print out progress in slow mode
2015-09-30 17:36:58 -07:00
Aaron Boodman
a6f7a2b63f Merge pull request #374 from aboodman/fix
sfcrime_importer: sometimes we would close before importing everything
2015-09-30 16:57:34 -07:00
Aaron Boodman
572130f563 Revert "Purposely break the build to test drone integration"
This reverts commit 8909eb5b42.
2015-09-30 16:46:14 -07:00
Aaron Boodman
8909eb5b42 Purposely break the build to test drone integration 2015-09-30 16:45:21 -07:00
Aaron Boodman
00108f1ec2 explore: say buh-bye 2015-09-30 16:43:38 -07:00
Aaron Boodman
7c8b28adcb Merge pull request #372 from aboodman/prompt
splore: add ability to get full ref
2015-09-30 16:42:10 -07:00
Aaron Boodman
65310bef12 sfcrime_importer: sometimes we would close before importing everything 2015-09-30 16:32:49 -07:00
Aaron Boodman
3096214158 sfcrime_search: print out progress in slow mode 2015-09-30 16:31:23 -07:00
Aaron Boodman
a3850bec1a splore: add ability to get full ref 2015-09-30 16:31:02 -07:00
Erik Arvidsson
8c2caa3b27 NomDL Codegen: Add TypeRef method to typed objects 2015-09-30 17:48:32 -04:00
Erik Arvidsson
ede5f43204 Value should also have a TypeRef
This is so that we can get the runtime type of a value
2015-09-30 16:15:13 -04:00
Dan Willhite
7d3598fe6b Merge pull request #365 from willhite/qtsearch
Naive crime search against flat list.
2015-09-29 16:12:27 -07:00
Dan Willhite
09a775a985 Naive crime search against flat list.
Add ability to search using the list of incident objects created by sfcrime_importer py passing in incidient-list-ref argument.
Also added better checks to ensure that a suitable ref was given as argument.
2015-09-29 16:11:19 -07:00
cmasone-attic
2363650d24 Merge pull request #364 from cmasone-attic/codegen
Modify codegen to include pacakge refs for unresolved types
2015-09-29 13:15:05 -07:00
Chris Masone
9168a902f9 Modify codegen to include pacakge refs for unresolved types
Also, switch to using a ref.Ref when getting/setting the package
ref in a TypeRef. Using a types.Ref just led to lots of manual
boxing and unboxing every time I wanted to use the reference.

Toward issue #294
2015-09-29 12:58:56 -07:00
cmasone-attic
eb8853a367 Merge pull request #363 from cmasone-attic/issue353
Fix build break by regenerating sfcrime_search/types.go
2015-09-29 10:44:20 -07:00
Chris Masone
bd67349c35 Fix build break by regenerating sfcrime_search/types.go 2015-09-29 10:43:19 -07:00
cmasone-attic
557b7ae608 Merge pull request #360 from cmasone-attic/issue353
Beginning of import support in NomDL

Fixes issue #353, towards issue #294
2015-09-29 10:38:19 -07:00
Erik Arvidsson
df0c7159f8 Merge pull request #354 from arv/explorer-fix-ref
decode.js: Remove Ref wrapping
2015-09-29 13:30:19 -04:00
Chris Masone
24bc9e4831 Add unittests to check failures in namespace resolution 2015-09-29 10:23:33 -07:00
Erik Arvidsson
283dae5f32 Update demos 2015-09-29 13:12:26 -04:00
Erik Arvidsson
301edfe7b3 Update README.md
Fix md link
2015-09-29 12:32:31 -04:00
Erik Arvidsson
531b355d08 decode.js: Remove Ref wrapping
It is not clear to me why we added the Ref wrapping? The Ref wrapping
causes the explorer.js IU to show the wrong ref for collections.
2015-09-29 11:50:17 -04:00
Dan Willhite
774bc94ada Merge pull request #362 from willhite/sfcrime-search
sfcrime_search utility.
2015-09-28 17:31:39 -07:00
Dan Willhite
0f88cc001f sfcrime_search utility. 2015-09-28 17:30:51 -07:00
Dan Willhite
23f3cf3dbd Merge pull request #359 from willhite/qtperf
Performance enhancements to sfcrime demos.
2015-09-28 16:37:00 -07:00
Dan Willhite
ff5627f5b5 Peformance enhancements. 2015-09-28 16:34:29 -07:00
Aaron Boodman
64aaf1cbf4 Merge pull request #361 from rafael-atticlabs/sfcrime
Make order of crime data deterministic
2015-09-28 16:19:22 -07:00
Rafael Weinstein
447774a4da Make order of crime data deterministic 2015-09-28 16:16:57 -07:00
Chris Masone
5ce93dad2e Beginning of import support in NomDL
This patch mostly merges parse.Package and types.Package, though it
can't quite go all the way. A types.Package doesn't have 'using'
declarations, while the parsed representation of a .noms file needs to
have that information. Hence, the parse package is moved to the 'pkg'
package, and pkg.Parsed is introduced. This type embeds types.Package
and adds the necessary additional information.

To make inroads on handling imports, I enhanced ParsePackage() (now
called ParseNomDL()) to actually process the 'alias' and 'import'
statements in the input and go replace namespaced type names in the
package with refs of imported packages. For example, the TypeRef for
'Bar' generated in the following package

alias Foo = import "sha1-ffffffff"

struct Bar {
  f: Foo.RockinStruct
}

will actually return types.Ref{sha1-ffffffff} when you call PackageRef()
on it.

In addition, I've added a function to the new 'pkg' package,
which allows the caller to get the dependencies of a type package
from a chunk store.

Fixes issue #353, towards issue #294
2015-09-28 16:08:22 -07:00
Aaron Boodman
d1a2724199 Merge pull request #357 from aboodman/splore
Add splore: a new visualization for noms
2015-09-28 14:49:52 -07:00
Dan Willhite
5858b4de6a Run generate and fmt. 2015-09-28 14:19:27 -07:00
Dan Willhite
71d91338f8 Merge pull request #315 from willhite/quadtree
Quadtree
2015-09-28 14:12:33 -07:00
Aaron Boodman
8789aba6e7 more review comments 2015-09-28 13:27:45 -07:00
Rafael Weinstein
35cc5e9943 Merge pull request #358 from rafael-atticlabs/parallelCSV
Add parallelism to csv_importer
2015-09-28 13:23:08 -07:00
Rafael Weinstein
82525a205a Add parallelism to csv_importer 2015-09-28 13:22:42 -07:00
Aaron Boodman
fd03a0db45 other comments 2015-09-28 13:11:38 -07:00
Aaron Boodman
f710840cf6 review comments 2015-09-28 13:07:46 -07:00