Commit Graph

135 Commits

Author SHA1 Message Date
Mike Gray 4b26de05f6 removing js csv sample (#2435) 2016-08-25 21:32:21 -04:00
Ben Kalman 66b98ea2a1 Add perf test for just parsing a CSV (ny-vehicle-registrations) (#2439) 2016-08-25 17:13:06 -07:00
Mike Gray 2f66e67763 fixing misspellings, fixing IneffAssign reported issues (#2436)
also removing encode-perf-rig since codec-perf-rig is more current and real
2016-08-25 13:32:34 -04:00
Mike Gray 6a661361ad csv-import/csv-export support for compound keys/nested maps (#2433) 2016-08-25 09:34:21 -04:00
Dan Willhite d7b7345218 Add informative message at base path of demo-server. (#2432) 2016-08-24 13:41:01 -07:00
Dan Willhite de32de82a2 Add != operator to nomdex query language. (#2430)
Fixes #2415
2016-08-24 10:05:42 -07:00
Dan Willhite 924492eed1 Describe find command in help output (#2429)
Fixes #2404
2016-08-23 23:05:46 -07:00
Erik Arvidsson 103078b366 Move samples/js/perf to js/perf (#2426) 2016-08-23 17:51:27 -07:00
Dan Willhite 1090ba4090 Add integration test for nomdex (#2425)
Fixes #2414
2016-08-23 17:04:51 -07:00
Erik Arvidsson d06c3ec8fe Move /js/ into /js/noms/ (#2423) 2016-08-23 16:04:00 -07:00
Mike Gray 4e54c44d56 no functional changes, improving code quality (#2410)
fix misspellings; fix code that was not gofmt'd - plus take advantage of gofmt -s too; couple of unreachable golint reported fixes; reference go report card results and tests
2016-08-23 13:51:38 -04:00
Dan Willhite 7b3adfe657 Add support to nomdex to query against multiple indexes. (#2396)
Fixes #2405
Fixes #2405
Fixes #2114 (Implement nomdex)
2016-08-23 10:26:11 -07:00
Ben Kalman 892f98050e Make perf suite testdata path configurable by -perf.testdata flag (#2406)
Needed by Jenkins shared workspaces.
2016-08-22 16:40:27 -07:00
Erik Arvidsson c6ad845129 Update README.md 2016-08-22 15:22:34 -07:00
Erik Arvidsson 0d2c4fd56d Revert "Move noms/samples/js/perf to noms/js/perf" (#2400) 2016-08-22 13:57:41 -07:00
Erik Arvidsson ecbdd2412b Use Go marshal API in the HR sample 2016-08-22 10:38:20 -07:00
Erik Arvidsson f41e413fe2 Merge pull request #2397 from sunglim/move_perf_js
Move noms/samples/js/perf to noms/js/perf
2016-08-22 10:28:31 -07:00
Mike Gray 1197b4127f csv-analyze to detect column types and primary keys (#2366)
create csv-analyze; add detection of PKs; move detect-columns from csv-import to csv-analyze
2016-08-19 14:24:32 -04:00
Ben Kalman 064c398dec Add perf test suite infrastructure, and a perf test for csv-import (#2384)
You can run these yourself using the -perf flag, e.g.

> noms serve &
> go test -v -perf http://localhost:8000 ./samples/go/csv/csv-import
> noms ds http://localhost:8000

Though you'll need to go-get github.com/attic-labs/testdata.

Note that all of this only records test results, it doesn't have any
concept of failing perf (unless test assertsions themselves fail). It
will be the job of some other Noms client (work in progress) to do that.

I will be setting this up to run continuously momentarily.
2016-08-18 15:49:21 -07:00
LIMSUNG GUK 89fb45553b Move sample/js/*-perf-rig to js/perf/ 2016-08-18 18:33:19 +09:00
Dan Willhite 218c98f209 Nomdex - for indexing and querying. (#2357)
This first version builds indexes and can query against a single one.
2016-08-17 14:42:34 -07:00
Erik Arvidsson 3320518f88 Fix shell script flags (#2377) 2016-08-16 11:58:57 -07:00
Ben Kalman 1e511a61c6 Let Splore open a noms path (#2356)
Currently Splore can only open a database (db=) or a hash (hash=). This
removes the hash and replaces it with the much more general path (p=).

For example, what used to be:
  ?db=http://demo.noms.io&hash=abcd
is now:
  ?db=http://demo.noms.io&p=#abcd

and of course more complex paths work, like:
  ?db=http://demo.noms.io&p=#abcd.field[42].name

I've exposed getHashOfValue in noms.js.
2016-08-12 16:47:26 -07:00
Ben Kalman da62bb2b97 Remove most references to ldb: prefix in the .md docs (#2360) 2016-08-12 15:51:25 -07:00
Ben Kalman 0d6bd01810 Port PathSpec implementation to JS (#2335)
This is a breaking change to the JS API. HashSpec and parseObjectSpec
have been removed in favour of PathSpec, and parse errors now throw
SyntaxError instead of silently failing (this matches JSON.parse).
2016-08-11 15:29:27 -07:00
Mike Gray 865e977320 add csv-import --detect-column-types option (#2329) 2016-08-11 17:02:05 -04:00
Erik Arvidsson 6178251012 Update to Flow 0.30.0 (#2337)
This requires all parameterized types to have type params. Fortunately
one can use `T<any>` which has the same behavior as the old `T` syntax.

We should tighten the types further after this but this unblocks us.

Fixes #2301
2016-08-11 11:27:41 -07:00
Sungguk Lim 6697c2e6fc Replace github.com/tsuru/gnuflag with github.com/juju/gnuflag (#2340)
Replace vendor folder and where it is used.
2016-08-11 10:29:57 -07:00
Peter Abrahamsen 33121dc102 Fix type-o in Flickr sample (#2283)
Based on the signature, this is how the copy should read.
2016-08-10 14:16:20 -04:00
Tegan Snyder 25124a12b0 Update csv README.md (#2328) 2016-08-10 12:13:19 -04:00
Mike Gray a812034182 changing csv-import of map to include pk in struct (#2316) 2016-08-09 19:57:11 -04:00
Mike Gray 75ef96bdc7 implement csv-export writing maps of structs (#2322) 2016-08-09 18:31:54 -04:00
Adam Leventhal e1fd70c2e3 nomsfs: small fix up for Finder regression (#2318) 2016-08-08 21:40:42 -07:00
Adam Leventhal 8fb43f1ef4 nomsfs: general cleanup (#2309) 2016-08-08 18:08:32 -07:00
Erik Arvidsson 0da3e4411f Splore: Use Struct as label for non named structs (#2291)
If a struct does not have a name we used to have no label for the node.
It looks kind of funky so instead it will use the text "Struct" as the
label.
2016-08-05 15:01:28 -07:00
Erik Arvidsson 6b6c409d16 Splore Blobs and more (#2279)
- Display the prolly-tree for Blobs
- Fix fallout from sha1-xxx to xxxx
- Make the hashes links to splore rooted at that hash

Fixes #2218
Fixes #1321
2016-08-05 11:41:33 -07:00
Mike Gray 8c5de64bda adding readme for nomsfs (#2280) 2016-08-05 10:55:42 -07:00
Ben Kalman 1116a05792 Fix Splore node labels in Firefox (#2264) 2016-08-03 22:54:03 -07:00
Surya Gaddipati 3f9d85359a Fix command line flag (#2266) 2016-08-03 18:32:33 -07:00
Adam Leventhal c6d99f2fab noms-based fuse implementation (#2256) 2016-08-02 17:50:39 -07:00
Ben Kalman 07be381117 Support reading from stdin in url-fetch
I need this in the short term because CSV raw files are too large to
check into github, so they need to be split up. It's easier to just do
"cat * | url-fetch -stdin" than recombining them on the file system.
2016-08-02 17:29:10 -07:00
Chris Masone 4f073aee3d Validate type of new Root in root/ POST handler
In the server side of the Remote Databse, the handler for
UpdateRoot now verifies that the new proposed Root is of a
legal type: empty map OR Map<String, Ref<Commit-like>>

Fixes #2116
2016-08-01 16:05:37 -07:00
cmasone-attic 55025ee801 Add caching layer to demo-server (#2228)
This patch creates a new kind of chunks.Factory that demo-server
uses to vend ChunkStore instances that all share the same
MemoryStore-based Chunk cache. This cache _will_ grow without bound,
but the current RAM/data ratio on demo.noms.io means that, in practice,
we will be fine for a bit.

This will need to be removed in favor of a real solution in Issue #2227

Fixes #2009
2016-08-01 11:55:16 -07:00
Mike Gray b42733e982 changing order of args to match JS and be more logical (#2223) 2016-08-01 11:17:59 -07:00
Erik Arvidsson 619a07298f Splore: Use demo.noms.io as the default database (#2219)
Changes the default database to `https://demo.noms.io/cli-tour`

Fixes #2217
2016-08-01 09:16:06 -07:00
Mike Gray 93916c5139 exposing StructData, updating tour (#2214) 2016-08-01 12:09:02 -04:00
Adam Leventhal e920c12c1c Fix cyclic type nondeterminism (#2147) (#2148) 2016-07-29 21:35:17 -07:00
Erik Arvidsson ed0364cc19 Switch to gnuflag (#2206)
This is to support:
- shorthands
- Putting commands anywhere (after positional arguments too)
2016-07-29 18:08:23 -07:00
Ben Kalman 467bdc9bc1 Let csv-importer take the metadata date as a flag (#2196) 2016-07-29 10:44:08 -07:00
Chris Masone b0112ba52b Remove NewSerializer
NewSerializer spun up a goroutine within itself. We've decided
this is an anti-pattern. Furthermore, we were using this inside
our remote database handler code, and a panic inside that goroutine
could take down the server. The callsites now use Serialize() directly.

Fixes #2169
2016-07-28 16:05:03 -07:00