a47edc8431
Tools cleanup
...
Add a python test, clean up some error messages, and trim
env vars that don't need to be passed to build/staging scripts.
2015-12-15 11:18:00 -08:00
9a3e73779d
Make types.Ref implement the OrderedValue interface.
...
This fixes the bug where compoundSets/Maps of refs are ordered by their
type.Ref's Ref, rather than their type.Ref's TargetRef.
2015-12-14 11:28:38 -08:00
113f526785
Fix cut and paste error in crunchbase importer.
2015-12-14 10:30:30 -08:00
bf21decb70
splore
2015-12-14 07:42:51 -08:00
7c43a2b49d
Merge pull request #751 from arv/encode-numbers-as-strings
...
Go: Encode numbers as strings
2015-12-14 09:49:34 -05:00
841ac0f088
Remove crunchbase/ui/build.go
2015-12-11 15:17:32 -08:00
6e316d9975
Move build scripts to python
...
Finding and running build scripts remains in Go
(tools/run_all_build.go and supporting libs), but the build scripts
themselves are in python now. This is because Go doesn't have much
support for copying files and directories around, which is kind of the
primary focus of build and packaging scripts.
Towards issue 677
2015-12-11 14:46:16 -08:00
40d164fe47
Go: Encode numbers as strings
...
Because JSON encoders encode numbers differently we cannot just use
numbers in the output.
This still encodes the NomsKind as numbers.
Towards #749
2015-12-11 16:30:07 -05:00
fe01f333a1
JS Support for Compound Objects
2015-12-10 15:04:02 -08:00
a5a9ebbaab
crunchbase/ui: fix typo
2015-12-10 15:00:14 -08:00
e496a31416
Make crunchbase importer more resilient to changes in spreadsheet format.
...
Fixes #736 .
2015-12-10 09:18:08 -08:00
dc58008226
Fix crunchbase importer
2015-12-09 15:16:00 -08:00
2c5063013b
Fix missing npm dep
2015-12-09 17:34:59 -05:00
13bc0f239c
Merge pull request #731 from cmasone-attic/issue677
...
Preserve environment when running subprocesses.
2015-12-09 12:05:13 -08:00
2a5747bd19
Preserve environment when running subprocesses.
...
Trying to whitelist needed env vars is just going to be a maintenance
headache, so don't do it.
2015-12-09 10:51:17 -08:00
1aa72eafd1
Also set BABEL_ENV in the build shell scripts
2015-12-09 13:03:43 -05:00
f31ea22051
JS: Add support for compiling in dev mode
...
When in dev mode we compile async functions to generators.
We also keep features that are available in Node5 and Chrome 47.
2015-12-09 12:34:33 -05:00
f04aa8ebc0
Merge pull request #727 from arv/flow-update
...
Update flow to 0.19 and fix new errors it found
2015-12-08 19:44:23 -05:00
d198036618
Compound Map & Set
2015-12-08 16:25:02 -08:00
bc301ddaf0
Use // for flow pragma
2015-12-08 19:20:20 -05:00
42eb0752f5
Update flow to 0.19 and fix new errors it found
2015-12-08 19:15:09 -05:00
b72d7cb323
CrunchBase UI: Hook up the data to the backend
...
This changes the indexer to only index what we need since without
chunked maps there is too much data to transfer and decode.
The graph is also changed to a line graph since using a bar chart
for this is not very intuitive.
2015-12-08 15:51:10 -05:00
2fd0d57c16
Correctly add GOROOT to empty subprocess environments
...
The way I was forcing GOROOT wound up clearing the execution environment
of subprocesses when the caller intended to simply re-use the current
execution environment. This path correctly adds GOROOT in all cases.
2015-12-05 16:38:41 -08:00
e5409f2698
Remove MetaSequenceKind from serialization
2015-12-04 13:34:30 -08:00
62a937fe93
Scripts should explicitly say they require bash if needed
...
Apparently pushd and popd aren't in whatever very-limited shell travis uses
in its build environment. So, scripts using them (and others for safety) should
she-bang /bin/bash instead of /bin/sh
2015-12-04 10:43:53 -08:00
8180c41bf0
Build scripts/tools written in Go
...
This patch introduces tools/run_all_build.go, a tool that looks for
files called build.go in our source tree and executes them using
'go run'. Currently, they're run in serial.
Also, some node projects are tweaked to make it clear that 'go run build.go'
is the supported mechanism for installing deps and building code.
2015-12-04 10:18:23 -08:00
699cc2accc
Fixes #687 .
...
Make dataStoreCommon.doCommit() return an error instead of boolean.
2015-12-02 16:41:00 -08:00
e0b368302d
listLeaf & compoundList implement List interface
2015-12-02 13:54:25 -08:00
4c1f4464af
Compound & Leaf values now have same Type()
2015-12-02 10:19:27 -08:00
698c21bc67
NomDL: Change type syntax to use <> instead of ()
...
Fixes #678
2015-12-02 12:30:00 -05:00
61f14f8c9a
Rename noms UInt* to Uint*
...
Fixes #673
2015-12-02 12:01:42 -05:00
afc3944341
Add top-down sync strategy.
2015-12-01 12:39:42 -08:00
b3f95399c6
Crunchbase indexer: Use a map of refs instead
...
We previously used a map of sets which got really large 17.6MB. This
adds a Ref indirection which leads to a map size of 104KB instead.
2015-12-01 15:11:09 -05:00
7caa08bc5c
Complex Types embed a ChunkStore
2015-12-01 10:40:47 -08:00
dc8059e36a
splore: add padding at right side of layout
2015-12-01 09:35:08 -08:00
af1d56b3b1
Fix symlinks for crunchbase/ui
2015-12-01 10:38:54 -05:00
3c29fdc0be
Make it possible to run crunchbase importer under cron
...
- fetch from a url rather than file
- use http caching to fetch the file
- compare hashes as a fallback for when caching fails us
2015-11-30 22:54:31 -08:00
2e91b971ab
Fix crasher in json_importer.
...
Move deferred call to close response body below error checks.
2015-11-26 09:42:42 -08:00
aac62e1aad
mv clients/crunchbase_ui -> clients/crunchbase/ui
2015-11-25 16:18:38 -08:00
ca77828a0b
crunchbase_ui: add instructions to get analyses too
2015-11-25 13:11:50 -08:00
9810b3cfc8
Remove extraneous stylesheet import
2015-11-25 14:04:08 -05:00
44f1d3e038
Rename crunchbase_ui/style.css -> styles.css
...
To be consistent with splore
2015-11-25 14:04:08 -05:00
7dcf3b88dd
Use a channel for the crunchbase indexer
...
... instead of a mutex
2015-11-25 13:56:25 -05:00
31450be379
Merge pull request #680 from arv/crunchbase-indexer
...
Crunchbase indexer
2015-11-25 12:31:19 -05:00
7864800bf0
Restructure the data a bit so that we do not have to load every round
2015-11-24 18:59:33 -05:00
3ca4b848f4
Code simplification...
...
based on fact that maps return zero values rather than nils when key isn't present.
2015-11-24 14:59:36 -08:00
91cf7f2048
Crunchbase indexer
...
Creates a map from key (ref of key) to a set of rounds (ref of set of
rounds).
2015-11-24 17:21:07 -05:00
5603ca76d7
Remove unused symbolic link
2015-11-24 14:03:32 -08:00
56bde584eb
Merge pull request #676 from arv/crunchbase-importer
...
Update Crunchbase importer to handle dates
2015-11-24 12:22:05 -05:00
0a1232c010
Update Crunchbase importer to handle dates
...
Previously we were storing date, year+month, year+quarter
and year, all as strings.
Now we only store the date as a unix time stamp (or zero) if the data
was invalid or missing.
Also, moves the files into an importer subdirectory in preparation for
an indexer.
2015-11-24 10:06:21 -05:00
Chris Masone