Commit Graph

3736 Commits

Author SHA1 Message Date
Aaron Boodman 5a3b405882 Update demo-p2p-chat.md 2017-09-19 18:00:41 -07:00
Aaron Boodman 42a58b5fb8 Update demo-p2p-chat.md 2017-09-19 18:00:18 -07:00
Dan Willhite 742f0681c3 Modifications to ipfs-chat and ipfs chunkstore (#3691)
* Modifications to ipfs-chat and ipfs chunkstore
 * Change ipfs paths to include directory where ipfs repo is stored.
 * Rework ipfs-chat to create ipfs chunkstores manually rather than
   relying on Spec.ForDataset. This enables creating two chunkstores
   (one local and one network) using the same IpfsNode (ipfs repo).
 * Create separate replicate function for daemon and mergeMessage
   function for client to experiment with slightly different behaviors
   for each.

* Re-organization of code to remove duplication.

The main points are:
* added event loop to process events synchronously
* more agressive about not re-processing msgs from other nodes
  that we've already processed
* fixed bug in ipfs chunkstore HasMany()

* Add go-base58 library
2017-09-19 17:54:32 -07:00
Aaron Boodman 1e7db1d840 Update architectures.md 2017-09-19 17:26:46 -07:00
Erik Arvidsson 9f758c0bdc Make EncodeValue return bytes directly (#3725)
Also make the primitives allocate a more exact buffer instead of the
initialBufferSize.

Also, stack allocate binaryNomsWriter
2017-09-19 17:02:11 -07:00
Aaron Boodman 3286f59914 Update architectures.md 2017-09-19 16:50:29 -07:00
cmasone-attic a5deeb0106 Rough cut at bucketdb about.md (#3720) 2017-09-19 16:09:28 -07:00
Aaron Boodman d74ab2a68a Update README.md 2017-09-19 14:58:01 -07:00
Aaron Boodman 27c18b02f2 Update README.md 2017-09-19 14:55:18 -07:00
Aaron Boodman c9739e09b0 Update cli-tour.md 2017-09-19 14:47:36 -07:00
Aaron Boodman a2776d3a84 Update cli-tour.md 2017-09-19 14:45:07 -07:00
Aaron Boodman 5641865bf6 Update cli-tour.md 2017-09-19 14:44:32 -07:00
Dan Willhite d1b9e99a2a Decentralized architecture with Noms intro (#3722) 2017-09-19 13:35:47 -07:00
Aaron Boodman ce75f84cba Update README.md 2017-09-19 12:36:21 -07:00
Aaron Boodman f739916fd1 remove status (#3723) 2017-09-19 12:00:09 -07:00
Aaron Boodman d8296bf1b5 Update README.md 2017-09-19 11:53:47 -07:00
Aaron Boodman 0064ca16c5 Update demo-ipfs-chat.md 2017-09-19 11:49:02 -07:00
Aaron Boodman 2d0e9e7383 Update demo-p2p-chat.md 2017-09-19 11:46:18 -07:00
Aaron Boodman f286c4ef49 Update quickstart.md 2017-09-19 11:42:54 -07:00
Aaron Boodman 05672e128f Update about.md 2017-09-19 10:54:28 -07:00
Dan Willhite 9e9759cb4d Add go syntax highlights to Go code and remove
Also remove reference to file in sample/go/quickstart/quickstart.go since we're no longer including it there.
2017-09-19 09:23:31 -07:00
Erik Arvidsson 6fcfeeb215 Optimize CSV Export (#3721)
This optimizes CSV export after the change in types.Value being backed
by byte slices.

Towards #3710
2017-09-19 00:48:21 -07:00
Aaron Boodman 2be441fffd Update quickstart.md 2017-09-18 21:13:14 -07:00
Erik Arvidsson 865f2498bb Update README.md 2017-09-18 16:20:15 -07:00
Dan Willhite a0aa9b93cb Update demo-ipfs-chat.md 2017-09-18 15:49:59 -07:00
Dan Willhite e9ab5b3ef9 Update demo-p2p-chat.md 2017-09-18 15:49:20 -07:00
Dan Willhite 06fbebfc27 Update quickstart.md 2017-09-18 15:29:08 -07:00
phritz 26d242789a remove double status bar 2017-09-18 12:10:26 -10:00
phritz 02f2392c9a remove double status bar 2017-09-18 12:10:11 -10:00
phritz f3c6e855c2 linkify mailto 2017-09-18 12:04:40 -10:00
phritz 58c8f0abe3 fix typo 2017-09-18 12:03:18 -10:00
phritz 8280a82159 fix README links (#3718) 2017-09-18 12:02:05 -10:00
phritz 8266ee9e1e update README and navigation (#3717)
Reflects proposal in aaron's doc.
2017-09-18 11:58:58 -10:00
Dan Willhite 002246bf50 Update quickstart.md 2017-09-18 14:57:57 -07:00
phritz 01d5478837 update heading 2017-09-18 11:09:47 -10:00
phritz c2c4ffa26d fix link 2017-09-18 11:09:02 -10:00
phritz 6558b697be prep docs/decent/ for demo release (#3716)
Updated content per aa's proposal, added olap use case directory.
2017-09-18 11:08:11 -10:00
Benjamin Kalman a03416acba Reuse the "current" buffer in sequenceChunker (#3702)
Avoids memory reallocation.
2017-09-18 12:23:20 -07:00
wardn 386c3f3e3e NOMSFS: only build for darwin/linux (#3712) 2017-09-17 09:45:36 -07:00
Erik Arvidsson b497bcc974 Make values be backed by []byte (#3694)
This makes all but types.Type be backed by a []byte.

The motivation is to reduce the allocations and the work needed to be
done when we read parts of a value (especially prolly trees).

Towards #2270
2017-09-14 17:45:08 -07:00
wardn e6c5675a54 remove js implementation (#3705) 2017-09-14 11:51:03 -07:00
Erik Arvidsson 3cbaf56f23 Don't build blob-get (#3704)
it has been removed
2017-09-14 10:29:44 -07:00
Dan Willhite 10ec10dc00 Add ability to register HRSCommenters on Structs. (#3609)
Clients can register HRSCommenters to cause additional info
to be included as comments when generating the human readable
encoding for Noms Structs.
2017-09-13 17:21:08 -07:00
Benjamin Kalman 26eb9e3713 Don't write a sequence chunk if there is no parent (#3699)
In most cases this will avoid writing the root chunk of a prolly tree,
which is the behavior we're aiming for: a prolly tree might be used
inline in which case the root never needs to be written.

The solution in this patch is imperfect because it may unnecessarily
write chunks, but this is rare.

Fixes https://github.com/attic-labs/noms/issues/3645
2017-09-13 15:52:31 -07:00
Erik Arvidsson 3db7be5062 Clean up Type WalkValues (#3700)
Use good practice OO design 😝
2017-09-13 15:45:52 -07:00
Erik Arvidsson 8f95c25403 Remove some printf debugging from tests (#3701) 2017-09-13 15:36:42 -07:00
Erik Arvidsson 5ff6432c7b Add support for parsing values (#3688)
This allows parsing all Noms values from the string representation
used by human readable encoding:

```
v, err := nomdl.Parse(vrw, `map {"abc": 42}`)
```

Fixes #1466
2017-09-13 15:02:01 -07:00
cmasone-attic d3be53d164 csv-invert: Perf improvments! (#3698)
Tweaking the main loop that processes list entries to avoid some
map assignments, lookups, and allocations saves 15% or so, resulting
in an overall savings of about 1m on the 6m runtime of our test
workload (as run on my laptop).

Towards #3690
2017-09-12 15:48:22 -07:00
cmasone-attic 1b5ac05793 csv-invert command line tool (#3689)
Takes the output of a CSV file imported as a List of Struct and
"inverts" it so that it's now a Struct of Lists.

Example:

List<Struct Row {
  Base?: String,
  DOLocationID?: String,
}>

becomes

Struct Columnar {
  base: List<String>,
  dolocationid: List<String>,
}
2017-09-12 15:05:31 -07:00
cmasone-attic 41f63a5a6a Stop noms sync from destroying locality (#3659)
This patch implements a new strategy for Pull() that pulls the chunks
from a given level of the graph over in the order they'll be
encountered by clients reading the graph.

Fixes #2968
2017-09-11 16:04:13 -07:00