Commit Graph

98 Commits

Author SHA1 Message Date
Aaron Boodman fd7c1cc14d Make dropbox work with the photos sample (#2745)
* dropbox/find-photos: encode auth token in photo URLs so they can
work in UI.

* Remove requirement for datePublished from photo-index

Dropbox doesn't have a publish date

* fix test

* review comments

* npm test
2016-10-21 14:49:03 -07:00
Ben Kalman cf296b48ca Fix photo set intersection bug (#2746) 2016-10-21 14:28:42 -07:00
Aaron Boodman 3afbc18079 picasa/slurp: use the redirect-less flow instead (#2732)
picasa/slurp: use the redirect-less flow instead
2016-10-20 21:32:41 -07:00
Aaron Boodman b9e104bfbd Fix date grouping logic (#2740)
Fix timestamp grouping
2016-10-20 09:49:45 -07:00
Aaron Boodman 7099c89bc9 Introduce the concept of an 'id' to several samples (#2738) 2016-10-20 09:49:22 -07:00
Aaron Boodman 02d0a8e8f7 ['foo'] -> .foo (#2736) 2016-10-20 06:51:40 -07:00
zcstarr d055fb5a37 Refactors face rectangle to face center point (#2737) 2016-10-19 15:37:07 -07:00
Erik Arvidsson e164f8aeec Flow header after copyright (#2734)
This puts the flow header after the copyright header.

It also:
 * fixes the existing files to have valid headers
 * Makes sure the script can handle doctype
2016-10-19 11:36:48 -07:00
Aaron Boodman 3adab7a874 picasa/find-photos (#2714)
* Introduce picasa/find-photos

* npm test
2016-10-19 09:07:49 -07:00
Aaron Boodman 067dc268ae Only dedupe photos by dateTaken, not datePublished (#2730)
Only dedupe photos by dateTaken, not datePublished

It's very common for groups of photos to have same datePublished
2016-10-18 17:39:47 -07:00
Aaron Boodman 4b843b8600 Introduce dropbox/find-photos (#2712)
Introduce dropbox/find-photos
2016-10-16 21:37:45 -07:00
Aaron Boodman 4ae6b16ac4 picasa/slurp: command-line flags should use dash not underscore (#2713) 2016-10-14 21:18:49 -07:00
Aaron Boodman f487358046 dropbox/slurp: path is optional (#2710) 2016-10-14 20:59:55 -07:00
Aaron Boodman 233af18525 dropbox/slurp: add ability to restrict import to a path prefix (#2709) 2016-10-14 14:24:52 -07:00
Ben Kalman 35495aa69a Add Picasa slurp importer (#2701) 2016-10-13 21:51:22 -07:00
Aaron Boodman 8fe85df1a4 Introduce samples/js/dropbox/slurp (#2702)
* Introduce samples/js/dropbox/slurp

Doing the filter step will be a bit different because Dropbox does
not provide secret URLs for every photo by default. Requests have
to be oauth-authenticated so we'll have to figure out how to do
that.

* vendor golang.org/x/oauth2 and golang.org/x/net

* Introduce oauthify and modify dropbox/slurp to use
2016-10-13 17:34:37 -07:00
Erik Arvidsson 5619d2b3ac Update Flow to 0.33 (#2692) 2016-10-12 14:17:49 -07:00
Aaron Boodman 5191b136c2 fb/slurp: fix eslint error (#2697) 2016-10-12 08:58:20 -07:00
Aaron Boodman 71b949489c fb: fix paging logic (#2691)
We didn't notice this before because none of us had enough fb data
to cause it to page.
2016-10-11 17:09:17 -07:00
Ben Kalman 70a24733aa Better error messages when index path is wrong in photo viewer (#2672) 2016-10-10 12:45:31 -07:00
Erik Arvidsson 7783fc5f44 Update style issues found by newer eslint (#2685) 2016-10-10 10:56:02 -07:00
Erik Arvidsson 8bd3d0720c Update the instructions for fb/slurp (#2686) 2016-10-08 10:14:09 -07:00
Aaron Boodman eb00815de4 Flickr: import primarily photo-wise rather than album-wise. (#2682)
Flickr: import primarily photo-wise rather than album-wise.

This way we get photos that aren't in any album.

Fixes: #2675
2016-10-07 17:03:01 -07:00
Erik Arvidsson 8b40a9997d Fix Flickr importer to get an access token (#2681)
We were using the short lived access token when we should have
exchanged that for a long term access token.

Also refactor the code a bit. Sorry!
2016-10-07 15:41:36 -07:00
Mike Gray 67ad849505 Update to Facebook API v2.8 (#2680) 2016-10-07 17:25:12 -04:00
Aaron Boodman 53d5b59017 Track run date and input paths for fb and flickr importers (#2673)
Track run date and input paths for fb and flickr importers
2016-10-06 18:52:30 -07:00
Aaron Boodman 2708e127b1 fb/slurp: add support for getting longer-lived access token (#2670) 2016-10-05 21:16:36 -07:00
Ben Kalman 49e74de710 Add a photo viewing web UI (#2662) 2016-10-05 12:49:56 -07:00
Erik Arvidsson a63b588f80 Fix lint errors (#2650) 2016-09-29 10:44:43 -07:00
Aaron Boodman 48e7ed9850 fb/find-photos: add in datePublished, dateUpdated, faces (#2634)
fb/find-photos: add in publishDate, updateDate, along with basic face info.
2016-09-28 17:18:46 -07:00
cmasone-attic dd92a06559 JS: Make Database a mutable API that vends immutable Datasets (#2636)
Noms SDK users frequently shoot themselves in the foot because they're
holding onto an "old" Database object. That is, they have a Database
tucked away in some internal state, they call Commit() on it, and
don't replace the object in their internal state with the new Database
returned from Commit.

This PR fixes #2589 by changing the Database and Dataset JS API to be
in line with the proposal there.
2016-09-28 16:50:57 -07:00
Ben Kalman a738ad2d85 flickr correct nsInSecond/nsInMillisecond (#2645) 2016-09-28 16:45:26 -07:00
Aaron Boodman 3efc6c5f7d You're the computer, you sort the fields (#2641)
Change makeStructType() API for sanity. Update callers.
2016-09-28 15:39:52 -07:00
Dan Willhite 4fd84d5141 Add dummy files to js samples with integration tests (#2643) 2016-09-28 13:59:22 -07:00
Dan Willhite 82b25f370f Remove pitch-index from samples/js (#2642) 2016-09-28 13:42:50 -07:00
Dan Willhite 7d81c9b96b Add integration test for sample: url_fetch (#2639)
Towards #1888
2016-09-28 13:36:19 -07:00
Dan Willhite cd8f995b2c Add integration test for sample: aggregate. (#2633)
Towards #1888
2016-09-28 12:52:55 -07:00
Mike Gray 181f549179 Update FB and Flickr importers to be similar in names and descriptions (#2615) 2016-09-27 13:28:11 -04:00
Aaron Boodman 429784dd00 flickr/find-photos: capture dateTaken, datePublished, dateUpdated (#2614)
flickr/find-photos: capture dateTaken, datePublished, dateUpdated.

TBR
2016-09-27 00:04:58 -07:00
cmasone-attic 2e462b11a5 Make Database a mutable API that vends immutable Datasets (#2617)
Noms SDK users frequently shoot themselves in the foot because they're
holding onto an "old" Database object. That is, they have a Database
tucked away in some internal state, they call Commit() on it, and
don't replace the object in their internal state with the new Database
returned from Commit.

This PR changes the Database and Dataset Go API to be in line with the
proposal in Issue #2589. JS follows in a separate patch.
2016-09-26 12:18:14 -07:00
Erik Arvidsson 21b8fc2b4f Update Flow to 0.32 (#2606)
Motivation: Better libs needed in an upcoming PR.
2016-09-22 15:22:20 -07:00
Erik Arvidsson e28cda9ba7 Update Babel dependencies (#2604)
The motivation is to get babylon@6.11.1 which has a fix for a bug where it
treated toString as a duplicate export.
2016-09-22 13:54:46 -07:00
Erik Arvidsson d9ebf6ac90 flickr/slurp: Treat fail as an error (#2544)
Reject the promise when we get a fail status.
2016-09-12 13:57:33 -07:00
Erik Arvidsson 70004e1699 Let splore use versioned URLs too (#2530) 2016-09-07 18:05:14 -07:00
Erik Arvidsson fd4c52acef stage.py: import os too (#2514) 2016-09-02 14:00:15 -07:00
Erik Arvidsson 893d0fa360 stage.py needs to import sys before using it (#2513)
Also changes the tabs to spaces. Thanks pylint.
2016-09-02 13:38:43 -07:00
Erik Arvidsson f465b0bd3c Fix import of noms.staging in stage.py (#2510)
Also fix unit test that was not updated when the functions were
renamed.
2016-09-02 13:09:07 -07:00
Ben Kalman 815ca1586f Add perf build.py and util (#2487) 2016-08-31 16:50:34 -07:00
Erik Arvidsson f5ce7e056b Fix path in splore build script (#2471)
The path to the noms sdk in the build script was not updated when the
js sdk was moved.
2016-08-31 12:01:10 -04:00
Ben Kalman b5098227b8 Add a perf viewer (#2434)
This is a web page which renders a graph of the data generated by perf
suite tests.
2016-08-30 16:11:21 -07:00