Commit Graph

98 Commits

Author SHA1 Message Date
Aaron Boodman
fd7c1cc14d Make dropbox work with the photos sample (#2745)
* dropbox/find-photos: encode auth token in photo URLs so they can
work in UI.

* Remove requirement for datePublished from photo-index

Dropbox doesn't have a publish date

* fix test

* review comments

* npm test
2016-10-21 14:49:03 -07:00
Ben Kalman
cf296b48ca Fix photo set intersection bug (#2746) 2016-10-21 14:28:42 -07:00
Aaron Boodman
3afbc18079 picasa/slurp: use the redirect-less flow instead (#2732)
picasa/slurp: use the redirect-less flow instead
2016-10-20 21:32:41 -07:00
Aaron Boodman
b9e104bfbd Fix date grouping logic (#2740)
Fix timestamp grouping
2016-10-20 09:49:45 -07:00
Aaron Boodman
7099c89bc9 Introduce the concept of an 'id' to several samples (#2738) 2016-10-20 09:49:22 -07:00
Aaron Boodman
02d0a8e8f7 ['foo'] -> .foo (#2736) 2016-10-20 06:51:40 -07:00
zcstarr
d055fb5a37 Refactors face rectangle to face center point (#2737) 2016-10-19 15:37:07 -07:00
Erik Arvidsson
e164f8aeec Flow header after copyright (#2734)
This puts the flow header after the copyright header.

It also:
 * fixes the existing files to have valid headers
 * Makes sure the script can handle doctype
2016-10-19 11:36:48 -07:00
Aaron Boodman
3adab7a874 picasa/find-photos (#2714)
* Introduce picasa/find-photos

* npm test
2016-10-19 09:07:49 -07:00
Aaron Boodman
067dc268ae Only dedupe photos by dateTaken, not datePublished (#2730)
Only dedupe photos by dateTaken, not datePublished

It's very common for groups of photos to have same datePublished
2016-10-18 17:39:47 -07:00
Aaron Boodman
4b843b8600 Introduce dropbox/find-photos (#2712)
Introduce dropbox/find-photos
2016-10-16 21:37:45 -07:00
Aaron Boodman
4ae6b16ac4 picasa/slurp: command-line flags should use dash not underscore (#2713) 2016-10-14 21:18:49 -07:00
Aaron Boodman
f487358046 dropbox/slurp: path is optional (#2710) 2016-10-14 20:59:55 -07:00
Aaron Boodman
233af18525 dropbox/slurp: add ability to restrict import to a path prefix (#2709) 2016-10-14 14:24:52 -07:00
Ben Kalman
35495aa69a Add Picasa slurp importer (#2701) 2016-10-13 21:51:22 -07:00
Aaron Boodman
8fe85df1a4 Introduce samples/js/dropbox/slurp (#2702)
* Introduce samples/js/dropbox/slurp

Doing the filter step will be a bit different because Dropbox does
not provide secret URLs for every photo by default. Requests have
to be oauth-authenticated so we'll have to figure out how to do
that.

* vendor golang.org/x/oauth2 and golang.org/x/net

* Introduce oauthify and modify dropbox/slurp to use
2016-10-13 17:34:37 -07:00
Erik Arvidsson
5619d2b3ac Update Flow to 0.33 (#2692) 2016-10-12 14:17:49 -07:00
Aaron Boodman
5191b136c2 fb/slurp: fix eslint error (#2697) 2016-10-12 08:58:20 -07:00
Aaron Boodman
71b949489c fb: fix paging logic (#2691)
We didn't notice this before because none of us had enough fb data
to cause it to page.
2016-10-11 17:09:17 -07:00
Ben Kalman
70a24733aa Better error messages when index path is wrong in photo viewer (#2672) 2016-10-10 12:45:31 -07:00
Erik Arvidsson
7783fc5f44 Update style issues found by newer eslint (#2685) 2016-10-10 10:56:02 -07:00
Erik Arvidsson
8bd3d0720c Update the instructions for fb/slurp (#2686) 2016-10-08 10:14:09 -07:00
Aaron Boodman
eb00815de4 Flickr: import primarily photo-wise rather than album-wise. (#2682)
Flickr: import primarily photo-wise rather than album-wise.

This way we get photos that aren't in any album.

Fixes: #2675
2016-10-07 17:03:01 -07:00
Erik Arvidsson
8b40a9997d Fix Flickr importer to get an access token (#2681)
We were using the short lived access token when we should have
exchanged that for a long term access token.

Also refactor the code a bit. Sorry!
2016-10-07 15:41:36 -07:00
Mike Gray
67ad849505 Update to Facebook API v2.8 (#2680) 2016-10-07 17:25:12 -04:00
Aaron Boodman
53d5b59017 Track run date and input paths for fb and flickr importers (#2673)
Track run date and input paths for fb and flickr importers
2016-10-06 18:52:30 -07:00
Aaron Boodman
2708e127b1 fb/slurp: add support for getting longer-lived access token (#2670) 2016-10-05 21:16:36 -07:00
Ben Kalman
49e74de710 Add a photo viewing web UI (#2662) 2016-10-05 12:49:56 -07:00
Erik Arvidsson
a63b588f80 Fix lint errors (#2650) 2016-09-29 10:44:43 -07:00
Aaron Boodman
48e7ed9850 fb/find-photos: add in datePublished, dateUpdated, faces (#2634)
fb/find-photos: add in publishDate, updateDate, along with basic face info.
2016-09-28 17:18:46 -07:00
cmasone-attic
dd92a06559 JS: Make Database a mutable API that vends immutable Datasets (#2636)
Noms SDK users frequently shoot themselves in the foot because they're
holding onto an "old" Database object. That is, they have a Database
tucked away in some internal state, they call Commit() on it, and
don't replace the object in their internal state with the new Database
returned from Commit.

This PR fixes #2589 by changing the Database and Dataset JS API to be
in line with the proposal there.
2016-09-28 16:50:57 -07:00
Ben Kalman
a738ad2d85 flickr correct nsInSecond/nsInMillisecond (#2645) 2016-09-28 16:45:26 -07:00
Aaron Boodman
3efc6c5f7d You're the computer, you sort the fields (#2641)
Change makeStructType() API for sanity. Update callers.
2016-09-28 15:39:52 -07:00
Dan Willhite
4fd84d5141 Add dummy files to js samples with integration tests (#2643) 2016-09-28 13:59:22 -07:00
Dan Willhite
82b25f370f Remove pitch-index from samples/js (#2642) 2016-09-28 13:42:50 -07:00
Dan Willhite
7d81c9b96b Add integration test for sample: url_fetch (#2639)
Towards #1888
2016-09-28 13:36:19 -07:00
Dan Willhite
cd8f995b2c Add integration test for sample: aggregate. (#2633)
Towards #1888
2016-09-28 12:52:55 -07:00
Mike Gray
181f549179 Update FB and Flickr importers to be similar in names and descriptions (#2615) 2016-09-27 13:28:11 -04:00
Aaron Boodman
429784dd00 flickr/find-photos: capture dateTaken, datePublished, dateUpdated (#2614)
flickr/find-photos: capture dateTaken, datePublished, dateUpdated.

TBR
2016-09-27 00:04:58 -07:00
cmasone-attic
2e462b11a5 Make Database a mutable API that vends immutable Datasets (#2617)
Noms SDK users frequently shoot themselves in the foot because they're
holding onto an "old" Database object. That is, they have a Database
tucked away in some internal state, they call Commit() on it, and
don't replace the object in their internal state with the new Database
returned from Commit.

This PR changes the Database and Dataset Go API to be in line with the
proposal in Issue #2589. JS follows in a separate patch.
2016-09-26 12:18:14 -07:00
Erik Arvidsson
21b8fc2b4f Update Flow to 0.32 (#2606)
Motivation: Better libs needed in an upcoming PR.
2016-09-22 15:22:20 -07:00
Erik Arvidsson
e28cda9ba7 Update Babel dependencies (#2604)
The motivation is to get babylon@6.11.1 which has a fix for a bug where it
treated toString as a duplicate export.
2016-09-22 13:54:46 -07:00
Erik Arvidsson
d9ebf6ac90 flickr/slurp: Treat fail as an error (#2544)
Reject the promise when we get a fail status.
2016-09-12 13:57:33 -07:00
Erik Arvidsson
70004e1699 Let splore use versioned URLs too (#2530) 2016-09-07 18:05:14 -07:00
Erik Arvidsson
fd4c52acef stage.py: import os too (#2514) 2016-09-02 14:00:15 -07:00
Erik Arvidsson
893d0fa360 stage.py needs to import sys before using it (#2513)
Also changes the tabs to spaces. Thanks pylint.
2016-09-02 13:38:43 -07:00
Erik Arvidsson
f465b0bd3c Fix import of noms.staging in stage.py (#2510)
Also fix unit test that was not updated when the functions were
renamed.
2016-09-02 13:09:07 -07:00
Ben Kalman
815ca1586f Add perf build.py and util (#2487) 2016-08-31 16:50:34 -07:00
Erik Arvidsson
f5ce7e056b Fix path in splore build script (#2471)
The path to the noms sdk in the build script was not updated when the
js sdk was moved.
2016-08-31 12:01:10 -04:00
Ben Kalman
b5098227b8 Add a perf viewer (#2434)
This is a web page which renders a graph of the data generated by perf
suite tests.
2016-08-30 16:11:21 -07:00