forked from gilesknap/gphotos-sync
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathChangeLog
293 lines (280 loc) · 10.3 KB
/
ChangeLog
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
CHANGES
=======
* tidy db tests
* faster rescan
* speed up re-scans when no new photos have arrived
* comparison folder generation fully working
* fix relative path in tests
* duplicates and extras monitoring complete
* link folder for missing files now working
* Fix tests
* Remove use of temporary table!
* Update example queries with verified numbers
* Indexing for matching complete
* Replace os.path with pathlib.Path throughout
* working on matching scanned exif info with library
* fix requirements
* now comparison folder is indexed to db
* Major refactor to generalize database access (3)
* Major refactor to generalize database access (2)
* Major refactor to generalize database access
* First pass at scanning filesystem and looking at EXIF
* Final? Python Type Hints addittion
* minimize no-inspections
* type hints up to DbRow.py
* adding python type hints
* fix to bad ID discovery function
* type hints in GooglePhotosDownload GooglePhotosIndex
* split GooglePhotosSync
* code tidy
* codacy tidy
* codecov and codacy tidy
* update changelog
* Fixes to make this work on windows
2.1
---
* code tidy for coadacy
* Add Codacy badge
* tidy code inspections
* add Main function to test coverage
* Better test coverage
* Better test coverage
* Make "Already Downloaded" more intuitive
* pi zero fixes
* added bad ids yaml file generation
* Update .travis.yml
* switch to Covdecov
* fix tests credentials
* switch user token to sync folder
* reformat to 80 chars
* fix 10000 dbase query limit
* tidy logging and keyboard interrupt handling
* tests passing using ThreadPoolExecutor
* first try at ThreadPoolExecutor
* use requests retires and timeout
* fix logger names
* fix coverage badge
* remove redundant code, tidy
* Update README.rst
* better system tests
* add 1 decent system test
* fix bug #32
* add downloaded flag to SyncRows
* Update README.rst
* fix relative test issue
* Update README.rst
2.0
---
* fix do-delete
* update readme, tweak versions
* restored some system tests
* add retries to download URL connection
* Update README.rst
* tidy logging
* add retries to http requests
* remove unicode specifiers
* provide incremental scan of media
* handle video download errors (needs fix from google)
* improved loggin
* skip pre-indexed albums, fix duplicate handling
* Update README.rst
* use list instead of search if no filters are supplied
* fix limit queue size logic - now works well
* limit task queue
* logging in download worker threads
* make album links relative
* batching media gets for super speedy downloads
* tidy threading and termination handling
* update pipfile etc to python3
* added parallel file download
* album index and local symlinks all working
* add delete local files removed from server
* added date range filtering
* mimetype support improvements and video downloads
* low memory download of images (GooglePhotosMediaSync::download\_photo\_media)
* restored duplicate handling, switch to relative paths in DB
* first pass indexing all media using google photos rest API
* simple test of new REST API in startup code
* Added REST API discovery
* first pass of switch to Python3, remove Picassa
* add out of memory monitoring
* add Pipfile (#25)
* use /usr/bin/env python2 everywhere, not hard-coded /usr/bin/python (#24)
1.1
---
* speed up scanning of "Auto Update"
* improvements to picasa-drive matching
* fix tests
* added locking, only one instance can run against a given database location
* make all log strings unicode
* add log of version number
* handle clean up of db on kill
* mods to assist debugging
1.0.2
-----
* let git control version number
* enable removal of items from albums on --flush-index
* add --db-path sp db can go on the fastest disk (#13)
* add --db-path sp db can go on the fastest disk
1.01
----
* bugfixes #6 #9
* switch logging to stdout
* remove "root" folder level and fix tests to work with logger
* add python.logging
* adding minor todos after verifying full sync of 100,000 photos against Google Backup and Sync
* fix root id finding
* clean up pycharm inspections
* tidy todos into todo.txt
v1.0
----
* final version of readme
* restore build status badges
* update Readme
* resolve auth scope issue
* indexing bug fixes
* restore indexing and duplicate handling using new scheme
* fixed indexing model - now using Drive as master
* rework is\_indexed to index all picasaweb files
* Added documentation on the picasaweb drive integration issue
* No handle file edits in picasa but ONLY after the initial sync :-(
* Cope with drive filename changes on edits
* Added handling of remote photos modifications in drive and picasa
* (re) added update on remote file changes
* update to index\_picasa\_media
* update to index\_picasa\_media
* get coverage module correct
* resturcture project to add coveralls
* attempting to get travis badge fixed again
* master branch build monitoring
* fix setup and update readme
* make media type IntEnum to fix travis
* added test credentials for travis testing
* add travis header to readme
* configure travis
* tests now run against gphotos.sync.test acount
* added travis
* fix tests to match changes to the test data
* Put in fix/check for the issues reported by arkpoah
* added interactive login via broswer
* added setting of modified date on local files to match remote
* fix mocking of AlbumRow in tests
* refactor: add boolean handling of empty DbRow objects
* Windows path fixes
* Added local deletion of removed remote files
* Completed filename validation for windows
* optimized imports
* Refactor - added AlbumsRow class
* Added filtering of illegal filename characters
* Refactor of database layer interface
* Unicode everywhere stage 1
* Fix tests on windows
* much improved incremental sync of album data
* Added DB schema check
* refactor - added AlbumMedia
* System tests now cover all command line options
* PicasaSync Refactor continues
* Get symlinks working on windows
* PicasaSync refactor done. Picasa Incremental backup done
* PicasaSync Refactor continues
* work in progress - PicasaSync refactor
* Remove progress handler due to download lock-ups
* fix minimum date handling on linux too
* Fixes to date handling for windows platform (yuk)
* New tighter db layer API and fixed incremental backup
* added Incremental scanning of drive files
* add dictionary for spelling inspections
* Fixes to run on windows (just removed one tab!)
* fix failing system test
* new testing flags --skip-picasa and --skip-drive
* clean up ALL inspections warnings
* fix indexing of picasa files - add more system tests
* add docstrings to DatabaseMedia
* fix album dating
* added a system test
* added test framework and merged, args removal and token refresh
* Add scanning of Drive items for deletion
* removed dependency on args object in DriveSync and PicasaSync
* gdata ouath2 token refresh now fully working
* tidy LocalData
* fix to gdata token refresh patch (still testing)
* handle AVIs in --include-video
* added some diagnostics command line options
* implement --include-video flag (now dont include videos by default)
* fix to exception reporting in retries
* Update readme cmd line parms
* add some diagnostics sql for testing
* fix --quiet option
* allow scanning of Google Photos only (not all of drive) this is now the default
* remove token refresh thread since gdata patch is working
* fix occasional false positives on is\_indexed
* fixed gdata patching
* restore 1st 3 phases
* tried to automate gdata patch - not working
* tidy for release
* Added download of indexed drive files and cleanup - ready for release to master
* implemented date range handling
* Flat Drive Search complete and its faster
* new duplicates scheme working
* new duplicate management scheme
* album links nearly working - not handling duplicate names
* repair empty database
* merged use-drive-folder-hierarchy and albumInfoTry branches
* merged use-drive-folder-hierarchy and albumInfoTry branches
* folder scan fully working
* new DB schema - picasa indexing and downloading done. album file links nearly done
* developing folder scanning
* refined search
* PicasaSync nearly done and DatabaseMedia working well
* added SymLink column to DB
* refactor: switching to PicasaSync from PhotoInfo. Indexing done, download todo
* refine unicode changes
* support unicode in album and photo titles
* make DriveID duplicate catching platform agnostic
* added indexing of album info into DB
* refactoring: now have a PicassaMedia and interface with DB via base class GoogleMedia
* tidy date and mimetype handling in GoogleDriveMedia
* start of refactoring: added base GoogleMedia class in prep for PicasaMedia indexing
* cope with duplicate drive IDs in drive folders
* hit limit of 10000 files per folder - added guard
* fix refresh of gdata token
* fixed scan of albums larger than 1000 photos
* switch db initialization to use empty db file
* removed upload functions, which would use up quota, need alternative approach in future
* temp code for download of files mising from Drive, fully working
* get download working with new Db Schema
* further mods to pick up missing file matches
* album entry to drive file match all but a few MP4s
* album entry to drive file matching working on nearly all files
* first pass of matching album entries to drive files
* added databse migration for db v 1.3
* switch to sqlite for local metadata store
* starting sqlite store
* refactor into class files
* Adding --index-only
* add stack trace on interupt
* photo service authentication fully working
* tidy pickledb use - only dump when done
* switched from extended attributes to pickledb
* connecting to google photos with oauth2
* update to python 3.5 in hope of fixing ssl lockup issue
* added options for starting remote folder, plus start and end date
* add option to download video files
* pep8 tidy up
* switched from canonical filenames to original titles with reliable duplicate handling
* switch to using google folder hierarchy
* cope with occasional transient quota errors
* cope with multiple images in the same second
* add Future Chages file
* avoid trashed files on abort
* allow recursive search of google photos sub directories
* Implement re-upload feature to re-upload low-quality pictures with original resolution
* Replace etaprogress with progressbar2 in requirements.txt
* Add dry-run option
* Reformat code using yapf
* Reorder import statements with isort
* Add vim modeline
* Add a visual progress indicator on the terminal, along with a quiet mode
* Fix PEP8 non-compliance issues
* Update README.rst
* First version