GitHub user khalidhuseynov reopened a pull request:
https://github.com/apache/incubator-zeppelin/pull/123
Sync functionality with another storage system
This PR is to handle the synchronization of notebooks between local
Zeppelin fs and remote storage system.
Corresponding issue: https://issues.apache.org/jira/browse/ZEPPELIN-133
TODO:
- [x] sync non existing files at start
- [x] sync modified files at start
- [x] save to both storages on save()
- [x] delete from both storages on remove()
- [x] pull new/updated notes from secondary storage
- [x] add comma separated storage class definitions
- [x] corresponding tests
- [x] handle failure cases of secondary storage
- [x] handle updated notes on Paragraph level instead of Note class itself
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/khalidhuseynov/incubator-zeppelin
sync-with-remote
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-zeppelin/pull/123.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #123
----
commit e778c4e95da6bf84ef782c9445ced1ae340f3289
Author: Khalid Huseynov <[email protected]>
Date: 2015-06-26T08:50:33Z
initial sync implementation
sync of modified notes at the start should be handled
commit 032e59b1244f7c4a66a49ea216065299cd511eed
Author: Khalid Huseynov <[email protected]>
Date: 2015-06-29T05:40:36Z
add modification time field for Note and NoteInfo
commit 5b8d99486506ae0eb8190821290e7cb035ab2970
Author: Khalid Huseynov <[email protected]>
Date: 2015-06-29T05:51:14Z
modify containsID() function to return object instead of boolean
commit 5f7ff18d13ba1a967cd7857f0da89e1eafe887e5
Author: Khalid Huseynov <[email protected]>
Date: 2015-06-30T06:31:34Z
use modTime field for uploading modified notes
commit 51e6271250f9573c0081161de11586597e0daab9
Author: Khalid Huseynov <[email protected]>
Date: 2015-06-30T06:33:25Z
change modTime of Note object on save()
commit 359a41e1fe551816fb8aed3d2e13a3df22efec14
Author: Khalid Huseynov <[email protected]>
Date: 2015-06-30T06:52:59Z
minor fix of default classname
commit 3899f8eda2ac708c9a6429cd7c935133015c014c
Author: Khalid Huseynov <[email protected]>
Date: 2015-06-30T07:02:57Z
minor changes to log comments
commit d001ebf6037852ccd41b79c487e82986ab100198
Author: Khalid Huseynov <[email protected]>
Date: 2015-06-30T07:14:44Z
function name/description change
commit 7c4366d4c18d0dc0973042ec09a43e4dd7d587e3
Author: Khalid Huseynov <[email protected]>
Date: 2015-06-30T08:26:19Z
remove commented code section and redundant type conversion
commit b6a3590971ced0558b1c4877e68ec698160147f7
Author: Khalid Huseynov <[email protected]>
Date: 2015-06-30T08:38:40Z
minor refactoring of getting storage class
commit 3314971c75d7818ab5e7c79a6677308d7a4d2d4b
Author: Khalid Huseynov <[email protected]>
Date: 2015-06-30T08:51:14Z
remove more comments
commit 5a967f1838bce2da24e06fbeec8c7e0b9ad02569
Author: Khalid Huseynov <[email protected]>
Date: 2015-07-02T19:31:40Z
logic ramification; add comma-separated storage class names; use list of
repos
commit a441f9d46507774472364005f2ffc680ed92b8fa
Author: Khalid Huseynov <[email protected]>
Date: 2015-07-03T08:33:57Z
catch write to secondary storage failed exception, write to main storage
commit 429372366fe9bc974a8a9231ce04b21d5c8aa20e
Author: Khalid Huseynov <[email protected]>
Date: 2015-07-13T09:37:05Z
add initial tests
commit c2827ff8e7da3eb442d0c2fba5f48e262fde5982
Author: Khalid Huseynov <[email protected]>
Date: 2015-07-14T08:13:02Z
delete modTime field from Note and NoteInfo
commit d33ffc79f34fe286d7e78509d7761ee2ad147ef9
Author: Khalid Huseynov <[email protected]>
Date: 2015-07-14T08:57:36Z
check latest modified from Paragraph fields
dateCreated, dateStarted, dateFinished fields of Paragraph class are used
for finding latest modification time of Note
commit cbe167cdbe385881ed7c709053e0c4cad1be9a4b
Author: Khalid Huseynov <[email protected]>
Date: 2015-07-15T04:23:31Z
minor test change + log removal
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---