[
https://issues.apache.org/jira/browse/SOLR-13710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942466#comment-16942466
]
David Wayne Smiley commented on SOLR-13710:
-------------------------------------------
Just "FileStore" might imply local (non-distributed) by itself; I wonder if
"[Cluster|Cloud|Shared]FileStore" might be better options. Nevertheless
FileStore is a decent name.
Also I think this internally should be an abstraction with multiple possible
implementations. It should be _possible_ to have a WebDAV like impl or shared
file system or S3 impl or heck even a ZooKeeper impl (not necessarily the same
ZK ensemble as the cluster state). The design should allow for these impls to
be extremely simple, especially the shared file system impl -- at least
theoretically since it need not be implemented right way.
I'm not sure if the SHA256 stuff need to be a fundamental part of this
abstraction. Why not just a shared directory of persisted data and _that's
it_? Could the "package" concept be layered on top (which may or may not use
SHA256 naming schemes)? I could imagine one day an option to put configSets in
this thing.
> DistribFileStore: a distributed p2p file store
> ----------------------------------------------
>
> Key: SOLR-13710
> URL: https://issues.apache.org/jira/browse/SOLR-13710
> Project: Solr
> Issue Type: Sub-task
> Security Level: Public(Default Security Level. Issues are Public)
> Reporter: Noble Paul
> Assignee: Noble Paul
> Priority: Major
> Time Spent: 20m
> Remaining Estimate: 0h
>
> * All jars for packages downloaded are stored in a dir
> SOLR_HOME/filestore/package.
> * The file names will be the sha256_hash-<filename>.
> * Before downloading the a jar from a location, it's first checked in the
> local directory
> * POST a jar to
> {{http://localhost://8983/api/cluster/filestore/package?name=<file-name>}} to
> distibute it in the cluster
> * A new API end point {{http://localhost://8983/api/node/filestore/package}}
> will list the available files
> * The file will be downloadable at
> {{http://localhost://8983/api/node/filestore/package/<sha256>}}
> Design:
> https://docs.google.com/document/d/15b3m3i3NFDKbhkhX_BN0MgvPGZaBj34TKNF2-UNC3U8/edit?ts=5d86a8ad#heading=h.qxgax9a5br5o
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
