[
https://issues.apache.org/jira/browse/SAMZA-598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387539#comment-14387539
]
Yan Fang commented on SAMZA-598:
--------------------------------
If no one is working on this. Going to take it.
{quote}
users will be able to inspect local stores of jobs that are running (1)
{quote}
The store is locked by the running process. Do not think we can inspect a local
stores of running jobs. Right? We are only able to inspect after the job is
done/killed.
{quote}
create a local copy of a state store for jobs that have lost their local state
already (2)
{quote}
Users will have to provide path for where they want to put the local state,
though it is a little error-prone. The reason is that, after implementing the
YARN host affinity (SAMZA-617), the local state will be stored in some places
like
{code}
${yarn.nodemanager.localdirs}/usercache/${user}/appcache/application_${appid}/container_${contid}
{code}
Reading the config file/stream will not provide enough information for the path
of the local state, such as missing applicationId, containerId. The only way is
to provide the path manually.
> Provide a tool to debug state stores
> ------------------------------------
>
> Key: SAMZA-598
> URL: https://issues.apache.org/jira/browse/SAMZA-598
> Project: Samza
> Issue Type: Bug
> Components: kv
> Affects Versions: 0.9.0
> Reporter: Chris Riccomini
> Fix For: 0.10.0
>
>
> There is currently no easy way to debug a Samza job when there are problems
> with the state store data. It would be nice to provide a tool that will:
> # Connect to a local KV state store, and dump its content.
> # Consume a changelog to and materialize a state store locally.
> Optionally, it would be nice to allow users to fetch values for a give key
> via a REPL. This is a little tricky, though, since the key might be
> serialized in Protobu, Avro, etc.
> Between 1-2, users will be able to inspect local stores of jobs that are
> running (1), and create a local copy of a state store for jobs that have lost
> their local state already (2).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
