[ 
https://issues.apache.org/jira/browse/SPARK-24311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jungtaek Lim updated SPARK-24311:
---------------------------------
    Description: 
The structure of delta file and snapshot file is same, but the operations are 
defined as individual methods which incurs duplicated logic between delta file 
and snapshot file.

We can refactor to remove duplicated logic to ensure readability, as well as 
guaranteeing that the structure of delta file and snapshot file keeps same.

  was:
The structure of delta file and snapshot file is same, but the operations are 
defined as individual methods which incurs duplicated logic between logic for 
delta file and logic for snapshot file.

We can refactor to remove duplicated logic to ensure readability, as well as 
guaranteeing that the structure of delta file and snapshot file keeps same.


> Refactor HDFSBackedStateStoreProvider to remove duplicated logic between 
> operations on delta file and snapshot file
> -------------------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-24311
>                 URL: https://issues.apache.org/jira/browse/SPARK-24311
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>    Affects Versions: 2.3.0
>            Reporter: Jungtaek Lim
>            Priority: Major
>
> The structure of delta file and snapshot file is same, but the operations are 
> defined as individual methods which incurs duplicated logic between delta 
> file and snapshot file.
> We can refactor to remove duplicated logic to ensure readability, as well as 
> guaranteeing that the structure of delta file and snapshot file keeps same.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to