[
https://issues.apache.org/jira/browse/HUDI-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103195#comment-17103195
]
Hong Shen edited comment on HUDI-866 at 5/9/20, 8:36 AM:
---------------------------------------------------------
I sorted out the classes in hudi-client that can replace spark context directly
with hadoop configuration object.
{code}
1. Can delete spark context directly.
ClientUtils
HoodieIndex
2. Can directly delete part of the Spark context.
HoodieTable
HoodieCopyOnWriteTable
HoodieMergeOnReadTable
HoodieTimelineArchiveLog
3. Can replace the Spark context by hadoop configuration.
AbstractHoodieClient
AbstractHoodieWriteClient
HoodieWriteClient
HoodieReadClient
The related test classes
4. Some test classes can replace the Spark context by hadoop configuration.
{code}
was (Author: shenhong):
I sorted out the classes in hudi-client that can replace spark context directly
with hadoop configuration object.
{code}
ClientUtils
HoodieIndex
HoodieTable
HoodieCopyOnWriteTable
HoodieMergeOnReadTable
HoodieTimelineArchiveLog
AbstractHoodieClient
AbstractHoodieWriteClient
HoodieWriteClient
HoodieReadClient
The related test classes
{code}
> Some classes that rely on JavaSparkContext to obtain Configuration can make
> them Spark-free.
> --------------------------------------------------------------------------------------------
>
> Key: HUDI-866
> URL: https://issues.apache.org/jira/browse/HUDI-866
> Project: Apache Hudi (incubating)
> Issue Type: Sub-task
> Reporter: Hong Shen
> Assignee: Hong Shen
> Priority: Major
> Labels: bug-bash-0.6.0, pull-request-available
> Fix For: 0.6.0
>
>
> Some classes that rely on JavaSparkContext to obtain Configuration can make
> them Spark-free.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
