[
https://issues.apache.org/jira/browse/CARBONDATA-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Xu closed CARBONDATA-3701.
-----------------------------
Resolution: Won't Do
> Apache CarbonData should provides python interface to support deep learning
> framework MXNet to ready and write data from/to CarbonData
> --------------------------------------------------------------------------------------------------------------------------------------
>
> Key: CARBONDATA-3701
> URL: https://issues.apache.org/jira/browse/CARBONDATA-3701
> Project: CarbonData
> Issue Type: Sub-task
> Reporter: Bo Xu
> Assignee: Bo Xu
> Priority: Major
>
> Nowadays AI model training is getting more and more popular. Currently many
> AI framework uses raw data files or row format data files for model training,
> it could not provide projection, filtering, and fast scan capability like in
> columnar store. So, if CarbonData supports AI framework, it can speed up
> model training by increase IO throughput, and provide more flexible training
> set selection ability to AI developers
> AI compute engine integration:
> MXNet integration: New python API in pycarbon to support MXNet to read data
> from CarbonData files for training model
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
