[jira] [Commented] (IGNITE-10051) Kubernetes documentation improvements
[
https://issues.apache.org/jira/browse/IGNITE-10051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16739308#comment-16739308
]
Akmal Chaudhri commented on IGNITE-10051:
-
[~Artem Budnikov], the AWS docs are fine as far as I can see (bullet point 1).
If you could kindly assist with the others, that would be really helpful. Thank
you.
> Kubernetes documentation improvements
> -
>
> Key: IGNITE-10051
> URL: https://issues.apache.org/jira/browse/IGNITE-10051
> Project: Ignite
> Issue Type: Task
> Components: documentation
>Affects Versions: 2.6
>Reporter: Maxim Pudov
>Assignee: Artem Budnikov
>Priority: Major
> Fix For: 2.8
>
> Attachments: kube-dashboard-access.yaml, mongodb-deployment.yaml
>
>
> I verified the deployment instructions of a kubernetes cluster with apache
> ignite and found some issues.
> 1. AWS deployment:
> [https://apacheignite.readme.io/docs/amazon-web-services-eks-deployment]
> miss print:
> {quote}{{kubbectl get pods}}
> {quote}
> has to be:
> {quote}{{kubectl get pods}}
> {quote}
> 2. Google Cloud deployment
> [https://apacheignite.readme.io/docs/google-cloud-deployment]
> Screenshots seem to be outdated
> 3. Microsoft Azure deployment
> [https://apacheignite.readme.io/docs/microsoft-azure-deployment#section-access-to-your-kubernetes-cluster]
> 3.1 At first I had no access to Kubernetes dashboard having this error:
> azure kubernetes dashboard namespaces is forbidden: User
> "system:serviceaccount:kube-system:kubernetes-dashboard" cannot list
> namespaces at the cluster scope
> This problem was solved by adding this config:
> {quote}kubectl create -f [^kube-dashboard-access.yaml]
> {quote}
> 3.2 Screenshots seem to be outdated for azure too.
> 4. Stateless deployment:
> [https://apacheignite.readme.io/docs/stateless-deployment]
> 4.1 At first we create example-cube-rbac.xml locally, but then we don't use
> it.
> 4.2 Instead the configuration file ignite-deployment.yaml
> ([https://apacheignite.readme.io/docs/stateless-deployment#section-ignite-pods-deployment])
> points to the wrong external configuration file:
> {quote}{{https://raw.githubusercontent.com/apache/ignite/master/modules/kubernetes/config/example-kube-persistence.xml}}
> {quote}
> I believe, it has to point to
> {quote}[{{https://raw.githubusercontent.com/apache/ignite/master/modules/kubernetes/config/example-kube-rback.xml}}|https://raw.githubusercontent.com/apache/ignite/master/modules/kubernetes/config/example-kube-rbac.xml]
> {quote}
> 4.3 In the same configuration file ignite-deployment.yaml there is a row
> {quote}{{serviceAccountName: ignite}}
> {quote}
> with Tab symbol, which has to be replaced with double Space.
> 5. Web console kubernetes installation.
> [https://apacheignite-tools.readme.io/docs/kubernetes-installation]
> 5.1 mongodb-deployment.yaml doesn't work as is. I had to modified it (check
> the attachment [^mongodb-deployment.yaml])
> 5.2 web-console-deployment.yaml - default image values aren't specified for
> frontend and backend (apacheignite/web-console-frontend,
> apacheignite/web-console-backend)
> 5.3 web-agent-deployment.yaml - serviceAccountName: "ignite-cluster" is
> incorrect. I guess "ignite" is the right one.
> 5.4 No such docker image as apacheignite/web-agent:mytag3.
> 6. General suggestions for kubernetes cluster deployment on GCC, AWS, Azure.
> 6.1 Create cluster via AWS Console, not command line. It's easier to pick
> values from drop down lists, and we don't provide complete installation via
> command line anyway.
> 6.2 When we suggest to use our configuration files for setting up services
> and pods, it is worth mentioning that our configs contain region parameter
> (zones: eu-west-1a) and user has to modify it himself.
> 6.3 The link to download configuration files points to the master branch,
> which could cause problems in future. For AWS it's
> [https://github.com/apache/ignite/tree/master/modules/kubernetes/config/eks]
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (IGNITE-10051) Kubernetes documentation improvements
[
https://issues.apache.org/jira/browse/IGNITE-10051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Akmal Chaudhri reassigned IGNITE-10051:
---
Assignee: Artem Budnikov (was: Akmal Chaudhri)
> Kubernetes documentation improvements
> -
>
> Key: IGNITE-10051
> URL: https://issues.apache.org/jira/browse/IGNITE-10051
> Project: Ignite
> Issue Type: Task
> Components: documentation
>Affects Versions: 2.6
>Reporter: Maxim Pudov
>Assignee: Artem Budnikov
>Priority: Major
> Fix For: 2.8
>
> Attachments: kube-dashboard-access.yaml, mongodb-deployment.yaml
>
>
> I verified the deployment instructions of a kubernetes cluster with apache
> ignite and found some issues.
> 1. AWS deployment:
> [https://apacheignite.readme.io/docs/amazon-web-services-eks-deployment]
> miss print:
> {quote}{{kubbectl get pods}}
> {quote}
> has to be:
> {quote}{{kubectl get pods}}
> {quote}
> 2. Google Cloud deployment
> [https://apacheignite.readme.io/docs/google-cloud-deployment]
> Screenshots seem to be outdated
> 3. Microsoft Azure deployment
> [https://apacheignite.readme.io/docs/microsoft-azure-deployment#section-access-to-your-kubernetes-cluster]
> 3.1 At first I had no access to Kubernetes dashboard having this error:
> azure kubernetes dashboard namespaces is forbidden: User
> "system:serviceaccount:kube-system:kubernetes-dashboard" cannot list
> namespaces at the cluster scope
> This problem was solved by adding this config:
> {quote}kubectl create -f [^kube-dashboard-access.yaml]
> {quote}
> 3.2 Screenshots seem to be outdated for azure too.
> 4. Stateless deployment:
> [https://apacheignite.readme.io/docs/stateless-deployment]
> 4.1 At first we create example-cube-rbac.xml locally, but then we don't use
> it.
> 4.2 Instead the configuration file ignite-deployment.yaml
> ([https://apacheignite.readme.io/docs/stateless-deployment#section-ignite-pods-deployment])
> points to the wrong external configuration file:
> {quote}{{https://raw.githubusercontent.com/apache/ignite/master/modules/kubernetes/config/example-kube-persistence.xml}}
> {quote}
> I believe, it has to point to
> {quote}[{{https://raw.githubusercontent.com/apache/ignite/master/modules/kubernetes/config/example-kube-rback.xml}}|https://raw.githubusercontent.com/apache/ignite/master/modules/kubernetes/config/example-kube-rbac.xml]
> {quote}
> 4.3 In the same configuration file ignite-deployment.yaml there is a row
> {quote}{{serviceAccountName: ignite}}
> {quote}
> with Tab symbol, which has to be replaced with double Space.
> 5. Web console kubernetes installation.
> [https://apacheignite-tools.readme.io/docs/kubernetes-installation]
> 5.1 mongodb-deployment.yaml doesn't work as is. I had to modified it (check
> the attachment [^mongodb-deployment.yaml])
> 5.2 web-console-deployment.yaml - default image values aren't specified for
> frontend and backend (apacheignite/web-console-frontend,
> apacheignite/web-console-backend)
> 5.3 web-agent-deployment.yaml - serviceAccountName: "ignite-cluster" is
> incorrect. I guess "ignite" is the right one.
> 5.4 No such docker image as apacheignite/web-agent:mytag3.
> 6. General suggestions for kubernetes cluster deployment on GCC, AWS, Azure.
> 6.1 Create cluster via AWS Console, not command line. It's easier to pick
> values from drop down lists, and we don't provide complete installation via
> command line anyway.
> 6.2 When we suggest to use our configuration files for setting up services
> and pods, it is worth mentioning that our configs contain region parameter
> (zones: eu-west-1a) and user has to modify it himself.
> 6.3 The link to download configuration files points to the master branch,
> which could cause problems in future. For AWS it's
> [https://github.com/apache/ignite/tree/master/modules/kubernetes/config/eks]
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (IGNITE-9798) Add TensorFlow Integration Page to Ignite website
[ https://issues.apache.org/jira/browse/IGNITE-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689797#comment-16689797 ] Akmal Chaudhri commented on IGNITE-9798: There are several pages available now on readme.io: https://dash.readme.io/project/apacheignite/v2.6/docs/tensor-flow https://dash.readme.io/project/apacheignite/v2.6/docs/ignite-dataset https://dash.readme.io/project/apacheignite/v2.6/docs/command-line-tool I have taken a pass at review and editing. > Add TensorFlow Integration Page to Ignite website > - > > Key: IGNITE-9798 > URL: https://issues.apache.org/jira/browse/IGNITE-9798 > Project: Ignite > Issue Type: Task > Components: documentation, site >Reporter: Denis Magda >Assignee: Prachi Garg >Priority: Major > Fix For: 2.7 > > > We need to create a dedicated page for Ignite and TensorFlow integration. > Please put it under Machine Learning item of the Features menu. > [~abchaudhri], will provide a reference to the readme.io page with in-depth > integration description. > [~dmagda], I have discussed this with [~chief]. He will create a separate > section with new pages for TensorFlow Integration. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (IGNITE-9798) Add TensorFlow Integration Page to Ignite website
[ https://issues.apache.org/jira/browse/IGNITE-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689797#comment-16689797 ] Akmal Chaudhri edited comment on IGNITE-9798 at 11/16/18 6:20 PM: -- There are several pages available now on readme.io, created by [~chief]. [~pgarg], please review: https://dash.readme.io/project/apacheignite/v2.6/docs/tensor-flow https://dash.readme.io/project/apacheignite/v2.6/docs/ignite-dataset https://dash.readme.io/project/apacheignite/v2.6/docs/command-line-tool I have taken a pass at review and editing. was (Author: abchaudhri): There are several pages available now on readme.io: https://dash.readme.io/project/apacheignite/v2.6/docs/tensor-flow https://dash.readme.io/project/apacheignite/v2.6/docs/ignite-dataset https://dash.readme.io/project/apacheignite/v2.6/docs/command-line-tool I have taken a pass at review and editing. > Add TensorFlow Integration Page to Ignite website > - > > Key: IGNITE-9798 > URL: https://issues.apache.org/jira/browse/IGNITE-9798 > Project: Ignite > Issue Type: Task > Components: documentation, site >Reporter: Denis Magda >Assignee: Prachi Garg >Priority: Major > Fix For: 2.7 > > > We need to create a dedicated page for Ignite and TensorFlow integration. > Please put it under Machine Learning item of the Features menu. > [~abchaudhri], will provide a reference to the readme.io page with in-depth > integration description. > [~dmagda], I have discussed this with [~chief]. He will create a separate > section with new pages for TensorFlow Integration. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-10214) Web console: dependency to open source JDBC driver is not generated in the project's pom file
[ https://issues.apache.org/jira/browse/IGNITE-10214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-10214: Summary: Web console: dependency to open source JDBC driver is not generated in the project's pom file (was: Web console: dependency to open source JDBS driver is not generated in the project's pom file) > Web console: dependency to open source JDBC driver is not generated in the > project's pom file > - > > Key: IGNITE-10214 > URL: https://issues.apache.org/jira/browse/IGNITE-10214 > Project: Ignite > Issue Type: Bug >Reporter: Pavel Konstantinov >Assignee: Pavel Konstantinov >Priority: Major > > Steps to reproduce: > # import caches from for example MySql DB > # check generated pom file -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-9577) Document Preprocessing
[ https://issues.apache.org/jira/browse/IGNITE-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686920#comment-16686920 ] Akmal Chaudhri commented on IGNITE-9577: Reviewed and edited. > Document Preprocessing > -- > > Key: IGNITE-9577 > URL: https://issues.apache.org/jira/browse/IGNITE-9577 > Project: Ignite > Issue Type: Task > Components: documentation, ml >Reporter: Aleksey Zinoviev >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.7 > > Attachments: Preprocessing.docx > > > The link for the updating > [https://apacheignite.readme.io/docs/ml-preprocessing] > > is here > [https://docs.google.com/document/d/1_KAZd5rVTlgWI3ZI9Q5gPVo06SuNZN4Sc6XD7KOX-Xw/edit?usp=sharing] > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-9798) Add TensorFlow Integration Page to Ignite website
[ https://issues.apache.org/jira/browse/IGNITE-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667797#comment-16667797 ] Akmal Chaudhri commented on IGNITE-9798: [~pgarg], I believe [~chief] and his team are working on the code and will create the pages as mentioned above. > Add TensorFlow Integration Page to Ignite website > - > > Key: IGNITE-9798 > URL: https://issues.apache.org/jira/browse/IGNITE-9798 > Project: Ignite > Issue Type: Task > Components: documentation, site >Reporter: Denis Magda >Assignee: Prachi Garg >Priority: Major > Fix For: 2.7 > > > We need to create a dedicated page for Ignite and TensorFlow integration. > Please put it under Machine Learning item of the Features menu. > [~abchaudhri], will provide a reference to the readme.io page with in-depth > integration description. > [~dmagda], I have discussed this with [~chief]. He will create a separate > section with new pages for TensorFlow Integration. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-9798) Add TensorFlow Integration Page to Ignite website
[ https://issues.apache.org/jira/browse/IGNITE-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-9798: --- Description: We need to create a dedicated page for Ignite and TensorFlow integration. Please put it under Machine Learning item of the Features menu. [~abchaudhri], will provide a reference to the readme.io page with in-depth integration description. [~dmagda], I have discussed this with [~chief]. He will create a separate section with new pages for TensorFlow Integration. was: We need to create a dedicated page for Ignite and TensorFlow integration. Please put it under Machine Learning item of the Features menu. [~abchaudhri], will provide a reference to the readme.io page with in-depth integration description. > Add TensorFlow Integration Page to Ignite website > - > > Key: IGNITE-9798 > URL: https://issues.apache.org/jira/browse/IGNITE-9798 > Project: Ignite > Issue Type: Task > Components: documentation, site >Reporter: Denis Magda >Assignee: Prachi Garg >Priority: Major > Fix For: 2.7 > > > We need to create a dedicated page for Ignite and TensorFlow integration. > Please put it under Machine Learning item of the Features menu. > [~abchaudhri], will provide a reference to the readme.io page with in-depth > integration description. > [~dmagda], I have discussed this with [~chief]. He will create a separate > section with new pages for TensorFlow Integration. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-9574) Document Gradient boosting
[ https://issues.apache.org/jira/browse/IGNITE-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-9574: --- Attachment: Gradient Boosting.docx > Document Gradient boosting > -- > > Key: IGNITE-9574 > URL: https://issues.apache.org/jira/browse/IGNITE-9574 > Project: Ignite > Issue Type: Task > Components: documentation, ml >Reporter: Aleksey Zinoviev >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.7 > > Attachments: Gradient Boosting.docx > > > The documentation for the new page with name "Gradient Boosting" > https://docs.google.com/document/d/1Twztetmpu9hH9ueomhAOUZSLUCukk8AvY9ibuicDCXI/edit -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-9574) Document Gradient boosting
[ https://issues.apache.org/jira/browse/IGNITE-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651536#comment-16651536 ] Akmal Chaudhri commented on IGNITE-9574: [~zaleslaw], edited documentation attached. Please double-check. > Document Gradient boosting > -- > > Key: IGNITE-9574 > URL: https://issues.apache.org/jira/browse/IGNITE-9574 > Project: Ignite > Issue Type: Task > Components: documentation, ml >Reporter: Aleksey Zinoviev >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.7 > > Attachments: Gradient Boosting.docx > > > The documentation for the new page with name "Gradient Boosting" > https://docs.google.com/document/d/1Twztetmpu9hH9ueomhAOUZSLUCukk8AvY9ibuicDCXI/edit -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-9576) Document Multi-Class Logistic Regression
[ https://issues.apache.org/jira/browse/IGNITE-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-9576: --- Attachment: Multi-class Logisitc Regression.docx > Document Multi-Class Logistic Regression > > > Key: IGNITE-9576 > URL: https://issues.apache.org/jira/browse/IGNITE-9576 > Project: Ignite > Issue Type: Task > Components: documentation, ml >Reporter: Aleksey Zinoviev >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.7 > > Attachments: Multi-class Logisitc Regression.docx > > > Added documentation for "Multi-class Logisitic Regression" > [https://docs.google.com/document/d/1L2NIZ0K3fn74VswT8k7Qk0Tezqyc_hAJETQGN–TZb4/edit?usp=sharing|https://docs.google.com/document/d/1L2NIZ0K3fn74VswT8k7Qk0Tezqyc_hAJETQGN--TZb4/edit?usp=sharing] > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-9576) Document Multi-Class Logistic Regression
[ https://issues.apache.org/jira/browse/IGNITE-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651521#comment-16651521 ] Akmal Chaudhri commented on IGNITE-9576: [~zaleslaw], edited documentation attached. Please double-check. > Document Multi-Class Logistic Regression > > > Key: IGNITE-9576 > URL: https://issues.apache.org/jira/browse/IGNITE-9576 > Project: Ignite > Issue Type: Task > Components: documentation, ml >Reporter: Aleksey Zinoviev >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.7 > > > Added documentation for "Multi-class Logisitic Regression" > [https://docs.google.com/document/d/1L2NIZ0K3fn74VswT8k7Qk0Tezqyc_hAJETQGN–TZb4/edit?usp=sharing|https://docs.google.com/document/d/1L2NIZ0K3fn74VswT8k7Qk0Tezqyc_hAJETQGN--TZb4/edit?usp=sharing] > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-9575) Document Binary Logistic Regression
[ https://issues.apache.org/jira/browse/IGNITE-9575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651507#comment-16651507 ] Akmal Chaudhri commented on IGNITE-9575: [~zaleslaw], edited documentation attached. Please double-check. [^Binary Logistic Regression.docx] > Document Binary Logistic Regression > --- > > Key: IGNITE-9575 > URL: https://issues.apache.org/jira/browse/IGNITE-9575 > Project: Ignite > Issue Type: Task > Components: documentation, ml >Reporter: Aleksey Zinoviev >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.7 > > Attachments: Binary Logistic Regression.docx > > > The docs for the page "Binary Logistic Regression" > [https://docs.google.com/document/d/1UjcyxHdcRDffbhcFEGkaPvxcG9Xn1SuTy-gmeHWaWFg/edit?usp=sharing] > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-9575) Document Binary Logistic Regression
[ https://issues.apache.org/jira/browse/IGNITE-9575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-9575: --- Attachment: Binary Logistic Regression.docx > Document Binary Logistic Regression > --- > > Key: IGNITE-9575 > URL: https://issues.apache.org/jira/browse/IGNITE-9575 > Project: Ignite > Issue Type: Task > Components: documentation, ml >Reporter: Aleksey Zinoviev >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.7 > > Attachments: Binary Logistic Regression.docx > > > The docs for the page "Binary Logistic Regression" > [https://docs.google.com/document/d/1UjcyxHdcRDffbhcFEGkaPvxcG9Xn1SuTy-gmeHWaWFg/edit?usp=sharing] > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-9577) Document Preprocessing
[ https://issues.apache.org/jira/browse/IGNITE-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-9577: --- Attachment: Preprocessing.docx > Document Preprocessing > -- > > Key: IGNITE-9577 > URL: https://issues.apache.org/jira/browse/IGNITE-9577 > Project: Ignite > Issue Type: Task > Components: documentation, ml >Reporter: Aleksey Zinoviev >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.7 > > Attachments: Preprocessing.docx > > > The link for the updating > [https://apacheignite.readme.io/docs/ml-preprocessing] > > is here > [https://docs.google.com/document/d/1_KAZd5rVTlgWI3ZI9Q5gPVo06SuNZN4Sc6XD7KOX-Xw/edit?usp=sharing] > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-9577) Document Preprocessing
[ https://issues.apache.org/jira/browse/IGNITE-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651493#comment-16651493 ] Akmal Chaudhri commented on IGNITE-9577: [~zaleslaw], edited documentation attached. Please double-check. [^Preprocessing.docx] > Document Preprocessing > -- > > Key: IGNITE-9577 > URL: https://issues.apache.org/jira/browse/IGNITE-9577 > Project: Ignite > Issue Type: Task > Components: documentation, ml >Reporter: Aleksey Zinoviev >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.7 > > Attachments: Preprocessing.docx > > > The link for the updating > [https://apacheignite.readme.io/docs/ml-preprocessing] > > is here > [https://docs.google.com/document/d/1_KAZd5rVTlgWI3ZI9Q5gPVo06SuNZN4Sc6XD7KOX-Xw/edit?usp=sharing] > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-9579) Document Random Forest
[ https://issues.apache.org/jira/browse/IGNITE-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650085#comment-16650085 ] Akmal Chaudhri commented on IGNITE-9579: [~zaleslaw], edited documentation attached. Please double-check. [^Random Forest.docx] > Document Random Forest > -- > > Key: IGNITE-9579 > URL: https://issues.apache.org/jira/browse/IGNITE-9579 > Project: Ignite > Issue Type: Task > Components: documentation, ml >Reporter: Aleksey Zinoviev >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.7 > > Attachments: Random Forest.docx > > > The link for new page with name "Random Forest" is here > https://docs.google.com/document/d/14t67HlWBaoV91887NjqbrsT0dAuExIxUOxYiaIbwEt4/edit?usp=sharing -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-9579) Document Random Forest
[ https://issues.apache.org/jira/browse/IGNITE-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-9579: --- Attachment: Random Forest.docx > Document Random Forest > -- > > Key: IGNITE-9579 > URL: https://issues.apache.org/jira/browse/IGNITE-9579 > Project: Ignite > Issue Type: Task > Components: documentation, ml >Reporter: Aleksey Zinoviev >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.7 > > Attachments: Random Forest.docx > > > The link for new page with name "Random Forest" is here > https://docs.google.com/document/d/14t67HlWBaoV91887NjqbrsT0dAuExIxUOxYiaIbwEt4/edit?usp=sharing -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-9581) Document ANN algorithm based on ACD concept
[ https://issues.apache.org/jira/browse/IGNITE-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650060#comment-16650060 ] Akmal Chaudhri commented on IGNITE-9581: [~zaleslaw], edited documentation attached. Please double-check. [^ANN.docx] > Document ANN algorithm based on ACD concept > --- > > Key: IGNITE-9581 > URL: https://issues.apache.org/jira/browse/IGNITE-9581 > Project: Ignite > Issue Type: Task > Components: documentation, ml >Reporter: Aleksey Zinoviev >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.7 > > Attachments: ANN.docx > > > The documentation for ANN classification algorithm > https://docs.google.com/document/d/1-ie6qrLy6ufkHVabG7ZggKLS2JbsLN2Ciyd_rr6nRgA/edit?usp=sharing -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-9581) Document ANN algorithm based on ACD concept
[ https://issues.apache.org/jira/browse/IGNITE-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-9581: --- Attachment: ANN.docx > Document ANN algorithm based on ACD concept > --- > > Key: IGNITE-9581 > URL: https://issues.apache.org/jira/browse/IGNITE-9581 > Project: Ignite > Issue Type: Task > Components: documentation, ml >Reporter: Aleksey Zinoviev >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.7 > > Attachments: ANN.docx > > > The documentation for ANN classification algorithm > https://docs.google.com/document/d/1-ie6qrLy6ufkHVabG7ZggKLS2JbsLN2Ciyd_rr6nRgA/edit?usp=sharing -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (IGNITE-8994) Configuring dedicated volumes for WAL and data with Kubernetes
[ https://issues.apache.org/jira/browse/IGNITE-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri reassigned IGNITE-8994: -- Assignee: Denis Magda (was: Akmal Chaudhri) > Configuring dedicated volumes for WAL and data with Kubernetes > -- > > Key: IGNITE-8994 > URL: https://issues.apache.org/jira/browse/IGNITE-8994 > Project: Ignite > Issue Type: Task > Components: documentation >Reporter: Denis Magda >Assignee: Denis Magda >Priority: Major > Fix For: 2.7 > > Attachments: yaml.zip > > > The current StatefulSet documentation request only one persistent volume for > both WAL and data/index files: > https://apacheignite.readme.io/docs/stateful-deployment#section-statefulset-deployment > However, according to Ignite performance guide the WAL has to be located on a > dedicated volume: > https://apacheignite.readme.io/docs/durable-memory-tuning#section-separate-disk-device-for-wal > Provide StatefulSet configuration that shows how to request separate volumes > for the WAL and data/index files. If needed, provide YAML configs for > StorageClass and volume claims. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-8994) Configuring dedicated volumes for WAL and data with Kubernetes
[ https://issues.apache.org/jira/browse/IGNITE-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633494#comment-16633494 ] Akmal Chaudhri commented on IGNITE-8994: [~dmagda], I believe this is now complete. > Configuring dedicated volumes for WAL and data with Kubernetes > -- > > Key: IGNITE-8994 > URL: https://issues.apache.org/jira/browse/IGNITE-8994 > Project: Ignite > Issue Type: Task > Components: documentation >Reporter: Denis Magda >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.7 > > Attachments: yaml.zip > > > The current StatefulSet documentation request only one persistent volume for > both WAL and data/index files: > https://apacheignite.readme.io/docs/stateful-deployment#section-statefulset-deployment > However, according to Ignite performance guide the WAL has to be located on a > dedicated volume: > https://apacheignite.readme.io/docs/durable-memory-tuning#section-separate-disk-device-for-wal > Provide StatefulSet configuration that shows how to request separate volumes > for the WAL and data/index files. If needed, provide YAML configs for > StorageClass and volume claims. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-8994) Configuring dedicated volumes for WAL and data with Kubernetes
[ https://issues.apache.org/jira/browse/IGNITE-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-8994: --- Summary: Configuring dedicated volumes for WAL and data with Kubernetes (was: Configuring dedicated volumes for WAL and data with Kuberenetes) > Configuring dedicated volumes for WAL and data with Kubernetes > -- > > Key: IGNITE-8994 > URL: https://issues.apache.org/jira/browse/IGNITE-8994 > Project: Ignite > Issue Type: Task > Components: documentation >Reporter: Denis Magda >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.7 > > Attachments: yaml.zip > > > The current StatefulSet documentation request only one persistent volume for > both WAL and data/index files: > https://apacheignite.readme.io/docs/stateful-deployment#section-statefulset-deployment > However, according to Ignite performance guide the WAL has to be located on a > dedicated volume: > https://apacheignite.readme.io/docs/durable-memory-tuning#section-separate-disk-device-for-wal > Provide StatefulSet configuration that shows how to request separate volumes > for the WAL and data/index files. If needed, provide YAML configs for > StorageClass and volume claims. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (IGNITE-8397) Update documentation for kNN regression (release 2.5)
[ https://issues.apache.org/jira/browse/IGNITE-8397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri reassigned IGNITE-8397: -- Assignee: Prachi Garg (was: Akmal Chaudhri) Prachi, I have reviewed and edited the doc page. Please review when you have time. Thank you. > Update documentation for kNN regression (release 2.5) > - > > Key: IGNITE-8397 > URL: https://issues.apache.org/jira/browse/IGNITE-8397 > Project: Ignite > Issue Type: Improvement > Components: documentation, ml >Affects Versions: 2.5 >Reporter: Aleksey Zinoviev >Assignee: Prachi Garg >Priority: Major > > In Apache Ignite 2.5 we have changed a kNN regression working on top of > partition based dataset and now we need to update documentation for this > feature. > > Previous version: > [https://dash.readme.io/project/apacheignite/v2.4/docs/knn-regression] > update with > New version: > [https://dash.readme.io/project/apacheignite/v2.4/docs/k-nn-regression-25] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-8397) Update documentation for kNN regression (release 2.5)
[ https://issues.apache.org/jira/browse/IGNITE-8397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-8397: --- Description: In Apache Ignite 2.5 we have changed a kNN regression working on top of partition based dataset and now we need to update documentation for this feature. Previous version: [https://dash.readme.io/project/apacheignite/v2.4/docs/knn-regression] update with New version: [https://dash.readme.io/project/apacheignite/v2.4/docs/k-nn-regression-25] was: In Apache Ignite 2.5 we have changed a kNN regression working on top of partition based dataset and now we need to update documentation for this feature. Previous version: [https://dash.readme.io/project/apacheignite/v2.4/docs/knn-regression] update with New version: [https://dash.readme.io/project/apacheignite/v2.4/docs/k-nn-regression-25|http://example.com] > Update documentation for kNN regression (release 2.5) > - > > Key: IGNITE-8397 > URL: https://issues.apache.org/jira/browse/IGNITE-8397 > Project: Ignite > Issue Type: Improvement > Components: documentation, ml >Affects Versions: 2.5 >Reporter: Aleksey Zinoviev >Assignee: Akmal Chaudhri >Priority: Major > > In Apache Ignite 2.5 we have changed a kNN regression working on top of > partition based dataset and now we need to update documentation for this > feature. > > Previous version: > [https://dash.readme.io/project/apacheignite/v2.4/docs/knn-regression] > update with > New version: > [https://dash.readme.io/project/apacheignite/v2.4/docs/k-nn-regression-25] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (IGNITE-8398) Update documentation for KMeans clustering (release 2.5)
[ https://issues.apache.org/jira/browse/IGNITE-8398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri reassigned IGNITE-8398: -- Assignee: Prachi Garg (was: Akmal Chaudhri) Prachi, I have reviewed and edited the doc page. Please review when you have time. Thank you. > Update documentation for KMeans clustering (release 2.5) > > > Key: IGNITE-8398 > URL: https://issues.apache.org/jira/browse/IGNITE-8398 > Project: Ignite > Issue Type: Improvement > Components: documentation, ml >Affects Versions: 2.5 >Reporter: Aleksey Zinoviev >Assignee: Prachi Garg >Priority: Major > > In Apache Ignite 2.5 we have changed a kMeans clustering and remove > FuzzyCMeans working on top of partition based dataset and now we need to > update documentation for this feature. > > Previous version: > [https://dash.readme.io/project/apacheignite/v2.4/docs/k-means-clustering] > update with > New version: > [https://dash.readme.io/project/apacheignite/v2.4/docs/k-means-clustering-25] > > IMPORTANT: Remove page > [https://dash.readme.io/project/apacheignite/v2.4/docs/fuzzy-c-means-clustering] > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (IGNITE-8399) Add documentation for SVM Binary and Multi-class classification (release 2.5)
[ https://issues.apache.org/jira/browse/IGNITE-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri reassigned IGNITE-8399: -- Assignee: Prachi Garg (was: Akmal Chaudhri) Prachi, I have reviewed and edited the doc page. Please review when you have time. Thank you. > Add documentation for SVM Binary and Multi-class classification (release 2.5) > - > > Key: IGNITE-8399 > URL: https://issues.apache.org/jira/browse/IGNITE-8399 > Project: Ignite > Issue Type: Improvement > Components: documentation, ml >Affects Versions: 2.5 >Reporter: Aleksey Zinoviev >Assignee: Prachi Garg >Priority: Major > > In Apache Ignite 2.5 we have added a SVM Binary and Multi-class > classification working on top of partition based dataset and now we need to > update documentation for this feature. > Add page [https://dash.readme.io/project/apacheignite/v2.4/docs/svm-25] > Add page > [https://dash.readme.io/project/apacheignite/v2.4/docs/svm-multi-class-classification-25] > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (IGNITE-8396) Update documentation for kNN classification (release 2.5)
[ https://issues.apache.org/jira/browse/IGNITE-8396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri reassigned IGNITE-8396: -- Assignee: Prachi Garg (was: Akmal Chaudhri) Prachi, I have reviewed and edited the doc page. Please review when you have time. Thank you. > Update documentation for kNN classification (release 2.5) > - > > Key: IGNITE-8396 > URL: https://issues.apache.org/jira/browse/IGNITE-8396 > Project: Ignite > Issue Type: Improvement > Components: documentation, ml >Affects Versions: 2.5 >Reporter: Aleksey Zinoviev >Assignee: Prachi Garg >Priority: Major > > In Apache Ignite 2.5 we have changed a kNN classification working on top of > partition based dataset and now we need to update documentation for this > feature. > > Previous version: > [https://dash.readme.io/project/apacheignite/v2.4/docs/knn-classification] > update with > New version: > [https://dash.readme.io/project/apacheignite/v2.4/docs/k-nn-classification-25] > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (IGNITE-8350) GA Grid: Prepare documentation for 2.5
[ https://issues.apache.org/jira/browse/IGNITE-8350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri reassigned IGNITE-8350: -- Assignee: Prachi Garg (was: Akmal Chaudhri) Prachi, I have reviewed and edited the doc page. Please review when you have time. Thank you. > GA Grid: Prepare documentation for 2.5 > -- > > Key: IGNITE-8350 > URL: https://issues.apache.org/jira/browse/IGNITE-8350 > Project: Ignite > Issue Type: New Feature > Components: documentation >Reporter: Turik Campbell >Assignee: Prachi Garg >Priority: Minor > Fix For: 2.5 > > > Review documentation and prepare for 2.5. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (IGNITE-8269) Add documentation for decision tree (release 2.5)
[ https://issues.apache.org/jira/browse/IGNITE-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri reassigned IGNITE-8269: -- Assignee: Prachi Garg (was: Akmal Chaudhri) Prachi, I have reviewed and edited the doc page. Please review when you have time. Thank you. > Add documentation for decision tree (release 2.5) > - > > Key: IGNITE-8269 > URL: https://issues.apache.org/jira/browse/IGNITE-8269 > Project: Ignite > Issue Type: Improvement > Components: documentation, ml >Affects Versions: 2.5 >Reporter: Anton Dmitriev >Assignee: Prachi Garg >Priority: Major > Fix For: 2.5 > > > In Apache Ignite 2.5 we have added a decision tree based on partition based > dataset and now we need to documentation for this feature. > Affected pages: > [Decision Tree|https://apacheignite.readme.io/v2.4/docs/decision-tree-25] > In release 2.5 > [https://apacheignite.readme.io/docs/decision-trees|https://apacheignite.readme.io/docs/decision-trees] > page should be changed to > [https://apacheignite.readme.io/docs/decision-tree-25|https://apacheignite.readme.io/docs/decision-tree-25]. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (IGNITE-8271) Add documentation for partition based dataset (release 2.5)
[ https://issues.apache.org/jira/browse/IGNITE-8271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri reassigned IGNITE-8271: -- Assignee: Prachi Garg (was: Akmal Chaudhri) Prachi, I have reviewed and edited the doc pages. Please review when you have time. Thank you. > Add documentation for partition based dataset (release 2.5) > --- > > Key: IGNITE-8271 > URL: https://issues.apache.org/jira/browse/IGNITE-8271 > Project: Ignite > Issue Type: Improvement > Components: documentation, ml >Affects Versions: 2.5 >Reporter: Anton Dmitriev >Assignee: Prachi Garg >Priority: Major > Fix For: 2.5 > > > In Apache Ignite 2.5 we have added new infrastructure layer - partition based > dataset, so now we need to add correspondent documentation. > Affected pages: > [Machine > Learning|https://apacheignite.readme.io/v2.4/docs/machine-learning-25] > [Partition Based > Dataset|https://apacheignite.readme.io/v2.4/docs/partition-based-dataset-25] > In release 2.5 > [https://apacheignite.readme.io/docs/machine-learning|https://apacheignite.readme.io/docs/machine-learning] > page should be changed to > [https://apacheignite.readme.io/docs/machine-learning-25|https://apacheignite.readme.io/docs/machine-learning-25]. > In release 2.5 > [https://apacheignite.readme.io/docs/partition-based-dataset-25|https://apacheignite.readme.io/docs/partition-based-dataset-25] > page should be added. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (IGNITE-8268) Add documentation for linear regression (release 2.5)
[ https://issues.apache.org/jira/browse/IGNITE-8268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri reassigned IGNITE-8268: -- Assignee: Prachi Garg (was: Akmal Chaudhri) Prachi, I have reviewed and edited the doc page. Please review when you have time. Thank you. > Add documentation for linear regression (release 2.5) > - > > Key: IGNITE-8268 > URL: https://issues.apache.org/jira/browse/IGNITE-8268 > Project: Ignite > Issue Type: Improvement > Components: documentation, ml >Affects Versions: 2.5 >Reporter: Anton Dmitriev >Assignee: Prachi Garg >Priority: Major > Fix For: 2.5 > > > In Apache Ignite 2.5 we have added two implementation of linear regression > based on partition based dataset: LSQR and gradient descent and now we need > to add documentation for these features. > Affected pages: > [Linear > Regression|https://apacheignite.readme.io/v2.4/docs/linear-regression-25] > In release 2.5 > [https://apacheignite.readme.io/v2.4/docs/ols-multiple-linear-regression|https://apacheignite.readme.io/v2.4/docs/ols-multiple-linear-regression] > should be changed to > [https://apacheignite.readme.io/docs/linear-regression-25|https://apacheignite.readme.io/docs/linear-regression-25]. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (IGNITE-8272) Add documentation for normalization preprocessor (release 2.5)
[ https://issues.apache.org/jira/browse/IGNITE-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri reassigned IGNITE-8272: -- Assignee: Prachi Garg (was: Akmal Chaudhri) Prachi, I have reviewed and edited the doc page. Please review when you have time. Thank you. > Add documentation for normalization preprocessor (release 2.5) > -- > > Key: IGNITE-8272 > URL: https://issues.apache.org/jira/browse/IGNITE-8272 > Project: Ignite > Issue Type: Improvement > Components: documentation, ml >Affects Versions: 2.5 >Reporter: Anton Dmitriev >Assignee: Prachi Garg >Priority: Major > Fix For: 2.5 > > > In Apache Ignite 2.5 we have added a normalization preprocessor working on > top of partition based dataset and now we need to add documentation for this > feature. > Affected pages: > [Preprocessing|https://apacheignite.readme.io/v2.4/docs/preprocessing-25] > In release 2.5 > [https://apacheignite.readme.io/v2.4/docs/preprocessing-25|https://apacheignite.readme.io/v2.4/docs/preprocessing-25] > page should be added. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (IGNITE-7907) Revisit and update the DBeaver documentations
[ https://issues.apache.org/jira/browse/IGNITE-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri closed IGNITE-7907. -- Documentation updated. Only minor updates required. All other instructions work as described. > Revisit and update the DBeaver documentations > - > > Key: IGNITE-7907 > URL: https://issues.apache.org/jira/browse/IGNITE-7907 > Project: Ignite > Issue Type: New Feature > Components: documentation >Reporter: Denis Magda >Assignee: Akmal Chaudhri >Priority: Blocker > Fix For: 2.5 > > > Seems that our documentation is outdated: > http://apache-ignite-users.70518.x6.nabble.com/Ignite-with-dBeaver-td20368.html#a20376 > Need to go from the beginning and update the existing parts. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (IGNITE-7907) Revisit and update the DBeaver documentations
[ https://issues.apache.org/jira/browse/IGNITE-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri resolved IGNITE-7907. Resolution: Fixed Documentation updated. > Revisit and update the DBeaver documentations > - > > Key: IGNITE-7907 > URL: https://issues.apache.org/jira/browse/IGNITE-7907 > Project: Ignite > Issue Type: New Feature > Components: documentation >Reporter: Denis Magda >Assignee: Akmal Chaudhri >Priority: Blocker > Fix For: 2.5 > > > Seems that our documentation is outdated: > http://apache-ignite-users.70518.x6.nabble.com/Ignite-with-dBeaver-td20368.html#a20376 > Need to go from the beginning and update the existing parts. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-7909) Java code examples are needed for Spark Data Frames.
[ https://issues.apache.org/jira/browse/IGNITE-7909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441801#comment-16441801 ] Akmal Chaudhri commented on IGNITE-7909: [~NIzhikov], please review code. > Java code examples are needed for Spark Data Frames. > > > Key: IGNITE-7909 > URL: https://issues.apache.org/jira/browse/IGNITE-7909 > Project: Ignite > Issue Type: Improvement > Components: spark >Affects Versions: 2.5 >Reporter: Akmal Chaudhri >Assignee: Akmal Chaudhri >Priority: Major > Labels: spark > Fix For: 2.5 > > Attachments: JavaIgniteCatalogExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameWriteExample.java > > Original Estimate: 336h > Remaining Estimate: 336h > > Existing Scala code examples have been developed to illustrate Ignite support > for Spark Data Frames. But Java code examples are also required. Some Java > code has already been developed but requires further testing. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (IGNITE-8296) Move Spark Scala DataFrames code examples to correct directory and prefix with "Scalar" to follow convention used with other Scala examples
[ https://issues.apache.org/jira/browse/IGNITE-8296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri reassigned IGNITE-8296: -- Assignee: (was: Akmal Chaudhri) > Move Spark Scala DataFrames code examples to correct directory and prefix > with "Scalar" to follow convention used with other Scala examples > > > Key: IGNITE-8296 > URL: https://issues.apache.org/jira/browse/IGNITE-8296 > Project: Ignite > Issue Type: Improvement > Components: spark >Affects Versions: 2.4 >Reporter: Akmal Chaudhri >Priority: Minor > Fix For: 2.5 > > > # The Spark Scala DataFrames code examples are in the wrong directory. They > should be moved to the correct directory structure. > # The Spark Scala DataFrames code examples should follow the naming > convention used for other Scala code examples and be prefixed with "Scalar". -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-8296) Move Spark Scala DataFrames code examples to correct directory and prefix with "Scalar" to follow convention used with other Scala examples
[ https://issues.apache.org/jira/browse/IGNITE-8296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-8296: --- Description: # The Spark Scala DataFrames code examples are in the wrong directory. They should be moved to the correct directory structure. # The Spark Scala DataFrames code examples should follow the naming convention used for other Scala code examples and be prefixed with "Scalar". was: # The Spark Scala code examples are in the wrong directory. They should be moved to the correct directory structure. # The Spark Scala code examples should follow the naming convention used for other Scala code examples and be prefixed with "Scalar". Summary: Move Spark Scala DataFrames code examples to correct directory and prefix with "Scalar" to follow convention used with other Scala examples (was: Move Spark Scala code examples to correct directory and prefix with "Scalar" to follow convention used with other Scala examples ) > Move Spark Scala DataFrames code examples to correct directory and prefix > with "Scalar" to follow convention used with other Scala examples > > > Key: IGNITE-8296 > URL: https://issues.apache.org/jira/browse/IGNITE-8296 > Project: Ignite > Issue Type: Improvement > Components: spark >Affects Versions: 2.4 >Reporter: Akmal Chaudhri >Assignee: Akmal Chaudhri >Priority: Minor > Fix For: 2.5 > > > # The Spark Scala DataFrames code examples are in the wrong directory. They > should be moved to the correct directory structure. > # The Spark Scala DataFrames code examples should follow the naming > convention used for other Scala code examples and be prefixed with "Scalar". -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (IGNITE-8296) Move Spark Scala code examples to correct directory and prefix with "Scalar" to follow convention used with other Scala examples
Akmal Chaudhri created IGNITE-8296: -- Summary: Move Spark Scala code examples to correct directory and prefix with "Scalar" to follow convention used with other Scala examples Key: IGNITE-8296 URL: https://issues.apache.org/jira/browse/IGNITE-8296 Project: Ignite Issue Type: Improvement Components: spark Affects Versions: 2.4 Reporter: Akmal Chaudhri Assignee: Akmal Chaudhri Fix For: 2.5 # The Spark Scala code examples are in the wrong directory. They should be moved to the correct directory structure. # The Spark Scala code examples should follow the naming convention used for other Scala code examples and be prefixed with "Scalar". -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-7909) Java code examples are needed for Spark Data Frames.
[ https://issues.apache.org/jira/browse/IGNITE-7909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-7909: --- Fix Version/s: 2.5 > Java code examples are needed for Spark Data Frames. > > > Key: IGNITE-7909 > URL: https://issues.apache.org/jira/browse/IGNITE-7909 > Project: Ignite > Issue Type: Improvement > Components: spark >Affects Versions: 2.5 >Reporter: Akmal Chaudhri >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.5 > > Attachments: JavaIgniteCatalogExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameWriteExample.java > > Original Estimate: 336h > Remaining Estimate: 336h > > Existing Scala code examples have been developed to illustrate Ignite support > for Spark Data Frames. But Java code examples are also required. Some Java > code has already been developed but requires further testing. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (IGNITE-7909) Java code examples are needed for Spark Data Frames.
[ https://issues.apache.org/jira/browse/IGNITE-7909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri reassigned IGNITE-7909: -- Assignee: Akmal Chaudhri > Java code examples are needed for Spark Data Frames. > > > Key: IGNITE-7909 > URL: https://issues.apache.org/jira/browse/IGNITE-7909 > Project: Ignite > Issue Type: Improvement > Components: spark >Affects Versions: 2.5 >Reporter: Akmal Chaudhri >Assignee: Akmal Chaudhri >Priority: Major > Attachments: JavaIgniteCatalogExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameWriteExample.java > > Original Estimate: 336h > Remaining Estimate: 336h > > Existing Scala code examples have been developed to illustrate Ignite support > for Spark Data Frames. But Java code examples are also required. Some Java > code has already been developed but requires further testing. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (IGNITE-7909) Java code examples are needed for Spark Data Frames.
Akmal Chaudhri created IGNITE-7909: -- Summary: Java code examples are needed for Spark Data Frames. Key: IGNITE-7909 URL: https://issues.apache.org/jira/browse/IGNITE-7909 Project: Ignite Issue Type: Improvement Components: spark Affects Versions: 2.5 Reporter: Akmal Chaudhri Assignee: Akmal Chaudhri Attachments: JavaIgniteCatalogExample.java, JavaIgniteDataFrameExample.java, JavaIgniteDataFrameWriteExample.java Existing Scala code examples have been developed to illustrate Ignite support for Spark Data Frames. But Java code examples are also required. Some Java code has already been developed but requires further testing. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386076#comment-16386076 ] Akmal Chaudhri edited comment on IGNITE-7655 at 3/5/18 4:05 PM: [~NIzhikov], I think everything is done. I have converted the Scala programs to Java. I have added the code snippets to the documentation. I have added a very small section about SparkSession to the documentation. It needs [~dmagda] to review all this now. was (Author: abchaudhri): [~NIzhikov], i think everything is done. I have converted the Scala programs to Java. I have added the code snippets to the documentation. I have added a very small section about SparkSession to the documentation. It needs [~dmagda] to review all this now. > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Denis Magda >Priority: Major > Fix For: 2.4 > > Attachments: JavaIgniteCatalogExample.java, > JavaIgniteCatalogExample.java, JavaIgniteCatalogExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameWriteExample.java, > JavaIgniteDataFrameWriteExample.java > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386076#comment-16386076 ] Akmal Chaudhri commented on IGNITE-7655: [~NIzhikov], i think everything is done. I have converted the Scala programs to Java. I have added the code snippets to the documentation. I have added a very small section about SparkSession to the documentation. It needs [~dmagda] to review all this now. > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Denis Magda >Priority: Major > Fix For: 2.4 > > Attachments: JavaIgniteCatalogExample.java, > JavaIgniteCatalogExample.java, JavaIgniteCatalogExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameWriteExample.java, > JavaIgniteDataFrameWriteExample.java > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385185#comment-16385185 ] Akmal Chaudhri commented on IGNITE-7655: [~dmagda], some Java code snippets added to the documentation and a small introductory section on SparkSession, which could be expanded. > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Denis Magda >Priority: Major > Fix For: 2.4 > > Attachments: JavaIgniteCatalogExample.java, > JavaIgniteCatalogExample.java, JavaIgniteCatalogExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameWriteExample.java, > JavaIgniteDataFrameWriteExample.java > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri reassigned IGNITE-7655: -- Assignee: Denis Magda (was: Akmal Chaudhri) > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Denis Magda >Priority: Major > Fix For: 2.4 > > Attachments: JavaIgniteCatalogExample.java, > JavaIgniteCatalogExample.java, JavaIgniteCatalogExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameWriteExample.java, > JavaIgniteDataFrameWriteExample.java > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[
https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16384689#comment-16384689
]
Akmal Chaudhri commented on IGNITE-7655:
One small line of code missing from the Java Catalog file:
{code:java}
df2.show();
{code}
It is fixed now.
[^JavaIgniteCatalogExample.java]
> Spark Data Frames: saving data frames into Ignite needs to be documented
>
>
> Key: IGNITE-7655
> URL: https://issues.apache.org/jira/browse/IGNITE-7655
> Project: Ignite
> Issue Type: Bug
> Components: documentation, spark
>Reporter: Nikolay Izhikov
>Assignee: Akmal Chaudhri
>Priority: Major
> Fix For: 2.4
>
> Attachments: JavaIgniteCatalogExample.java,
> JavaIgniteCatalogExample.java, JavaIgniteCatalogExample.java,
> JavaIgniteDataFrameExample.java, JavaIgniteDataFrameExample.java,
> JavaIgniteDataFrameExample.java, JavaIgniteDataFrameWriteExample.java,
> JavaIgniteDataFrameWriteExample.java
>
>
> Once IGNITE-7337 is ready for merge.
> This new feature of Ignite needs to be documented.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-7655: --- Attachment: JavaIgniteCatalogExample.java > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.4 > > Attachments: JavaIgniteCatalogExample.java, > JavaIgniteCatalogExample.java, JavaIgniteCatalogExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameWriteExample.java, > JavaIgniteDataFrameWriteExample.java > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-7655: --- Attachment: JavaIgniteDataFrameWriteExample.java > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.4 > > Attachments: JavaIgniteCatalogExample.java, > JavaIgniteCatalogExample.java, JavaIgniteDataFrameExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameExample.java, > JavaIgniteDataFrameWriteExample.java, JavaIgniteDataFrameWriteExample.java > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16384595#comment-16384595 ] Akmal Chaudhri commented on IGNITE-7655: Attached are the three Scala programs converted to Java. [^JavaIgniteCatalogExample.java] [^JavaIgniteDataFrameExample.java] [^JavaIgniteDataFrameWriteExample.java] Again, probably some improvements, but they work. > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.4 > > Attachments: JavaIgniteCatalogExample.java, > JavaIgniteCatalogExample.java, JavaIgniteDataFrameExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameExample.java, > JavaIgniteDataFrameWriteExample.java, JavaIgniteDataFrameWriteExample.java > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-7655: --- Attachment: JavaIgniteDataFrameExample.java > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.4 > > Attachments: JavaIgniteCatalogExample.java, > JavaIgniteCatalogExample.java, JavaIgniteDataFrameExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameExample.java, > JavaIgniteDataFrameWriteExample.java, JavaIgniteDataFrameWriteExample.java > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-7655: --- Attachment: JavaIgniteCatalogExample.java > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.4 > > Attachments: JavaIgniteCatalogExample.java, > JavaIgniteCatalogExample.java, JavaIgniteDataFrameExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameWriteExample.java > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-7655: --- Attachment: JavaIgniteDataFrameWriteExample.java JavaIgniteDataFrameExample.java JavaIgniteCatalogExample.java > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.4 > > Attachments: JavaIgniteCatalogExample.java, > JavaIgniteDataFrameExample.java, JavaIgniteDataFrameExample.java, > JavaIgniteDataFrameWriteExample.java > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16384260#comment-16384260 ] Akmal Chaudhri edited comment on IGNITE-7655 at 3/2/18 10:49 PM: - Attached is an example using Java. [^JavaIgniteDataFrameExample.java] Probably needs improvement, but it works. was (Author: abchaudhri): Attached is an example using Java. [^JavaIgniteDataFrameExample.java] > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.4 > > Attachments: JavaIgniteDataFrameExample.java > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16384260#comment-16384260 ] Akmal Chaudhri edited comment on IGNITE-7655 at 3/2/18 10:41 PM: - Attached is an example using Java. [^JavaIgniteDataFrameExample.java] was (Author: abchaudhri): Attached is an example using Java. [^JavaIgniteDataFrameExample.java] > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.4 > > Attachments: JavaIgniteDataFrameExample.java > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16384260#comment-16384260 ] Akmal Chaudhri commented on IGNITE-7655: Attached is an example using Java. [^JavaIgniteDataFrameExample.java] > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.4 > > Attachments: JavaIgniteDataFrameExample.java > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri updated IGNITE-7655: --- Attachment: JavaIgniteDataFrameExample.java > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.4 > > Attachments: JavaIgniteDataFrameExample.java > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383947#comment-16383947 ] Akmal Chaudhri commented on IGNITE-7655: [~vkulichenko], [~NIzhikov], thank you. [~dmagda] assisted me today and we were able to get some simple Java code working with Ignite DataFrames. I need to look further at the Spark documentation and I think I will have the equivalent Java code ready quite soon. > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.4 > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[
https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383379#comment-16383379
]
Akmal Chaudhri commented on IGNITE-7655:
[~vkulichenko], I am trying to take the existing Scala code example:
[https://github.com/apache/ignite/blob/master/examples/src/main/spark/org/apache/ignite/examples/spark/IgniteDataFrameExample.scala]
and rewrite it for Java. I am blocked here for the moment:
{code:java}
val igniteDF = spark.read
.format(FORMAT_IGNITE) //Data source type.
.option(OPTION_TABLE, "person") //Table to read.
.option(OPTION_CONFIG_FILE, CONFIG) //Ignite config.
.load()
.filter(col("id") >= 2) //Filter clause.
.filter(col("name") like "%M%") //Another filter clause.
{code}
The Java code to create the tables works ok. However, I don't know Scala, so
trying to do a conversion from one language to another is difficult.
> Spark Data Frames: saving data frames into Ignite needs to be documented
>
>
> Key: IGNITE-7655
> URL: https://issues.apache.org/jira/browse/IGNITE-7655
> Project: Ignite
> Issue Type: Bug
> Components: documentation, spark
>Reporter: Nikolay Izhikov
>Assignee: Akmal Chaudhri
>Priority: Major
> Fix For: 2.4
>
>
> Once IGNITE-7337 is ready for merge.
> This new feature of Ignite needs to be documented.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382547#comment-16382547 ] Akmal Chaudhri commented on IGNITE-7655: [~NIzhikov], I have been trying to build some Java code examples, equivalent to your Scala code. However, I notice that: *org.apache.ignite.spark.IgniteDataFrameSettings* is only implemented in Scala. Is that correct please? Thank you. > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.4 > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri reassigned IGNITE-7655: -- Assignee: Denis Magda (was: Akmal Chaudhri) > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Denis Magda >Priority: Major > Fix For: 2.4 > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380491#comment-16380491 ] Akmal Chaudhri commented on IGNITE-7655: I have gone through the document and improved the readability and formatting. > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Akmal Chaudhri >Priority: Major > Fix For: 2.4 > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-7655) Spark Data Frames: saving data frames into Ignite needs to be documented
[ https://issues.apache.org/jira/browse/IGNITE-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377306#comment-16377306 ] Akmal Chaudhri commented on IGNITE-7655: [~NIzhikov] I have done some minor edits throughout the document to improve readability. The GitHub examples are in Scala, but I will try and build the project and run the code to test that it works. > Spark Data Frames: saving data frames into Ignite needs to be documented > > > Key: IGNITE-7655 > URL: https://issues.apache.org/jira/browse/IGNITE-7655 > Project: Ignite > Issue Type: Bug > Components: documentation, spark >Reporter: Nikolay Izhikov >Assignee: Nikolay Izhikov >Priority: Major > Fix For: 2.4 > > > Once IGNITE-7337 is ready for merge. > This new feature of Ignite needs to be documented. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (IGNITE-7250) Apache Ignite Transactional Subsystem Architecture
[ https://issues.apache.org/jira/browse/IGNITE-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akmal Chaudhri resolved IGNITE-7250. Resolution: Resolved > Apache Ignite Transactional Subsystem Architecture > -- > > Key: IGNITE-7250 > URL: https://issues.apache.org/jira/browse/IGNITE-7250 > Project: Ignite > Issue Type: Task > Components: documentation >Reporter: Denis Magda >Assignee: Akmal Chaudhri > Fix For: 2.4 > > Attachments: Apache Ignite Transactions Architecture Eng 0.2.pdf, > Apache Ignite Transactions Architecture Eng 0.4.pdf, Apache Ignite > Transactions Architecture Rus 0.2.pdf, Apache Ignite Transactions > Architecture Rus 0.4.pdf > > > A couple of community members prepared a well-defined document about Ignite > transactions architecture. See the PDF version attached. > Use this document to enrich the existing page on Ignite transactions. Even > more, it makes sense to define a unique category for transactions and create > several pages. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-6041) Update Gettting Started documentation page
[ https://issues.apache.org/jira/browse/IGNITE-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141460#comment-16141460 ] Akmal Chaudhri commented on IGNITE-6041: Denis, There is a GH repo: https://github.com/VeryFatBoy/Ignite-Getting-Started I have invited you to be collaborator. I will upload some code later today, but not sure if you wanted sub-directories. Either way, I can add some files quite quickly. Thank you. akmal > Update Gettting Started documentation page > -- > > Key: IGNITE-6041 > URL: https://issues.apache.org/jira/browse/IGNITE-6041 > Project: Ignite > Issue Type: Task > Components: website >Reporter: Dmitriy Setrakyan >Assignee: Denis Magda > Labels: docs > > Update Getting Started guide in the documentation [1]: > # show enable/disable persistence flag > # add SQL connectivity example (create, insert, select) > # put data grid example right after SQL > # add collocated computation example to the data grid example > # add service grid example > [1] https://apacheignite.readme.io/docs/getting-started -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (IGNITE-5886) Ignite SQL Getting Started
[
https://issues.apache.org/jira/browse/IGNITE-5886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Akmal Chaudhri resolved IGNITE-5886.
Resolution: Fixed
> Ignite SQL Getting Started
> ---
>
> Key: IGNITE-5886
> URL: https://issues.apache.org/jira/browse/IGNITE-5886
> Project: Ignite
> Issue Type: Task
>Reporter: Denis Magda
>Assignee: Akmal Chaudhri
>Priority: Critical
> Fix For: 2.2
>
>
> The goal of the task is to create an Ignite SQL Getting Started with the
> following sections:
> * Connection to the cluster using JDBC and ODBC drivers. The
> content/description for both drivers will be the same. The only difference
> will be in the source code that can be shown in different tabs of "Code
> Sample" readme.io element. Take a look at the DDL doc [1] that incorporates
> the source code for Java API and JDBC.
> * SQL tables and indexes creation using DDL statements [1]. There should be
> at least two tables. Use the affinity collocation for them. {{CREATE TABLE}}
> command support {{AFFINITYKEY}} parameter that can be passed to {{WITH}}
> block.
> * Preload data using {{INSERT}} statements.
> * Show how to query data with {{SELECT}} statements including joins.
> * Show to update the data sets with {{UPDATE}} and {{DELETE}} statements.
> Here is the page to document (presently it's hidden and visible only for
> documentation contributors):
> https://apacheignite.readme.io/v2.1/docs/getting-started-sql
> Use JDBC thin driver [2] for the JDBC connectivity. The ODBC is well
> documented here [3] and we have a lot of examples for it in Ignite
> deliverables.
> Moreover, as a part of this activity, we will have the ready-to-use source
> code that should be shared on GitHub and mentioned in the documentation.
> [1] https://apacheignite.readme.io/v2.1/docs/distributed-ddl
> [2] https://apacheignite.readme.io/v2.1/docs/jdbc-driver#jdbc-thin-driver
> [3] https://apacheignite.readme.io/v2.1/docs/odbc-driver
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Assigned] (IGNITE-5886) Ignite SQL Getting Started
[
https://issues.apache.org/jira/browse/IGNITE-5886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Akmal Chaudhri reassigned IGNITE-5886:
--
Assignee: Akmal Chaudhri
> Ignite SQL Getting Started
> ---
>
> Key: IGNITE-5886
> URL: https://issues.apache.org/jira/browse/IGNITE-5886
> Project: Ignite
> Issue Type: Task
>Reporter: Denis Magda
>Assignee: Akmal Chaudhri
>Priority: Critical
> Fix For: 2.2
>
>
> The goal of the task is to create an Ignite SQL Getting Started with the
> following sections:
> * Connection to the cluster using JDBC and ODBC drivers. The
> content/description for both drivers will be the same. The only difference
> will be in the source code that can be shown in different tabs of "Code
> Sample" readme.io element. Take a look at the DDL doc [1] that incorporates
> the source code for Java API and JDBC.
> * SQL tables and indexes creation using DDL statements [1]. There should be
> at least two tables. Use the affinity collocation for them. {{CREATE TABLE}}
> command support {{AFFINITYKEY}} parameter that can be passed to {{WITH}}
> block.
> * Preload data using {{INSERT}} statements.
> * Show how to query data with {{SELECT}} statements including joins.
> * Show to update the data sets with {{UPDATE}} and {{DELETE}} statements.
> Here is the page to document (presently it's hidden and visible only for
> documentation contributors):
> https://apacheignite.readme.io/v2.1/docs/getting-started-sql
> Use JDBC thin driver [2] for the JDBC connectivity. The ODBC is well
> documented here [3] and we have a lot of examples for it in Ignite
> deliverables.
> Moreover, as a part of this activity, we will have the ready-to-use source
> code that should be shared on GitHub and mentioned in the documentation.
> [1] https://apacheignite.readme.io/v2.1/docs/distributed-ddl
> [2] https://apacheignite.readme.io/v2.1/docs/jdbc-driver#jdbc-thin-driver
> [3] https://apacheignite.readme.io/v2.1/docs/odbc-driver
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
