[
https://issues.apache.org/jira/browse/HUDI-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351095#comment-17351095
]
Sugamber commented on HUDI-1668:
[~nishith29] Yes, We can close this.
Thank you!!!
>
[
https://issues.apache.org/jira/browse/HUDI-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350651#comment-17350651
]
Nishith Agarwal commented on HUDI-1668:
---
[~shivnarayan] [~sugamberku] Spark has a 3 stage sorting
[
https://issues.apache.org/jira/browse/HUDI-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17326526#comment-17326526
]
Sugamber commented on HUDI-1668:
[~shivnarayan] I see Global sort executed twice in this example.
>
[
https://issues.apache.org/jira/browse/HUDI-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17326525#comment-17326525
]
Sugamber commented on HUDI-1668:
I've attached the both screenshot.
!Screenshot 2021-04-21 at 6.40.19
[
https://issues.apache.org/jira/browse/HUDI-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17326397#comment-17326397
]
Sugamber commented on HUDI-1668:
[~shivnarayan], I don't have spark 2.4.3 cluster.
I'll run the job and
[
https://issues.apache.org/jira/browse/HUDI-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324294#comment-17324294
]
sivabalan narayanan commented on HUDI-1668:
---
btw, min supported spark version is 2.4.3. Can you
[
https://issues.apache.org/jira/browse/HUDI-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324293#comment-17324293
]
sivabalan narayanan commented on HUDI-1668:
---
and btw, we have a direct row writing option (w/o
[
https://issues.apache.org/jira/browse/HUDI-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324292#comment-17324292
]
sivabalan narayanan commented on HUDI-1668:
---
[~sugamberku]: can you attach screenshots for spark
