Hi Fatemah,
I think there are likely two things to consider here:
1. How will expressions be modeled? There are already some examples of
using expressions in Arrow for pruning predicates [1]. Do you plan to
re-use them?
2. Along these lines is the proposed approach taken because the API to
[
https://issues.apache.org/jira/browse/PARQUET-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Antoine Pitrou reassigned PARQUET-2188:
---
Assignee: fatemah
> Add SkipRecords API to RecordReader
>
[
https://issues.apache.org/jira/browse/PARQUET-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Antoine Pitrou resolved PARQUET-2188.
-
Fix Version/s: cpp-11.0.0
Resolution: Fixed
Issue resolved by pull request
-- Sending as an email in case Jira messages are filtered out. Please let
me know your thoughts on this. Thanks!
Jira ticket: https://issues.apache.org/jira/browse/PARQUET-2210
Currently, we do not use the statistics that is stored in the page headers
for pruning the rows that we read. Row group
fatemah created PARQUET-2210:
Summary: Add FilteredPageReader to filter rows based on page
statistics
Key: PARQUET-2210
URL: https://issues.apache.org/jira/browse/PARQUET-2210
Project: Parquet
[
https://issues.apache.org/jira/browse/PARQUET-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Antoine Pitrou updated PARQUET-2209:
Summary: [C++] Optimize skip for the case that number of values to skip
equals page size
[
https://issues.apache.org/jira/browse/PARQUET-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Antoine Pitrou updated PARQUET-2209:
Component/s: parquet-cpp
> [C++] Optimize skip for the case that number of values to
[
https://issues.apache.org/jira/browse/PARQUET-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated PARQUET-2209:
Labels: pull-request-available (was: )
> Optimize skip for the case that number of
fatemah created PARQUET-2209:
Summary: Optimize skip for the case that number of values to skip
equals page size
Key: PARQUET-2209
URL: https://issues.apache.org/jira/browse/PARQUET-2209
Project: Parquet
[
https://issues.apache.org/jira/browse/PARQUET-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1762#comment-1762
]
ASF GitHub Bot commented on PARQUET-1711:
-
jinyius commented on PR #995:
URL:
jinyius commented on PR #995:
URL: https://github.com/apache/parquet-mr/pull/995#issuecomment-1297295385
@ggershinsky
i'd love to just hit the button. i don't see it. the workflow for travis
ci had a failure due to a transient connection issue, and so it wasn't giving
me the
[
https://issues.apache.org/jira/browse/PARQUET-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626665#comment-17626665
]
ASF GitHub Bot commented on PARQUET-1711:
-
jinyius opened a new pull request, #995:
URL:
[
https://issues.apache.org/jira/browse/PARQUET-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626663#comment-17626663
]
ASF GitHub Bot commented on PARQUET-1711:
-
jinyius commented on PR #995:
URL:
[
https://issues.apache.org/jira/browse/PARQUET-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626664#comment-17626664
]
ASF GitHub Bot commented on PARQUET-1711:
-
jinyius closed pull request #995: PARQUET-1711:
jinyius commented on PR #995:
URL: https://github.com/apache/parquet-mr/pull/995#issuecomment-1297292700
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To
jinyius closed pull request #995: PARQUET-1711: support recursive proto schemas
by limiting recursion depth
URL: https://github.com/apache/parquet-mr/pull/995
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
Hello,
I don't know if everyone here is already aware, but the Apache Software
Foundation has decided that user registration on JIRA will very soon be
moderated in order to fight against issue/comment spam. Concretely, user
creation requests will soon have to be approved by a project's PMC
[
https://issues.apache.org/jira/browse/PARQUET-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626624#comment-17626624
]
ASF GitHub Bot commented on PARQUET-1711:
-
ggershinsky commented on PR #995:
URL:
ggershinsky commented on PR #995:
URL: https://github.com/apache/parquet-mr/pull/995#issuecomment-1297193514
yep, just the squash/merge button.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
Parquet columnar encryption supports these types. Currently, it requires an
explicit full path for each column to be encrypted.
Your sample will work with
*spark.sparkContext.hadoopConfiguration.set("parquet.encryption.column.keys",
"k2:rider.list.element.foo,rider.list.element.bar")*
Having said
Gidon Gershinsky created PARQUET-2208:
-
Summary: Add details to nested column encryption config doc and
exception text
Key: PARQUET-2208
URL: https://issues.apache.org/jira/browse/PARQUET-2208
21 matches
Mail list logo
