[jira] [Commented] (ASTERIXDB-3255) Embed computed fields' values to resulting records
[ https://issues.apache.org/jira/browse/ASTERIXDB-3255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17765822#comment-17765822 ] ASF subversion and git services commented on ASTERIXDB-3255: Commit e45416d27de9f89870b3d353fbfe7ae0d78de874 in asterixdb's branch refs/heads/master from Wail Alkowaileet [ https://gitbox.apache.org/repos/asf?p=asterixdb.git;h=e45416d27d ] [ASTERIXDB-3255][RT] Embed filter values in CSV/TSV - user model changes: no - storage format changes: no - interface changes: no Details: Add the support to embed filter values when parsing CSV files.. Change-Id: I611e2117cc68d7f1f2c5c5bcf1c97947f20043cb Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/17779 Integration-Tests: Jenkins Tested-by: Jenkins Reviewed-by: Wail Alkowaileet > Embed computed fields' values to resulting records > -- > > Key: ASTERIXDB-3255 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-3255 > Project: Apache AsterixDB > Issue Type: Improvement > Components: EXT - External data >Affects Versions: 0.9.9 >Reporter: Wail Y. Alkowaileet >Assignee: Wail Y. Alkowaileet >Priority: Major > Labels: triaged > Fix For: 0.9.9 > > > The current implementation of dynamic prefixes requires that declared > computed fields should also appear in the external datasets' records. In > certain use cases, computed fields may not have the same values or they may > have a different JSON path or type. Those cases should be handled by > embedding the values of computed fields. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (ASTERIXDB-3255) Embed computed fields' values to resulting records
[ https://issues.apache.org/jira/browse/ASTERIXDB-3255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17765663#comment-17765663 ] ASF subversion and git services commented on ASTERIXDB-3255: Commit 9682753fc2111dbcb7d6d0d3b5b2015d9661cc5c in asterixdb's branch refs/heads/master from Wail Alkowaileet [ https://gitbox.apache.org/repos/asf?p=asterixdb.git;h=9682753fc2 ] [ASTERIXDB-3255][RT] Embed filter values in Parquet - user model changes: no - storage format changes: no - interface changes: yes Details: Add the support to emved filter values when assembling Parquet's columns. Change-Id: I537133639a464ab46f60e2aa27ae68ab203c1989 Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/17776 Integration-Tests: Jenkins Tested-by: Jenkins Reviewed-by: Wail Alkowaileet Reviewed-by: Hussain Towaileb > Embed computed fields' values to resulting records > -- > > Key: ASTERIXDB-3255 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-3255 > Project: Apache AsterixDB > Issue Type: Improvement > Components: EXT - External data >Affects Versions: 0.9.9 >Reporter: Wail Y. Alkowaileet >Assignee: Wail Y. Alkowaileet >Priority: Major > Labels: triaged > Fix For: 0.9.9 > > > The current implementation of dynamic prefixes requires that declared > computed fields should also appear in the external datasets' records. In > certain use cases, computed fields may not have the same values or they may > have a different JSON path or type. Those cases should be handled by > embedding the values of computed fields. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (ASTERIXDB-3255) Embed computed fields' values to resulting records
[ https://issues.apache.org/jira/browse/ASTERIXDB-3255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17764474#comment-17764474 ] ASF subversion and git services commented on ASTERIXDB-3255: Commit 5d4846e73d28633e230714be27e7035428df8d4a in asterixdb's branch refs/heads/master from Wail Alkowaileet [ https://gitbox.apache.org/repos/asf?p=asterixdb.git;h=5d4846e73d ] [ASTERIXDB-3255][RT] Prepare for embedding values in parquet - user model changes: no - storage format changes: no - interface changes: yes Details: Preparing for embedding computed fields' values in Parquet. This patch introduces IExternalDataRuntimeContext, which could have different implementations when creating parsers, readers, and/or input-streams. Change-Id: Idde191ab6d99c48022bb65bec648e83e249e4b75 Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/17767 Integration-Tests: Jenkins Tested-by: Jenkins Reviewed-by: Wail Alkowaileet Reviewed-by: Ali Alsuliman > Embed computed fields' values to resulting records > -- > > Key: ASTERIXDB-3255 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-3255 > Project: Apache AsterixDB > Issue Type: Improvement > Components: EXT - External data >Affects Versions: 0.9.9 >Reporter: Wail Y. Alkowaileet >Assignee: Wail Y. Alkowaileet >Priority: Major > Labels: triaged > Fix For: 0.9.9 > > > The current implementation of dynamic prefixes requires that declared > computed fields should also appear in the external datasets' records. In > certain use cases, computed fields may not have the same values or they may > have a different JSON path or type. Those cases should be handled by > embedding the values of computed fields. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (ASTERIXDB-3255) Embed computed fields' values to resulting records
[ https://issues.apache.org/jira/browse/ASTERIXDB-3255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17763164#comment-17763164 ] ASF subversion and git services commented on ASTERIXDB-3255: Commit dcfbcad74fcf7ab2596ca14c5b4831beba7d62dc in asterixdb's branch refs/heads/master from Wail Alkowaileet [ https://gitbox.apache.org/repos/asf?p=asterixdb.git;h=dcfbcad74f ] [ASTERIXDB-3255][EXT] Part1: Embed external filter values - user model changes: yes - storage format changes: no - interface changes: yes Details: - Embed filter values by default -- Users can disable that by setting 'embed-filter-values' to false when creating an external dataset. -- Value embedding is performed at the parser level - This patch includes the support of value embedding when querying JSON-based external datasets. - The support for Parquet, CSV, and TSV will be included in follow-up patches. Change-Id: Ia61a62ab1390d9d87105898cf8c17f77c136c434 Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/17751 Integration-Tests: Jenkins Tested-by: Jenkins Reviewed-by: Wail Alkowaileet Reviewed-by: Hussain Towaileb > Embed computed fields' values to resulting records > -- > > Key: ASTERIXDB-3255 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-3255 > Project: Apache AsterixDB > Issue Type: Improvement > Components: EXT - External data >Affects Versions: 0.9.9 >Reporter: Wail Y. Alkowaileet >Assignee: Wail Y. Alkowaileet >Priority: Major > Labels: triaged > Fix For: 0.9.9 > > > The current implementation of dynamic prefixes requires that declared > computed fields should also appear in the external datasets' records. In > certain use cases, computed fields may not have the same values or they may > have a different JSON path or type. Those cases should be handled by > embedding the values of computed fields. -- This message was sent by Atlassian Jira (v8.20.10#820010)
