[jira] [Assigned] (BEAM-3176) BeamSqlCli: support DROP clause
[ https://issues.apache.org/jira/browse/BEAM-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-3176: -- Assignee: James Xu (was: Xu Mingmin) > BeamSqlCli: support DROP clause > --- > > Key: BEAM-3176 > URL: https://issues.apache.org/jira/browse/BEAM-3176 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2194) JOIN: cross join
[ https://issues.apache.org/jira/browse/BEAM-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2194: -- Assignee: (was: James Xu) > JOIN: cross join > > > Key: BEAM-2194 > URL: https://issues.apache.org/jira/browse/BEAM-2194 > Project: Beam > Issue Type: New Feature > Components: dsl-sql >Reporter: James Xu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2201) Support set statement
[ https://issues.apache.org/jira/browse/BEAM-2201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2201: -- Assignee: (was: James Xu) > Support set statement > - > > Key: BEAM-2201 > URL: https://issues.apache.org/jira/browse/BEAM-2201 > Project: Beam > Issue Type: Task > Components: dsl-sql >Reporter: James Xu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2721) Augment BeamRecordType to do slicing and concatenation.
[ https://issues.apache.org/jira/browse/BEAM-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2721: -- Assignee: (was: Xu Mingmin) > Augment BeamRecordType to do slicing and concatenation. > --- > > Key: BEAM-2721 > URL: https://issues.apache.org/jira/browse/BEAM-2721 > Project: Beam > Issue Type: Bug > Components: dsl-sql >Reporter: Robert Bradshaw > > Currently in several places we cast to BeamSqlRecordType, extract the field > type ints, do the slicing, and then reconstruct a new BeamSqlRecordType. If > BeamRecordType had polymorphic methods to slice/concat this would be cleaner > and more flexible. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (BEAM-3176) BeamSqlCli: support DROP clause
James Xu created BEAM-3176: -- Summary: BeamSqlCli: support DROP clause Key: BEAM-3176 URL: https://issues.apache.org/jira/browse/BEAM-3176 Project: Beam Issue Type: Sub-task Components: dsl-sql Reporter: James Xu Assignee: Xu Mingmin -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (BEAM-3175) BeamSqlCli: support SELECT CLAUSE
James Xu created BEAM-3175: -- Summary: BeamSqlCli: support SELECT CLAUSE Key: BEAM-3175 URL: https://issues.apache.org/jira/browse/BEAM-3175 Project: Beam Issue Type: Sub-task Components: dsl-sql Reporter: James Xu -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Closed] (BEAM-2651) Change requests for DSL_SQL merge
[ https://issues.apache.org/jira/browse/BEAM-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu closed BEAM-2651. -- Resolution: Fixed Fix Version/s: Not applicable > Change requests for DSL_SQL merge > - > > Key: BEAM-2651 > URL: https://issues.apache.org/jira/browse/BEAM-2651 > Project: Beam > Issue Type: Task > Components: dsl-sql >Reporter: Xu Mingmin > Labels: bundle, dsl_sql_merge, dsl_sql_review > Fix For: Not applicable > > > This task collects all the sub-tasks, which are requested in > https://github.com/apache/beam/pull/3606. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Closed] (BEAM-2678) add a validation in BeamRowType.create
[
https://issues.apache.org/jira/browse/BEAM-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
James Xu closed BEAM-2678.
--
Resolution: Fixed
Fix Version/s: Not applicable
> add a validation in BeamRowType.create
> --
>
> Key: BEAM-2678
> URL: https://issues.apache.org/jira/browse/BEAM-2678
> Project: Beam
> Issue Type: Improvement
> Components: dsl-sql
>Reporter: Xu Mingmin
>Assignee: Xu Mingmin
>Priority: Minor
> Fix For: Not applicable
>
>
> A validation is required in method {{BeamRowType.create()}} to ensure that
> {{fieldNames.size() == fieldTypes.size()}}.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (BEAM-2678) add a validation in BeamRowType.create
[
https://issues.apache.org/jira/browse/BEAM-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249225#comment-16249225
]
James Xu commented on BEAM-2678:
The check is already there in code. Closing...
> add a validation in BeamRowType.create
> --
>
> Key: BEAM-2678
> URL: https://issues.apache.org/jira/browse/BEAM-2678
> Project: Beam
> Issue Type: Improvement
> Components: dsl-sql
>Reporter: Xu Mingmin
>Assignee: Xu Mingmin
>Priority: Minor
>
> A validation is required in method {{BeamRowType.create()}} to ensure that
> {{fieldNames.size() == fieldTypes.size()}}.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Closed] (BEAM-3170) support topicPartition in BeamKafkaTable
[
https://issues.apache.org/jira/browse/BEAM-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
James Xu closed BEAM-3170.
--
Resolution: Fixed
Fix Version/s: 2.3.0
> support topicPartition in BeamKafkaTable
>
>
> Key: BEAM-3170
> URL: https://issues.apache.org/jira/browse/BEAM-3170
> Project: Beam
> Issue Type: Improvement
> Components: dsl-sql
>Reporter: Xu Mingmin
>Assignee: Xu Mingmin
> Fix For: 2.3.0
>
>
> In {{KafkaIO}} there're two options to set the source topics/partitions, and
> we only support the 1st one now:
> {code}
> 1 .withTopics(topics)
> 2. withTopicPartitions(topicPartitions)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Closed] (BEAM-3161) Cannot output with timestamp XXXX
[
https://issues.apache.org/jira/browse/BEAM-3161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
James Xu closed BEAM-3161.
--
Resolution: Fixed
> Cannot output with timestamp
> -
>
> Key: BEAM-3161
> URL: https://issues.apache.org/jira/browse/BEAM-3161
> Project: Beam
> Issue Type: Bug
> Components: dsl-sql
>Reporter: Xu Mingmin
>Assignee: Xu Mingmin
> Fix For: 2.3.0
>
>
> BeamSQL throws exception when running query
> {code}
> select siteId, count(*), TUMBLE_START(unix_timestamp_to_date(eventTimestamp),
> INTERVAL '1' HOUR) from RHEOS_SOJEVENT_TOTAL GROUP BY siteId,
> TUMBLE(unix_timestamp_to_date(eventTimestamp), INTERVAL '1' HOUR)
> {code}
> Exception details:
> {code}
> Caused by: java.lang.IllegalArgumentException: Cannot output with timestamp
> 2017-11-08T21:37:46.000Z. Output timestamps must be no earlier than the
> timestamp of the current input (2017-11-08T21:37:49.322Z) minus the allowed
> skew (0 milliseconds). See the DoFn#getAllowedTimestampSkew() Javadoc for
> details on changing the allowed skew.
> at
> org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.checkTimestamp(SimpleDoFnRunner.java:463)
> at
> org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.outputWithTimestamp(SimpleDoFnRunner.java:429)
> at org.apache.Caused by: java.lang.IllegalArgumentException: Cannot
> output with timestamp 2017-11-08T21:37:46.000Z. Output timestamps must be no
> earlier than the timestamp of the current input (2017-11-08T21:37:49.322Z)
> minus the allowed skew (0 milliseconds). See the
> DoFn#getAllowedTimestampSkew() Javadoc for details on changing the allowed
> skew.
> at
> org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.checkTimestamp(SimpleDoFnRunner.java:463)
> at
> org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.outputWithTimestamp(SimpleDoFnRunner.java:429)
> at
> org.apache.beam.sdk.transforms.WithTimestamps$AddTimestampsDoFn.processElement(WithTimestamps.java:138)beam.sdk.transforms.WithTimestamps$AddTimestampsDoFn.processElement(WithTimestamps.java:138)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Closed] (BEAM-2441) DSL SQL maven module location and name
[
https://issues.apache.org/jira/browse/BEAM-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
James Xu closed BEAM-2441.
--
Resolution: Fixed
Fix Version/s: Not applicable
> DSL SQL maven module location and name
> --
>
> Key: BEAM-2441
> URL: https://issues.apache.org/jira/browse/BEAM-2441
> Project: Beam
> Issue Type: Improvement
> Components: dsl-sql
>Reporter: Luke Cwik
>Assignee: James Xu
> Labels: dsl_sql_merge
> Fix For: Not applicable
>
>
> The current maven module location is *dsl/sql*, unfortunately this occludes
> the fact that this is for the Java SDK and also prevents alternative language
> implementations.
> Some alternative locations could be:
> {code}
> sdks/java/extensions/sql
> sdks/java/dsls/sql
> dsls/sql/java
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Closed] (BEAM-2528) BeamSql: support create table
[ https://issues.apache.org/jira/browse/BEAM-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu closed BEAM-2528. -- Resolution: Fixed Fix Version/s: 2.3.0 > BeamSql: support create table > - > > Key: BEAM-2528 > URL: https://issues.apache.org/jira/browse/BEAM-2528 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Fix For: 2.3.0 > > > support create table. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-3171) convert a join into lookup
[
https://issues.apache.org/jira/browse/BEAM-3171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248295#comment-16248295
]
James Xu commented on BEAM-3171:
I like the ability to external joining a dimension table.
After read the external join link you referenced, seems [~kenn] are objecting
to implement it as a new PTransform in the Beam model, instead we should
optimize the SideInput to let the beam program can get values by keys, and let
the runner decide to load all data in or just query the remote KV store every
time, I like this solution, it's cleaner.
But before we have the optimized SideInput, there's no harm to have an improved
external join first.
> convert a join into lookup
> --
>
> Key: BEAM-3171
> URL: https://issues.apache.org/jira/browse/BEAM-3171
> Project: Beam
> Issue Type: New Feature
> Components: dsl-sql
>Reporter: Xu Mingmin
>Assignee: Xu Mingmin
> Labels: experimental
>
> We use BeamSQL to run streaming jobs mostly, and add a join_as_lookup
> improvement(internal branch) to cover the streaming-to-batch case(similar as
> [1]). I could submit a PR as experimental if people are interested.
> The rough solution is, if one source of join node implements
> {{BeamSeekableTable}} and the other is not, then the join node is converted
> to a fact-lookup operation.
> Ref:
> [1]
> https://docs.google.com/document/d/1B-XnUwXh64lbswRieckU0BxtygSV58hysqZbpZmk03A/edit?usp=sharing
>
> [~xumingming] [~takidau] for any comments
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (BEAM-995) Apache Pig DSL
[ https://issues.apache.org/jira/browse/BEAM-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182502#comment-16182502 ] James Xu commented on BEAM-995: --- [~nielsbasjes] Pig actually is doing the similar thing as Beam: # They both defined an unified data processing API # They both support several backends. So do pig-on-beam on either side does not have so much difference. I prefer to do it on beam-side because: # BEAM is already doing the `support several backends` thing, let's just let BEAM do it, make pig focus more on its primary advantage: the friendly API. # To align with other extension like SQL. For the pros to do it on pig-side you mentioned: 1. Builtin facilities for loading UDFs and UDAFs > Yes, I agree, the existing UDFs and UDAFs are very important. If we do > pig-on-beam on beam-side, we will have something like `UDFAdapter` which will > adapt all existing UDFs, so we can use them in the new pig-on-beam. 2. Execution flow optimizer(s) > There is pipeline optimizer in BEAM, and also an optimizer in underline > engine(Spark, MapReduce), will pig optimizer matter so much in this context? > (I am not familiar with Pig, correct me if I am wrong) 3. A selection of execution backends. > Beam itself supports all the different backends. > Apache Pig DSL > -- > > Key: BEAM-995 > URL: https://issues.apache.org/jira/browse/BEAM-995 > Project: Beam > Issue Type: New Feature > Components: sdk-ideas >Reporter: Jean-Baptiste Onofré >Assignee: Jean-Baptiste Onofré > > Apache Pig is still popular and the language is not so large. > Providing a DSL using the Pig language would potentially allow more people to > use Beam (at least during a transition period). -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2739) improve JavaDoc in BeamSqlEnv
[ https://issues.apache.org/jira/browse/BEAM-2739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124790#comment-16124790 ] James Xu commented on BEAM-2739: BeamSqlEnv will be moved to `.impl` in https://github.com/apache/beam/pull/3708 > improve JavaDoc in BeamSqlEnv > - > > Key: BEAM-2739 > URL: https://issues.apache.org/jira/browse/BEAM-2739 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: Xu Mingmin > Labels: dsl_sql_merge, dsl_sql_review > > Refer to : > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmjhfE > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmjhfM -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2746) change visibility of BeamSqlTable
[ https://issues.apache.org/jira/browse/BEAM-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124789#comment-16124789 ] James Xu commented on BEAM-2746: Let's merge it into BEAM-2740, it will be covered by https://github.com/apache/beam/pull/3708 > change visibility of BeamSqlTable > - > > Key: BEAM-2746 > URL: https://issues.apache.org/jira/browse/BEAM-2746 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: Xu Mingmin >Assignee: James Xu > Labels: dsl_sql_merge, dsl_sql_review > > refer to > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmjhgQ -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2747) accept CombineFn as UDAF
[ https://issues.apache.org/jira/browse/BEAM-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121681#comment-16121681 ] James Xu commented on BEAM-2747: To be more clear, since the signature to add a function is: ``` void add(String var1, Function var2); ``` we can create a `BeamAggregateFunctiomImpl` which copy the implementation of Calcite's `AggregationFunctionImpl`, but add a method which accept a CombineFn to build a BeamAggregateFunctiomImpl. > accept CombineFn as UDAF > > > Key: BEAM-2747 > URL: https://issues.apache.org/jira/browse/BEAM-2747 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: Xu Mingmin >Assignee: Xu Mingmin > Labels: dsl_sql_merge, dsl_sql_review > > refer to > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmjhgo -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2747) accept CombineFn as UDAF
[ https://issues.apache.org/jira/browse/BEAM-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121112#comment-16121112 ] James Xu commented on BEAM-2747: [~mingmxu] I think the Adapter strategy should work. Although AggregateFunctionImpl.create() only take one Class parameter. But we can copy the implementation out, make some modification, make it accept a CombineFn instance. > accept CombineFn as UDAF > > > Key: BEAM-2747 > URL: https://issues.apache.org/jira/browse/BEAM-2747 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: Xu Mingmin >Assignee: Xu Mingmin > Labels: dsl_sql_merge, dsl_sql_review > > refer to > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmjhgo -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2739) improve JavaDoc in BeamSqlEnv
[ https://issues.apache.org/jira/browse/BEAM-2739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119736#comment-16119736 ] James Xu commented on BEAM-2739: Seems no need to add javadoc due to my comments here: https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmjhfE > improve JavaDoc in BeamSqlEnv > - > > Key: BEAM-2739 > URL: https://issues.apache.org/jira/browse/BEAM-2739 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: Xu Mingmin > Labels: dsl_sql_merge, dsl_sql_review > > Refer to : > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmjhfE > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmjhfM -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2733) update JavaDoc of BeamSql
[ https://issues.apache.org/jira/browse/BEAM-2733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2733: -- Assignee: James Xu > update JavaDoc of BeamSql > - > > Key: BEAM-2733 > URL: https://issues.apache.org/jira/browse/BEAM-2733 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: Xu Mingmin >Assignee: James Xu > Labels: dsl_sql_merge, dsl_sql_review > > refer to discussions: > 1. > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmFcik > 2. > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmjhfc > 3. > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmjhfU > 4. > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmjhfY > 5. > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmjhfQ -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2743) rename size() in BeamRecord
[ https://issues.apache.org/jira/browse/BEAM-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117997#comment-16117997 ] James Xu commented on BEAM-2743: already covered by BEAM-2744 > rename size() in BeamRecord > --- > > Key: BEAM-2743 > URL: https://issues.apache.org/jira/browse/BEAM-2743 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: Xu Mingmin >Assignee: James Xu > Labels: dsl_sql_merge, dsl_sql_review > > refer to > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTrrtwc -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2746) change visibility of BeamSqlTable
[ https://issues.apache.org/jira/browse/BEAM-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2746: -- Assignee: James Xu > change visibility of BeamSqlTable > - > > Key: BEAM-2746 > URL: https://issues.apache.org/jira/browse/BEAM-2746 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: Xu Mingmin >Assignee: James Xu > Labels: dsl_sql_merge, dsl_sql_review > > refer to > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmjhgQ -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2740) update exposed methods in BeamSqlEnv
[ https://issues.apache.org/jira/browse/BEAM-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2740: -- Assignee: James Xu > update exposed methods in BeamSqlEnv > > > Key: BEAM-2740 > URL: https://issues.apache.org/jira/browse/BEAM-2740 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: Xu Mingmin >Assignee: James Xu > Labels: dsl_sql_merge, dsl_sql_review > > Refer to > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmFcis > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmFciw -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2745) add getFieldTypeByIndex(index) in BeamRecordSqlType
[ https://issues.apache.org/jira/browse/BEAM-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2745: -- Assignee: James Xu > add getFieldTypeByIndex(index) in BeamRecordSqlType > --- > > Key: BEAM-2745 > URL: https://issues.apache.org/jira/browse/BEAM-2745 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: Xu Mingmin >Assignee: James Xu > Labels: dsl_sql_merge, dsl_sql_review > > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTmjhgQ -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2744) rename size() in BeamRecordType
[ https://issues.apache.org/jira/browse/BEAM-2744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2744: -- Assignee: James Xu > rename size() in BeamRecordType > --- > > Key: BEAM-2744 > URL: https://issues.apache.org/jira/browse/BEAM-2744 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: Xu Mingmin >Assignee: James Xu > Labels: dsl_sql_merge, dsl_sql_review > > refer to > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTrrtwc -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2743) rename size() in BeamRecord
[ https://issues.apache.org/jira/browse/BEAM-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2743: -- Assignee: James Xu > rename size() in BeamRecord > --- > > Key: BEAM-2743 > URL: https://issues.apache.org/jira/browse/BEAM-2743 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: Xu Mingmin >Assignee: James Xu > Labels: dsl_sql_merge, dsl_sql_review > > refer to > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTrrtwc -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2742) Switch from primitives to Java types
[ https://issues.apache.org/jira/browse/BEAM-2742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2742: -- Assignee: James Xu > Switch from primitives to Java types > > > Key: BEAM-2742 > URL: https://issues.apache.org/jira/browse/BEAM-2742 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: Xu Mingmin >Assignee: James Xu > Labels: dsl_sql_merge, dsl_sql_review > > Refer to > https://docs.google.com/document/d/1VlAqKLhQua6YpR42KuziIYHTB1FfQTi16Mh88MEYBsU/edit?disco=BTrrtwc -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2441) DSL SQL maven module location and name
[
https://issues.apache.org/jira/browse/BEAM-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
James Xu reassigned BEAM-2441:
--
Assignee: James Xu
> DSL SQL maven module location and name
> --
>
> Key: BEAM-2441
> URL: https://issues.apache.org/jira/browse/BEAM-2441
> Project: Beam
> Issue Type: Improvement
> Components: dsl-sql
>Reporter: Luke Cwik
>Assignee: James Xu
> Labels: dsl_sql_merge
>
> The current maven module location is *dsl/sql*, unfortunately this occludes
> the fact that this is for the Java SDK and also prevents alternative language
> implementations.
> Some alternative locations could be:
> {code}
> sdks/java/extensions/sql
> sdks/java/dsls/sql
> dsls/sql/java
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Assigned] (BEAM-2445) DSL SQL to use service locator pattern to automatically register UDFs
[ https://issues.apache.org/jira/browse/BEAM-2445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2445: -- Assignee: James Xu > DSL SQL to use service locator pattern to automatically register UDFs > - > > Key: BEAM-2445 > URL: https://issues.apache.org/jira/browse/BEAM-2445 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Luke Cwik >Assignee: James Xu >Priority: Minor > Labels: dsl_sql_merge > > Use a service locator pattern to find UDFs that can be registered. The > service loader can be used to register UDFs for standard functions via DSL > SQL, additional UDFs registered by third party libraries, and end user > created UDFs. > Example ServiceLoader usage within Apache Beam to find coder providers: > https://github.com/apache/beam/blob/7126fdc6ee5671e99a2dede3f25ba616aa0e8fa4/sdks/java/core/src/main/java/org/apache/beam/sdk/coders/CoderRegistry.java#L147 -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2441) DSL SQL maven module location and name
[
https://issues.apache.org/jira/browse/BEAM-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098523#comment-16098523
]
James Xu commented on BEAM-2441:
Since there is already many extensions in `sdks/java/extensions/sql`, how about
use `sdks/java/extensions/sql`?
> DSL SQL maven module location and name
> --
>
> Key: BEAM-2441
> URL: https://issues.apache.org/jira/browse/BEAM-2441
> Project: Beam
> Issue Type: Improvement
> Components: dsl-sql
>Reporter: Luke Cwik
> Labels: dsl_sql_merge
>
> The current maven module location is *dsl/sql*, unfortunately this occludes
> the fact that this is for the Java SDK and also prevents alternative language
> implementations.
> Some alternative locations could be:
> {code}
> sdks/java/extensions/sql
> sdks/java/dsls/sql
> dsls/sql/java
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Resolved] (BEAM-2515) BeamSql: refactor the MockedBeamSqlTable and related tests
[ https://issues.apache.org/jira/browse/BEAM-2515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2515. Resolution: Fixed Fix Version/s: 2.2.0 > BeamSql: refactor the MockedBeamSqlTable and related tests > -- > > Key: BEAM-2515 > URL: https://issues.apache.org/jira/browse/BEAM-2515 > Project: Beam > Issue Type: Bug > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Fix For: 2.2.0 > > > MockedBeamSqlTable is only for Bounded data sources, after another Unbounded > mock added, some refactor will be needed. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2563) Add integration test for math operators
[ https://issues.apache.org/jira/browse/BEAM-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2563. Resolution: Fixed Fix Version/s: 2.2.0 > Add integration test for math operators > --- > > Key: BEAM-2563 > URL: https://issues.apache.org/jira/browse/BEAM-2563 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: James Xu >Assignee: Xu Mingmin > Labels: dsl_sql_merge > Fix For: 2.2.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2559) Add integration test for the sql functions
[ https://issues.apache.org/jira/browse/BEAM-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2559. Resolution: Fixed Fix Version/s: 2.2.0 > Add integration test for the sql functions > -- > > Key: BEAM-2559 > URL: https://issues.apache.org/jira/browse/BEAM-2559 > Project: Beam > Issue Type: Task > Components: dsl-sql >Reporter: James Xu > Labels: dsl_sql_merge > Fix For: 2.2.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2613) Add integration test for comparison operators
[ https://issues.apache.org/jira/browse/BEAM-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2613. Resolution: Fixed Fix Version/s: 2.2.0 > Add integration test for comparison operators > - > > Key: BEAM-2613 > URL: https://issues.apache.org/jira/browse/BEAM-2613 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Labels: dsl_sql_merge > Fix For: 2.2.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2621) rename BeamSqlRecordType to BeamSqlRowType
[ https://issues.apache.org/jira/browse/BEAM-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2621. Resolution: Fixed Fix Version/s: 2.2.0 > rename BeamSqlRecordType to BeamSqlRowType > -- > > Key: BEAM-2621 > URL: https://issues.apache.org/jira/browse/BEAM-2621 > Project: Beam > Issue Type: Bug > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Labels: dsl_sql_merge > Fix For: 2.2.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2355) support comparison operator
[ https://issues.apache.org/jira/browse/BEAM-2355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2355. Resolution: Fixed Fix Version/s: 2.2.0 > support comparison operator > --- > > Key: BEAM-2355 > URL: https://issues.apache.org/jira/browse/BEAM-2355 > Project: Beam > Issue Type: New Feature > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Fix For: 2.2.0 > > > https://calcite.apache.org/docs/reference.html#comparison-operators -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2565) Add integration test for CASE operators
[ https://issues.apache.org/jira/browse/BEAM-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2565. Resolution: Fixed Fix Version/s: 2.2.0 > Add integration test for CASE operators > --- > > Key: BEAM-2565 > URL: https://issues.apache.org/jira/browse/BEAM-2565 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Labels: dsl_sql_merge > Fix For: 2.2.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2561) Add integration test for date functions
[ https://issues.apache.org/jira/browse/BEAM-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2561. Resolution: Fixed Fix Version/s: 2.2.0 > Add integration test for date functions > --- > > Key: BEAM-2561 > URL: https://issues.apache.org/jira/browse/BEAM-2561 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Labels: dsl_sql_merge > Fix For: 2.2.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2562) Add integration test for logical operators
[ https://issues.apache.org/jira/browse/BEAM-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2562. Resolution: Fixed Fix Version/s: 2.2.0 > Add integration test for logical operators > -- > > Key: BEAM-2562 > URL: https://issues.apache.org/jira/browse/BEAM-2562 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: James Xu >Assignee: Xu Mingmin > Labels: dsl_sql_merge > Fix For: 2.2.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-995) Apache Pig DSL
[ https://issues.apache.org/jira/browse/BEAM-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089758#comment-16089758 ] James Xu commented on BEAM-995: --- can we reuse the parser, but use different interpreter? One is pig itself, the other is pig-on-beam. This is the appoarch beamsql is taking. > Apache Pig DSL > -- > > Key: BEAM-995 > URL: https://issues.apache.org/jira/browse/BEAM-995 > Project: Beam > Issue Type: New Feature > Components: sdk-ideas >Reporter: Jean-Baptiste Onofré >Assignee: Jean-Baptiste Onofré > > Apache Pig is still popular and the language is not so large. > Providing a DSL using the Pig language would potentially allow more people to > use Beam (at least during a transition period). -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2560) Add integration test for arithmetic operators
[ https://issues.apache.org/jira/browse/BEAM-2560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2560. Resolution: Fixed Fix Version/s: 2.2.0 > Add integration test for arithmetic operators > - > > Key: BEAM-2560 > URL: https://issues.apache.org/jira/browse/BEAM-2560 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Labels: dsl_sql_merge > Fix For: 2.2.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2565) Add integration test for CASE operators
[ https://issues.apache.org/jira/browse/BEAM-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2565: -- Assignee: James Xu > Add integration test for CASE operators > --- > > Key: BEAM-2565 > URL: https://issues.apache.org/jira/browse/BEAM-2565 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Labels: dsl_sql_merge > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (BEAM-2621) rename BeamSqlRecordType to BeamSqlRowType
James Xu created BEAM-2621: -- Summary: rename BeamSqlRecordType to BeamSqlRowType Key: BEAM-2621 URL: https://issues.apache.org/jira/browse/BEAM-2621 Project: Beam Issue Type: Bug Components: dsl-sql Reporter: James Xu Assignee: James Xu -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (BEAM-2565) Add integration test for CASE operators
[ https://issues.apache.org/jira/browse/BEAM-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu updated BEAM-2565: --- Summary: Add integration test for CASE operators (was: Add integration test for OTHER operators) > Add integration test for CASE operators > --- > > Key: BEAM-2565 > URL: https://issues.apache.org/jira/browse/BEAM-2565 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: James Xu > Labels: dsl_sql_merge > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (BEAM-2613) Add integration test for comparison operators
James Xu created BEAM-2613: -- Summary: Add integration test for comparison operators Key: BEAM-2613 URL: https://issues.apache.org/jira/browse/BEAM-2613 Project: Beam Issue Type: Sub-task Components: dsl-sql Reporter: James Xu Assignee: James Xu -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2564) Add integration test for string operators
[ https://issues.apache.org/jira/browse/BEAM-2564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2564. Resolution: Fixed Fix Version/s: Not applicable > Add integration test for string operators > - > > Key: BEAM-2564 > URL: https://issues.apache.org/jira/browse/BEAM-2564 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Labels: dsl_sql_merge > Fix For: Not applicable > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-995) Apache Pig DSL
[ https://issues.apache.org/jira/browse/BEAM-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083235#comment-16083235 ] James Xu commented on BEAM-995: --- I think the former is better, the execution engine for beam program is spark,storm etc, and it is also the approach beam sql is taking. > Apache Pig DSL > -- > > Key: BEAM-995 > URL: https://issues.apache.org/jira/browse/BEAM-995 > Project: Beam > Issue Type: New Feature > Components: sdk-ideas >Reporter: Jean-Baptiste Onofré >Assignee: Jean-Baptiste Onofré > > Apache Pig is still popular and the language is not so large. > Providing a DSL using the Pig language would potentially allow more people to > use Beam (at least during a transition period). -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2561) Add integration test for date functions
[ https://issues.apache.org/jira/browse/BEAM-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2561: -- Assignee: James Xu > Add integration test for date functions > --- > > Key: BEAM-2561 > URL: https://issues.apache.org/jira/browse/BEAM-2561 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Labels: dsl_sql_merge > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2564) Add integration test for string operators
[ https://issues.apache.org/jira/browse/BEAM-2564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2564: -- Assignee: James Xu > Add integration test for string operators > - > > Key: BEAM-2564 > URL: https://issues.apache.org/jira/browse/BEAM-2564 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Labels: dsl_sql_merge > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2203) Arithmetic operators: support DATETIME & DATETIME_INTERVAL
[ https://issues.apache.org/jira/browse/BEAM-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079805#comment-16079805 ] James Xu commented on BEAM-2203: I have assigned this one to you [~vectorijk] > Arithmetic operators: support DATETIME & DATETIME_INTERVAL > -- > > Key: BEAM-2203 > URL: https://issues.apache.org/jira/browse/BEAM-2203 > Project: Beam > Issue Type: New Feature > Components: dsl-sql >Reporter: James Xu >Assignee: Kai Jiang > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2203) Arithmetic operators: support DATETIME & DATETIME_INTERVAL
[ https://issues.apache.org/jira/browse/BEAM-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2203: -- Assignee: Kai Jiang > Arithmetic operators: support DATETIME & DATETIME_INTERVAL > -- > > Key: BEAM-2203 > URL: https://issues.apache.org/jira/browse/BEAM-2203 > Project: Beam > Issue Type: New Feature > Components: dsl-sql >Reporter: James Xu >Assignee: Kai Jiang > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (BEAM-2565) Add integration test for OTHER operators
James Xu created BEAM-2565: -- Summary: Add integration test for OTHER operators Key: BEAM-2565 URL: https://issues.apache.org/jira/browse/BEAM-2565 Project: Beam Issue Type: Sub-task Components: dsl-sql Reporter: James Xu -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (BEAM-2564) Add integration test for string operators
James Xu created BEAM-2564: -- Summary: Add integration test for string operators Key: BEAM-2564 URL: https://issues.apache.org/jira/browse/BEAM-2564 Project: Beam Issue Type: Sub-task Components: dsl-sql Reporter: James Xu -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (BEAM-2563) Add integration test for math operators
James Xu created BEAM-2563: -- Summary: Add integration test for math operators Key: BEAM-2563 URL: https://issues.apache.org/jira/browse/BEAM-2563 Project: Beam Issue Type: Sub-task Components: dsl-sql Reporter: James Xu -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (BEAM-2562) Add integration test for logical operators
James Xu created BEAM-2562: -- Summary: Add integration test for logical operators Key: BEAM-2562 URL: https://issues.apache.org/jira/browse/BEAM-2562 Project: Beam Issue Type: Sub-task Components: dsl-sql Reporter: James Xu -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2561) Add integration test for date functions
[ https://issues.apache.org/jira/browse/BEAM-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2561: -- Assignee: (was: Xu Mingmin) > Add integration test for date functions > --- > > Key: BEAM-2561 > URL: https://issues.apache.org/jira/browse/BEAM-2561 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: James Xu > Labels: dsl_sql_merge > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (BEAM-2561) Add integration test for date functions
James Xu created BEAM-2561: -- Summary: Add integration test for date functions Key: BEAM-2561 URL: https://issues.apache.org/jira/browse/BEAM-2561 Project: Beam Issue Type: Sub-task Components: dsl-sql Reporter: James Xu Assignee: Xu Mingmin -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (BEAM-2559) Add integration test for the sql functions
[ https://issues.apache.org/jira/browse/BEAM-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu updated BEAM-2559: --- Summary: Add integration test for the sql functions (was: Add test for the sql functions) > Add integration test for the sql functions > -- > > Key: BEAM-2559 > URL: https://issues.apache.org/jira/browse/BEAM-2559 > Project: Beam > Issue Type: Task > Components: dsl-sql >Reporter: James Xu > Labels: dsl_sql_merge > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (BEAM-2560) Add integration test for arithmetic operators
[ https://issues.apache.org/jira/browse/BEAM-2560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu updated BEAM-2560: --- Summary: Add integration test for arithmetic operators (was: Add test for arithmetic operators) > Add integration test for arithmetic operators > - > > Key: BEAM-2560 > URL: https://issues.apache.org/jira/browse/BEAM-2560 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Labels: dsl_sql_merge > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (BEAM-2560) Add test for arithmetic operators
James Xu created BEAM-2560: -- Summary: Add test for arithmetic operators Key: BEAM-2560 URL: https://issues.apache.org/jira/browse/BEAM-2560 Project: Beam Issue Type: Sub-task Components: dsl-sql Reporter: James Xu Assignee: James Xu -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2559) Add test for the sql functions
[ https://issues.apache.org/jira/browse/BEAM-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2559: -- Assignee: (was: Xu Mingmin) > Add test for the sql functions > -- > > Key: BEAM-2559 > URL: https://issues.apache.org/jira/browse/BEAM-2559 > Project: Beam > Issue Type: Task > Components: dsl-sql >Reporter: James Xu > Labels: dsl_sql_merge > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (BEAM-2559) Add test for the sql functions
James Xu created BEAM-2559: -- Summary: Add test for the sql functions Key: BEAM-2559 URL: https://issues.apache.org/jira/browse/BEAM-2559 Project: Beam Issue Type: Task Components: dsl-sql Reporter: James Xu Assignee: Xu Mingmin -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2550) test JOINs with DSL methods
[ https://issues.apache.org/jira/browse/BEAM-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075796#comment-16075796 ] James Xu commented on BEAM-2550: Since we already have tested JOINs in the `rel` package(for BeamJoinRel), I think we only have to do a happy test here, mainly to test the integration of JOIN with the DSL methods, but not have to enumerate every cases like bounded vs bounded, unbounded vs unbounded etc. > test JOINs with DSL methods > --- > > Key: BEAM-2550 > URL: https://issues.apache.org/jira/browse/BEAM-2550 > Project: Beam > Issue Type: Task > Components: dsl-sql >Reporter: Xu Mingmin >Assignee: James Xu > Labels: dsl_sql_merge > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2550) test JOINs with DSL methods
[ https://issues.apache.org/jira/browse/BEAM-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2550: -- Assignee: James Xu > test JOINs with DSL methods > --- > > Key: BEAM-2550 > URL: https://issues.apache.org/jira/browse/BEAM-2550 > Project: Beam > Issue Type: Task > Components: dsl-sql >Reporter: Xu Mingmin >Assignee: James Xu > Labels: dsl_sql_merge > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2193) JOIN: inner join, left join, right join, full outer join
[ https://issues.apache.org/jira/browse/BEAM-2193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2193. Resolution: Fixed Fix Version/s: Not applicable > JOIN: inner join, left join, right join, full outer join > > > Key: BEAM-2193 > URL: https://issues.apache.org/jira/browse/BEAM-2193 > Project: Beam > Issue Type: New Feature > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Labels: dsl_sql_merge > Fix For: Not applicable > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2214) support `JOIN` in explain
[
https://issues.apache.org/jira/browse/BEAM-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071233#comment-16071233
]
James Xu commented on BEAM-2214:
[~mingmxu] this can be closed now?
> support `JOIN` in explain
> -
>
> Key: BEAM-2214
> URL: https://issues.apache.org/jira/browse/BEAM-2214
> Project: Beam
> Issue Type: Sub-task
> Components: dsl-sql
>Reporter: Xu Mingmin
>Assignee: James Xu
>
> Support keyword {{JOIN}} to to replace node in explain,
> {code}
> LogicalJoin(condition=[=($0, $8)], joinType=[inner|left|right|full])
> {code}
> examples as below:
> {code}
> sql = "select * from ORDER_DETAILS join ORDER_FILTERED_DETAILS on
> ORDER_DETAILS.f_int = ORDER_FILTERED_DETAILS.f_int";
> sql = "select * from ORDER_DETAILS inner join ORDER_FILTERED_DETAILS on
> ORDER_DETAILS.f_int = ORDER_FILTERED_DETAILS.f_int";
> sql = "select * from ORDER_DETAILS left outer join ORDER_FILTERED_DETAILS on
> ORDER_DETAILS.f_int = ORDER_FILTERED_DETAILS.f_int";
> sql = "select * from ORDER_DETAILS right outer join ORDER_FILTERED_DETAILS on
> ORDER_DETAILS.f_int = ORDER_FILTERED_DETAILS.f_int";
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (BEAM-2215) Beam pipeline for bounded-bounded join
[ https://issues.apache.org/jira/browse/BEAM-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071234#comment-16071234 ] James Xu commented on BEAM-2215: [~mingmxu] this can be closed now? > Beam pipeline for bounded-bounded join > -- > > Key: BEAM-2215 > URL: https://issues.apache.org/jira/browse/BEAM-2215 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: Xu Mingmin > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2216) Beam pipeline for bounded-unbounded join
[ https://issues.apache.org/jira/browse/BEAM-2216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071235#comment-16071235 ] James Xu commented on BEAM-2216: [~mingmxu] this can be closed now? > Beam pipeline for bounded-unbounded join > > > Key: BEAM-2216 > URL: https://issues.apache.org/jira/browse/BEAM-2216 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: Xu Mingmin > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2217) Beam pipeline for unbounded-unbounded join
[ https://issues.apache.org/jira/browse/BEAM-2217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071231#comment-16071231 ] James Xu commented on BEAM-2217: [~mingmxu] this can be closed now? > Beam pipeline for unbounded-unbounded join > -- > > Key: BEAM-2217 > URL: https://issues.apache.org/jira/browse/BEAM-2217 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: Xu Mingmin > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (BEAM-2528) BeamSql: support create table
James Xu created BEAM-2528: -- Summary: BeamSql: support create table Key: BEAM-2528 URL: https://issues.apache.org/jira/browse/BEAM-2528 Project: Beam Issue Type: Sub-task Components: dsl-sql Reporter: James Xu Assignee: James Xu support create table. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2202) Support DDL
[ https://issues.apache.org/jira/browse/BEAM-2202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2202: -- Assignee: (was: James Xu) > Support DDL > --- > > Key: BEAM-2202 > URL: https://issues.apache.org/jira/browse/BEAM-2202 > Project: Beam > Issue Type: Task > Components: dsl-sql >Reporter: James Xu > > Mainly create table, drop table, alter table -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (BEAM-2202) Support DDL
[ https://issues.apache.org/jira/browse/BEAM-2202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu updated BEAM-2202: --- Issue Type: Task (was: New Feature) > Support DDL > --- > > Key: BEAM-2202 > URL: https://issues.apache.org/jira/browse/BEAM-2202 > Project: Beam > Issue Type: Task > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > > Mainly create table, drop table, alter table -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2378) extend join-library to support FULL OUTER JOIN
[ https://issues.apache.org/jira/browse/BEAM-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2378. Resolution: Fixed Fix Version/s: Not applicable > extend join-library to support FULL OUTER JOIN > -- > > Key: BEAM-2378 > URL: https://issues.apache.org/jira/browse/BEAM-2378 > Project: Beam > Issue Type: Bug > Components: sdk-java-extensions >Reporter: James Xu >Assignee: James Xu > Fix For: Not applicable > > > Currently INNER, LEFT OUTER, RIGHT OUTER are supported, would be nice to > support FULL OUTER JOIN. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2192) support DISTINCT select
[ https://issues.apache.org/jira/browse/BEAM-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2192. Resolution: Fixed Fix Version/s: Not applicable > support DISTINCT select > --- > > Key: BEAM-2192 > URL: https://issues.apache.org/jira/browse/BEAM-2192 > Project: Beam > Issue Type: New Feature > Components: dsl-sql >Reporter: James Xu >Assignee: Xu Mingmin > Labels: dsl_sql_merge > Fix For: Not applicable > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2356) support logical operators
[ https://issues.apache.org/jira/browse/BEAM-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2356. Resolution: Fixed Fix Version/s: Not applicable > support logical operators > - > > Key: BEAM-2356 > URL: https://issues.apache.org/jira/browse/BEAM-2356 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Fix For: Not applicable > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2191) Support Set opeators
[ https://issues.apache.org/jira/browse/BEAM-2191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2191. Resolution: Fixed Fix Version/s: Not applicable > Support Set opeators > > > Key: BEAM-2191 > URL: https://issues.apache.org/jira/browse/BEAM-2191 > Project: Beam > Issue Type: Task > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Fix For: Not applicable > > > support the set operators in query: > query UNION [ ALL | DISTINCT ] query > query EXCEPT [ ALL | DISTINCT ] query > query MINUS [ ALL | DISTINCT ] query > query INTERSECT [ ALL | DISTINCT ] query -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2325) Support Set Operator: INTERSECT, EXCEPT, UNION
[ https://issues.apache.org/jira/browse/BEAM-2325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2325. Resolution: Fixed Fix Version/s: Not applicable > Support Set Operator: INTERSECT, EXCEPT, UNION > -- > > Key: BEAM-2325 > URL: https://issues.apache.org/jira/browse/BEAM-2325 > Project: Beam > Issue Type: Sub-task > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Fix For: Not applicable > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (BEAM-2515) BeamSql: refactor the MockedBeamSqlTable and related tests
James Xu created BEAM-2515: -- Summary: BeamSql: refactor the MockedBeamSqlTable and related tests Key: BEAM-2515 URL: https://issues.apache.org/jira/browse/BEAM-2515 Project: Beam Issue Type: Bug Components: dsl-sql Reporter: James Xu Assignee: James Xu MockedBeamSqlTable is only for Bounded data sources, after another Unbounded mock added, some refactor will be needed. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BEAM-2247) support date/time functions
[ https://issues.apache.org/jira/browse/BEAM-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2247. Resolution: Fixed Fix Version/s: Not applicable > support date/time functions > --- > > Key: BEAM-2247 > URL: https://issues.apache.org/jira/browse/BEAM-2247 > Project: Beam > Issue Type: New Feature > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > Labels: dsl_sql_merge > Fix For: Not applicable > > > https://calcite.apache.org/docs/reference.html#datetime-functions -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2477) BeamAggregationRel should use Combine.perKey instead of GroupByKey
[ https://issues.apache.org/jira/browse/BEAM-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055380#comment-16055380 ] James Xu commented on BEAM-2477: [~lzljs3620320] can you provide more info about `Combine.perKey`'s performance is better than `GroupByKey`, e.g. some link? > BeamAggregationRel should use Combine.perKey instead of GroupByKey > -- > > Key: BEAM-2477 > URL: https://issues.apache.org/jira/browse/BEAM-2477 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Jingsong Lee >Assignee: Jingsong Lee > Labels: dsl_sql_merge > > Their semantics are the same, but the efficiency of implementation is quite > different, and at the runner level there is a lot of optimization for > `Combine.perKey`. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2202) Support DDL
[ https://issues.apache.org/jira/browse/BEAM-2202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16051467#comment-16051467 ] James Xu commented on BEAM-2202: I will start to work on this one. > Support DDL > --- > > Key: BEAM-2202 > URL: https://issues.apache.org/jira/browse/BEAM-2202 > Project: Beam > Issue Type: New Feature > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > > Mainly create table, drop table, alter table -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2202) Support DDL
[ https://issues.apache.org/jira/browse/BEAM-2202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2202: -- Assignee: James Xu > Support DDL > --- > > Key: BEAM-2202 > URL: https://issues.apache.org/jira/browse/BEAM-2202 > Project: Beam > Issue Type: New Feature > Components: dsl-sql >Reporter: James Xu >Assignee: James Xu > > Mainly create table, drop table, alter table -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2443) BeamSqlRecordType should migrate to using a builder pattern via AutoValue/AutoBuilder
[ https://issues.apache.org/jira/browse/BEAM-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2443: -- Assignee: James Xu (was: Xu Mingmin) > BeamSqlRecordType should migrate to using a builder pattern via > AutoValue/AutoBuilder > - > > Key: BEAM-2443 > URL: https://issues.apache.org/jira/browse/BEAM-2443 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Luke Cwik >Assignee: James Xu >Priority: Minor > Labels: dsl_sql_merge > > This is a code health and usability issue. Performing the migration now to > use AutoValue/AutoBuilder will make it easier for people to create table row > types without needing to worry about mutability. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2443) BeamSqlRecordType should migrate to using a builder pattern via AutoValue/AutoBuilder
[ https://issues.apache.org/jira/browse/BEAM-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049941#comment-16049941 ] James Xu commented on BEAM-2443: I will take this one. > BeamSqlRecordType should migrate to using a builder pattern via > AutoValue/AutoBuilder > - > > Key: BEAM-2443 > URL: https://issues.apache.org/jira/browse/BEAM-2443 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Luke Cwik >Assignee: James Xu >Priority: Minor > Labels: dsl_sql_merge > > This is a code health and usability issue. Performing the migration now to > use AutoValue/AutoBuilder will make it easier for people to create table row > types without needing to worry about mutability. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2444) DSL SQL: Use standard java exceptions instead of custom ones
[
https://issues.apache.org/jira/browse/BEAM-2444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
James Xu reassigned BEAM-2444:
--
Assignee: James Xu (was: Xu Mingmin)
> DSL SQL: Use standard java exceptions instead of custom ones
>
>
> Key: BEAM-2444
> URL: https://issues.apache.org/jira/browse/BEAM-2444
> Project: Beam
> Issue Type: Improvement
> Components: dsl-sql
>Reporter: Luke Cwik
>Assignee: James Xu
>Priority: Minor
> Labels: dsl_sql_merge
>
> Remove the Beam SQL exception type and use the standard Java one with the
> same purpose.
> Beam SQL exception types:
> {code}
> org.apache.beam.dsls.sql.exception.BeamSqlUnsupportedException
> org.apache.beam.dsls.sql.schema.UnsupportedDataTypeException
> org.apache.beam.dsls.sql.exception.InvalidFieldException
> org.apache.beam.dsls.sql.exception.BeamInvalidOperatorException
> {code}
> Suggested alternatives depending on the context of where/why exception is
> being thrown:
> {code}
> java.lang.UnsupportedOperationException
> java.lang.IllegalArgumentException
> java.lang.IllegalStateException
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (BEAM-2444) DSL SQL: Use standard java exceptions instead of custom ones
[
https://issues.apache.org/jira/browse/BEAM-2444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049929#comment-16049929
]
James Xu commented on BEAM-2444:
I will take this one.
> DSL SQL: Use standard java exceptions instead of custom ones
>
>
> Key: BEAM-2444
> URL: https://issues.apache.org/jira/browse/BEAM-2444
> Project: Beam
> Issue Type: Improvement
> Components: dsl-sql
>Reporter: Luke Cwik
>Assignee: Xu Mingmin
>Priority: Minor
> Labels: dsl_sql_merge
>
> Remove the Beam SQL exception type and use the standard Java one with the
> same purpose.
> Beam SQL exception types:
> {code}
> org.apache.beam.dsls.sql.exception.BeamSqlUnsupportedException
> org.apache.beam.dsls.sql.schema.UnsupportedDataTypeException
> org.apache.beam.dsls.sql.exception.InvalidFieldException
> org.apache.beam.dsls.sql.exception.BeamInvalidOperatorException
> {code}
> Suggested alternatives depending on the context of where/why exception is
> being thrown:
> {code}
> java.lang.UnsupportedOperationException
> java.lang.IllegalArgumentException
> java.lang.IllegalStateException
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Assigned] (BEAM-2440) DSL SQL: Reduce visibility to simplify backwards compatibility
[ https://issues.apache.org/jira/browse/BEAM-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2440: -- Assignee: James Xu (was: Xu Mingmin) > DSL SQL: Reduce visibility to simplify backwards compatibility > -- > > Key: BEAM-2440 > URL: https://issues.apache.org/jira/browse/BEAM-2440 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Luke Cwik >Assignee: James Xu > Labels: dsl_sql_merge > > The package namespace should be flattened into one java package and > everything made package private except for the public classes like BeamSql, > BeamSqlCli, BeamSqlRow, BeamSqlRowCoder, ... > This will simplify the backwards compatibility story after merging since it > reduces the visible surface that users can interact with. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2440) DSL SQL: Reduce visibility to simplify backwards compatibility
[ https://issues.apache.org/jira/browse/BEAM-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049918#comment-16049918 ] James Xu commented on BEAM-2440: I will take this one. > DSL SQL: Reduce visibility to simplify backwards compatibility > -- > > Key: BEAM-2440 > URL: https://issues.apache.org/jira/browse/BEAM-2440 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Luke Cwik >Assignee: James Xu > Labels: dsl_sql_merge > > The package namespace should be flattened into one java package and > everything made package private except for the public classes like BeamSql, > BeamSqlCli, BeamSqlRow, BeamSqlRowCoder, ... > This will simplify the backwards compatibility story after merging since it > reduces the visible surface that users can interact with. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2442) DSL SQL: Public classes/methods should not expose/use calcite types
[ https://issues.apache.org/jira/browse/BEAM-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048657#comment-16048657 ] James Xu commented on BEAM-2442: I'd like to take this one. > DSL SQL: Public classes/methods should not expose/use calcite types > --- > > Key: BEAM-2442 > URL: https://issues.apache.org/jira/browse/BEAM-2442 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Luke Cwik >Assignee: Xu Mingmin > Labels: dsl_sql_merge > > Calcite is an internal implementation detail of how Beam SQL is operating. To > prevent a hard dependence on Calcite, public methods and classes should not > rely on consuming/producing Calcite types. > For example, BeamSqlRecordType uses org.apache.calcite.sql.type.SqlTypeName > instead of using the Java SQL types > (https://docs.oracle.com/javase/8/docs/api/java/sql/Types.html). > This task is to create an ApiSurfaceTest to help find, fix, and prevent > org.apache.calcite.* from being exposed. Example ApiSurfaceTest: > https://github.com/apache/beam/blob/367fcb28d544934797d25cb34d54136b2d7d6e99/sdks/java/core/src/test/java/org/apache/beam/SdkCoreApiSurfaceTest.java -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BEAM-2442) DSL SQL: Public classes/methods should not expose/use calcite types
[ https://issues.apache.org/jira/browse/BEAM-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2442: -- Assignee: James Xu (was: Xu Mingmin) > DSL SQL: Public classes/methods should not expose/use calcite types > --- > > Key: BEAM-2442 > URL: https://issues.apache.org/jira/browse/BEAM-2442 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Luke Cwik >Assignee: James Xu > Labels: dsl_sql_merge > > Calcite is an internal implementation detail of how Beam SQL is operating. To > prevent a hard dependence on Calcite, public methods and classes should not > rely on consuming/producing Calcite types. > For example, BeamSqlRecordType uses org.apache.calcite.sql.type.SqlTypeName > instead of using the Java SQL types > (https://docs.oracle.com/javase/8/docs/api/java/sql/Types.html). > This task is to create an ApiSurfaceTest to help find, fix, and prevent > org.apache.calcite.* from being exposed. Example ApiSurfaceTest: > https://github.com/apache/beam/blob/367fcb28d544934797d25cb34d54136b2d7d6e99/sdks/java/core/src/test/java/org/apache/beam/SdkCoreApiSurfaceTest.java -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Closed] (BEAM-2375) upgrade beam-version to 2.0.0
[ https://issues.apache.org/jira/browse/BEAM-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu closed BEAM-2375. -- Resolution: Fixed Fix Version/s: 2.1.0 > upgrade beam-version to 2.0.0 > - > > Key: BEAM-2375 > URL: https://issues.apache.org/jira/browse/BEAM-2375 > Project: Beam > Issue Type: Bug > Components: dsl-sql >Reporter: James Xu >Assignee: Jean-Baptiste Onofré > Fix For: 2.1.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Closed] (BEAM-2196) support UDF
[ https://issues.apache.org/jira/browse/BEAM-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu closed BEAM-2196. -- Resolution: Fixed Fix Version/s: 2.1.0 > support UDF > --- > > Key: BEAM-2196 > URL: https://issues.apache.org/jira/browse/BEAM-2196 > Project: Beam > Issue Type: New Feature > Components: dsl-sql >Reporter: James Xu >Assignee: Xu Mingmin > Fix For: 2.1.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (BEAM-2194) JOIN: cross join
[ https://issues.apache.org/jira/browse/BEAM-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu updated BEAM-2194: --- Summary: JOIN: cross join (was: JOIN: cross join, full outer join) > JOIN: cross join > > > Key: BEAM-2194 > URL: https://issues.apache.org/jira/browse/BEAM-2194 > Project: Beam > Issue Type: New Feature > Components: dsl-sql >Reporter: James Xu >Assignee: Xu Mingmin > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BEAM-2194) JOIN: cross join, full outer join
[ https://issues.apache.org/jira/browse/BEAM-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16030928#comment-16030928 ] James Xu commented on BEAM-2194: merge full outer join to BEAM-2193, but still keep cross join in this issue. > JOIN: cross join, full outer join > - > > Key: BEAM-2194 > URL: https://issues.apache.org/jira/browse/BEAM-2194 > Project: Beam > Issue Type: New Feature > Components: dsl-sql >Reporter: James Xu >Assignee: Xu Mingmin > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BEAM-2193) JOIN: inner join, left join, right join, cross join, full outer join
[ https://issues.apache.org/jira/browse/BEAM-2193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16030922#comment-16030922 ] James Xu commented on BEAM-2193: Remove cross join from this issue, since it requires totally different implementation. > JOIN: inner join, left join, right join, cross join, full outer join > > > Key: BEAM-2193 > URL: https://issues.apache.org/jira/browse/BEAM-2193 > Project: Beam > Issue Type: New Feature > Components: dsl-sql >Reporter: James Xu > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (BEAM-2193) JOIN: inner join, left join, right join, full outer join
[ https://issues.apache.org/jira/browse/BEAM-2193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu updated BEAM-2193: --- Summary: JOIN: inner join, left join, right join, full outer join (was: JOIN: inner join, left join, right join, cross join, full outer join) > JOIN: inner join, left join, right join, full outer join > > > Key: BEAM-2193 > URL: https://issues.apache.org/jira/browse/BEAM-2193 > Project: Beam > Issue Type: New Feature > Components: dsl-sql >Reporter: James Xu > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BEAM-2378) extend join-library to support FULL OUTER JOIN
[ https://issues.apache.org/jira/browse/BEAM-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16028432#comment-16028432 ] James Xu commented on BEAM-2378: [~davor] if it is a reasonable, I will submit a PR for it. > extend join-library to support FULL OUTER JOIN > -- > > Key: BEAM-2378 > URL: https://issues.apache.org/jira/browse/BEAM-2378 > Project: Beam > Issue Type: Bug > Components: sdk-java-extensions >Reporter: James Xu > > Currently INNER, LEFT OUTER, RIGHT OUTER are supported, would be nice to > support FULL OUTER JOIN. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (BEAM-2378) extend join-library to support FULL OUTER JOIN
James Xu created BEAM-2378: -- Summary: extend join-library to support FULL OUTER JOIN Key: BEAM-2378 URL: https://issues.apache.org/jira/browse/BEAM-2378 Project: Beam Issue Type: Bug Components: sdk-java-extensions Reporter: James Xu Assignee: Davor Bonaci Currently INNER, LEFT OUTER, RIGHT OUTER are supported, would be nice to support FULL OUTER JOIN. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Assigned] (BEAM-2378) extend join-library to support FULL OUTER JOIN
[ https://issues.apache.org/jira/browse/BEAM-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2378: -- Assignee: (was: Davor Bonaci) > extend join-library to support FULL OUTER JOIN > -- > > Key: BEAM-2378 > URL: https://issues.apache.org/jira/browse/BEAM-2378 > Project: Beam > Issue Type: Bug > Components: sdk-java-extensions >Reporter: James Xu > > Currently INNER, LEFT OUTER, RIGHT OUTER are supported, would be nice to > support FULL OUTER JOIN. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
