Re: SQL Client Limitations

2018-08-25 Thread Eron Wright
I'd like to better understand how catalogs will work in SQL Client.   I
assume we'll be able to reference catalog classes from the environment file
(e.g. FLINK-9172).

Thanks

On Tue, Aug 21, 2018 at 4:56 AM Fabian Hueske  wrote:

> Hi Dominik,
>
> The SQL Client supports the same subset of SQL that you get with Java /
> Scala embedded queries.
> The documentation [1] covers all supported operations.
>
> There are some limitations because certain operators require special time
> attributes (row time or processing time attributes) which are monotonically
> increasing.
> Some operators such as a regular join (in contrast to a time-windowed join)
> remove the monotonicity property of time attributes such that time-based
> operations cannot be applied anymore.
>
> Best,
> Fabian
>
> [1] https://ci.apache.org/projects/flink/flink-docs-
> release-1.6/dev/table/sql.html
>
>
>
> 2018-08-21 13:27 GMT+02:00 Till Rohrmann :
>
> > Hi Dominik,
> >
> > I think such a list would be really helpful. I've pulled Timo and Fabian
> > into this conversation because they probably know more.
> >
> > Cheers,
> > Till
> >
> > On Mon, Aug 20, 2018 at 12:43 PM Dominik Wosiński 
> > wrote:
> >
> >> Hey,
> >>
> >> Do we have any list of current limitations of SQL Client available
> >> somewhere or the only way is to go through JIRA issues?
> >>
> >> For example:
> >> I tried to make Group By Tumble Window and Inner Join in one query and
> it
> >> seems that it is not possible currently and I was wondering whether it's
> >> and issue with my query or known limitation.
> >>
> >> Thanks,
> >> Best Regards,
> >> Dominik.
> >>
> >
>


Added additional logo forms to apache-wide logo collection

2018-08-25 Thread Ted Dunning


I just added the black outline and white-filled versions of the Flink logo to 
the svn directory[1] for the Apache wide logo directory. I got these from the 
presumably official directory[2] on the web site. This means that there are now 
flink-[123].svg forms in that directory which should show up in Daniel's web 
directory [3] before long 

[1] https://svn.apache.org/repos/asf/comdev/project-logos/originals

[2] https://flink.apache.org/img/logo/svg/

[3] https://logos.humbedooh.com/



Flink tableApi/sql calendar

2018-08-25 Thread Sergey Nuyanzin
Hello,

I have just faced with a question: what calendar is used by Flink
tableAPI/sql?
For instance there was a TIMESTAMPADD related issue [1] with references to
MySql documentation. However there are some contradictions like:
from one side there is a testTimestampAdd[2] in Flink which expects
1017-11-29 after adding -1000 years. From the other side there is MySql
documentation about their calendar [3] and result of the same query
1017-12-05T22:58:58.998 vs expected by Flink's test 2017-11-29 22:58:58.998

Should it be treated as an issue or just another calendar usage (without
Gregorian cutover e.g.)?

[1] https://issues.apache.org/jira/browse/FLINK-6811
[2]

https://github.com/apache/flink/blob/505dca174128ebb3bf765778ee36d58f680d6a1e/flink-libraries/flink-table/src/test/scala/org/apache/flink/table/expressions/ScalarFunctionsTest.scala#L2166


[3] https://dev.mysql.com/doc/refman/5.5/en/mysql-calendar.html
Best regards,
Sergey


[jira] [Created] (FLINK-10217) use Slack for user support and questions

2018-08-25 Thread Nicos Maris (JIRA)
Nicos Maris created FLINK-10217:
---

 Summary: use Slack for user support and questions
 Key: FLINK-10217
 URL: https://issues.apache.org/jira/browse/FLINK-10217
 Project: Flink
  Issue Type: Task
  Components: Project Website
Reporter: Nicos Maris


h2. Current status

For user support and questions, users are instructed to subscribe to 
u...@flink.apache.org but there are users like me who enjoy using also a chat 
channel. However, the instructions to do so are not clear and the IRC activity 
is low and it is definitely [not indicative of the project's 
activity|https://issues.apache.org/jira/browse/FLINK-3862?focusedCommentId=16152376=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16152376].

The [website|https://flink.apache.org/community.html] mentions that "If you 
want to talk with the Flink committers and users in a chat, there is an [IRC 
channel|https://flink.apache.org/community.html#irc].;

h2. Option 1: Use Slack

An example of an Apache project that using 
[Slack|https://tedium.co/2017/10/17/irc-vs-slack-chat-history] is: 
http://mesos.apache.org/community

I can assist on setting it up if at least one expert joins from the very 
beginning.

h2. Option 2: Keep using IRC and document it

Add the [missing 
section|https://github.com/apache/flink-web/blob/master/community.md#irc] at 
the website along with instructions for people who have never used IRC.
h2. Option 3: Use only the mailing list

Use only u...@flink.apache.org for user support and questions and do not 
mention IRC at the website.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (FLINK-10216) Add REGEXP_MATCH in TableAPI and SQL

2018-08-25 Thread Juho Autio (JIRA)
Juho Autio created FLINK-10216:
--

 Summary: Add REGEXP_MATCH in TableAPI and SQL
 Key: FLINK-10216
 URL: https://issues.apache.org/jira/browse/FLINK-10216
 Project: Flink
  Issue Type: Sub-task
Reporter: Juho Autio


Here's a naive implementation:

{code:java}
public class RegexpMatchFunction extends ScalarFunction {
// NOTE! Flink calls eval() by reflection
public boolean eval(String value, String pattern) {
return value != null && pattern != null && value.matches(pattern);
}
}
{code}

I wonder if there would be a way to optimize this to use 
{{Pattern.compile(value)}} and use the compiled Pattern for multiple calls 
(possibly different values, but same pattern).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (FLINK-10215) Add configuration of java option for historyserver

2018-08-25 Thread liuxianjiao (JIRA)
liuxianjiao created FLINK-10215:
---

 Summary: Add configuration of java option  for historyserver 
 Key: FLINK-10215
 URL: https://issues.apache.org/jira/browse/FLINK-10215
 Project: Flink
  Issue Type: Improvement
  Components: History Server
Affects Versions: 1.6.0, 2.0.0
Reporter: liuxianjiao
 Fix For: 2.0.0


We hava configuation to set java option for taskmanger and jobmanager, but 
there is a lack of historyserver's configuration. So, I add a 
"env.java.opts.historyserver" ,which is just like "env.java.opts.jobmanager" 
and 

"env.java.opts.taskmanager".

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)