[
https://issues.apache.org/jira/browse/SAMZA-390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314307#comment-14314307
]
Milinda Lakmal Pathirage commented on SAMZA-390:
------------------------------------------------
I tried disabling validation in Calcite, but query preparation didn't work
without the output from parser going through the validator. So, we need to
clarify the possibility of disabling/relaxing validation in Calcite with
[~julianhyde]. IMO, we shouldn't skip all validations. I think we need to
validate the structure of the query to check whether the query is executable,
but not access to the fields. But I'm not sure whether this is possible with
current Calcite implementation.
There is a simple TableFactory implementation in the latest patch that I have
attached to SAMZA-483. I used Avro schema like syntax (string and int types in
that implementation) in a Calcite JSON model to define the stream's type. And
Calcite has support for SQL arrays, maps, sets, records, objects and some
notion of JavaRecord, so I believe that we can implement support for Avro
schemas (at least partial support).
[~nickpan47], I found two schema registries which support Avro.
- https://github.com/schema-repo/schema-repo
- https://github.com/linkedin/camus/tree/master/camus-schema-registry-avro
But I am not sure to which one you referred to in above comment. Can you please
let me know where I can find more information about Avro schema registry. I can
try to implement a Calcite SchemaFactory based on Avro schema registry.
> High-Level Language for Samza
> -----------------------------
>
> Key: SAMZA-390
> URL: https://issues.apache.org/jira/browse/SAMZA-390
> Project: Samza
> Issue Type: New Feature
> Components: sql
> Reporter: Raul Castro Fernandez
> Priority: Minor
> Labels: project
> Attachments: StreamSQLforSAMZA-v0.1.docx.docx
>
>
> Discussion about high-level languages to define Samza queries. Queries are
> defined in this language and transformed to a dataflow graph where the nodes
> are Samza jobs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
