[jira] [Created] (GRIFFIN-370) The regular expression of Profiling cannot be submit to service correctly through UI
Hou YunQing created GRIFFIN-370: --- Summary: The regular expression of Profiling cannot be submit to service correctly through UI Key: GRIFFIN-370 URL: https://issues.apache.org/jira/browse/GRIFFIN-370 Project: Griffin Issue Type: Bug Components: Frontend Module Affects Versions: 0.6.0 Environment: Ubuntu 18 Reporter: Hou YunQing Attachments: 微信截图_20220119140503.png Dear developers: I'm sorry that my English level is not very good, maybe this letter does not conform to English writing habits. I am writing this message to you because maybe I found a frontend bug of griffin. The version of griffin I am using is 0.6.0.Here are the phenomenon. When I trying to create new profiling which including a "Regular Expression Detection Count",I typed my regular expression(^(10|[1-9])$) and submit it successful. Then I checked the rule just submitted but the regular expression was changed to '^[0-9]{4}$',the full expression is as shown bottom,obviously not my wish. [ \{ "id": 560, "rule": "count(source.desc) AS `desc_regexcount` WHERE source.desc RLIKE '^[0-9]{4}$'", "dsl.type": "griffin-dsl", "dq.type": "PROFILING", "out.dataframe.name": "desc_regexcount" }, \{ "id": 561, "rule": "count(source.age) AS `age_nullcount` WHERE source.age IS NULL", "dsl.type": "griffin-dsl", "dq.type": "PROFILING", "out.dataframe.name": "age_nullcount" }, \{ "id": 562, "rule": "approx_count_distinct(source.id) AS `id_distcount`", "dsl.type": "griffin-dsl", "dq.type": "PROFILING" } ] I read the code of frontend module and hold the opinion that it is a frontend bug. In the file [https://github.com/apache/griffin/blob/master/ui/angular/src/app/measure/create-measure/pr/pr.component.ts] at line 312,the regulation expression is written to a "constant" not the one I typed. Thank you for your attention. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Work logged] (GRIFFIN-369) Bug fix for avro format in data connector
[ https://issues.apache.org/jira/browse/GRIFFIN-369?focusedWorklogId=710482=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-710482 ] ASF GitHub Bot logged work on GRIFFIN-369: -- Author: ASF GitHub Bot Created on: 18/Jan/22 12:58 Start Date: 18/Jan/22 12:58 Worklog Time Spent: 10m Work Description: lipzhu opened a new pull request #598: URL: https://github.com/apache/griffin/pull/598 **What changes were proposed in this pull request?** Built in Avro format is released in Spark 2.4.0,https://issues.apache.org/jira/browse/SPARK-24768 For Griffin, we still need to convert the Avro to com.databricks.spark.avro in Spark 2.3.x environment. **Does this PR introduce any user-facing change?** No. **How was this patch tested?** Unit Tests -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 710482) Remaining Estimate: 0h Time Spent: 10m > Bug fix for avro format in data connector > - > > Key: GRIFFIN-369 > URL: https://issues.apache.org/jira/browse/GRIFFIN-369 > Project: Griffin > Issue Type: Bug >Reporter: Zhu, Lipeng >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > built-in AVRO data source implementation is released in spark 2.4.0. > In spark 2.3.x, we need to use > com.databricks.spark.avro. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [griffin] lipzhu opened a new pull request #598: [GRIFFIN-369] Bug fix for avro format in Spark 2.3.x environment
lipzhu opened a new pull request #598: URL: https://github.com/apache/griffin/pull/598 **What changes were proposed in this pull request?** Built in Avro format is released in Spark 2.4.0,https://issues.apache.org/jira/browse/SPARK-24768 For Griffin, we still need to convert the Avro to com.databricks.spark.avro in Spark 2.3.x environment. **Does this PR introduce any user-facing change?** No. **How was this patch tested?** Unit Tests -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (GRIFFIN-369) Bug fix for avro format in data connector
Zhu, Lipeng created GRIFFIN-369: --- Summary: Bug fix for avro format in data connector Key: GRIFFIN-369 URL: https://issues.apache.org/jira/browse/GRIFFIN-369 Project: Griffin Issue Type: Bug Reporter: Zhu, Lipeng built-in AVRO data source implementation is released in spark 2.4.0. In spark 2.3.x, we need to use com.databricks.spark.avro. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (GRIFFIN-368) Upgrade ui module to support building with Apple M1 machine.
He Wang created GRIFFIN-368: --- Summary: Upgrade ui module to support building with Apple M1 machine. Key: GRIFFIN-368 URL: https://issues.apache.org/jira/browse/GRIFFIN-368 Project: Griffin Issue Type: Improvement Components: Frontend Module Reporter: He Wang The components in ui module is out of date, we need to upgrade them to support building the project with Apple M1 machine. AFAIK node.js support Apple silicon from `v16.0.0`, and npm and angular may also need to be upgraded. -- This message was sent by Atlassian Jira (v8.20.1#820001)