[GitHub] shaofengshi commented on issue #23: Kylin es
shaofengshi commented on issue #23: Kylin es URL: https://github.com/apache/kylin/pull/23#issuecomment-403275910 This PR has been out of date. And it didn't introduce how it be designed, implemented and how to compare with other storage engine like HBase. Close it now. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] shaofengshi closed pull request #159: KYLIN-3403 filter code system add one type of Date
shaofengshi closed pull request #159: KYLIN-3403 filter code system add one
type of Date
URL: https://github.com/apache/kylin/pull/159
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):
diff --git
a/core-metadata/src/main/java/org/apache/kylin/metadata/filter/FilterCodeSystemFactory.java
b/core-metadata/src/main/java/org/apache/kylin/metadata/filter/FilterCodeSystemFactory.java
index bae8cf94e2..8ac36b1216 100644
---
a/core-metadata/src/main/java/org/apache/kylin/metadata/filter/FilterCodeSystemFactory.java
+++
b/core-metadata/src/main/java/org/apache/kylin/metadata/filter/FilterCodeSystemFactory.java
@@ -22,18 +22,23 @@
import java.util.HashMap;
import org.apache.kylin.common.util.BytesUtil;
+import org.apache.kylin.common.util.DateFormat;
import org.apache.kylin.metadata.datatype.DataType;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
/**
* Created by donald.zheng on 2016/12/19.
*/
public class FilterCodeSystemFactory {
+private static final Logger logger =
LoggerFactory.getLogger(FilterCodeSystemFactory.class);
private final static HashMap codeSystemMap =
new HashMap<>();
static {
codeSystemMap.put("string", StringCodeSystem.INSTANCE);
codeSystemMap.put("integer", new IntegerCodeSystem());
codeSystemMap.put("decimal", new DecimalCodeSystem());
+codeSystemMap.put("date", new DateTimeCodeSystem());
}
public static IFilterCodeSystem getFilterCodeSystem(DataType dataType) {
@@ -41,6 +46,8 @@ public static IFilterCodeSystem getFilterCodeSystem(DataType
dataType) {
return codeSystemMap.get("integer");
} else if (dataType.isNumberFamily()) {
return codeSystemMap.get("decimal");
+} else if (dataType.isDateTimeFamily()) {
+return codeSystemMap.get("date");
} else {
return codeSystemMap.get("string");
}
@@ -95,4 +102,33 @@ public int compare(Object o, Object t1) {
}
}
+private static class DateTimeCodeSystem implements
IFilterCodeSystem {
+
+@Override
+public boolean isNull(String code) {
+return code == null;
+}
+
+@Override
+public void serialize(String code, ByteBuffer buf) {
+BytesUtil.writeUTFString(code, buf);
+}
+
+@Override
+public String deserialize(ByteBuffer buf) {
+return BytesUtil.readUTFString(buf);
+}
+
+@Override
+public int compare(String o1, String o2) {
+try {
+long d1 = DateFormat.stringToMillis(o1);
+long d2 = DateFormat.stringToMillis(o2);
+return Long.compare(d1, d2);
+} catch (IllegalArgumentException e) {
+logger.error("failed to convert string[{},{}] to date, use
string to compare.", o1, o2, e);
+return o1.compareTo(o2);
+}
+}
+}
}
diff --git a/kylin-it/src/test/resources/query/sql_datetime/query01.sql
b/kylin-it/src/test/resources/query/sql_datetime/query01.sql
new file mode 100644
index 00..b2f8b8059d
--- /dev/null
+++ b/kylin-it/src/test/resources/query/sql_datetime/query01.sql
@@ -0,0 +1,9 @@
+SELECT
+
+count(1) as TRANS_CNT
+
+FROM TEST_KYLIN_FACT as TEST_KYLIN_FACT
+INNER JOIN EDW.TEST_CAL_DT as TEST_CAL_DT
+ON TEST_KYLIN_FACT.CAL_DT = TEST_CAL_DT.CAL_DT
+
+WHERE TEST_CAL_DT.WEEK_BEG_DT > date'2001-09-09'
\ No newline at end of file
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[GitHub] shaofengshi commented on issue #159: KYLIN-3403 filter code system add one type of Date
shaofengshi commented on issue #159: KYLIN-3403 filter code system add one type of Date URL: https://github.com/apache/kylin/pull/159#issuecomment-403275852 Yifan has fixed this; The pr is not needed; This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] shaofengshi commented on issue #165: Batch sync commits
shaofengshi commented on issue #165: Batch sync commits URL: https://github.com/apache/kylin/pull/165#issuecomment-403274562 LGTM, except some commits for the same JIRA wasn't squashed; I manually merged them and pushed in master branch. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] shaofengshi closed pull request #165: Batch sync commits
shaofengshi closed pull request #165: Batch sync commits URL: https://github.com/apache/kylin/pull/165 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
Re: [Announce] Apache Kylin 2.3.2 released
Thanks, Kaisen. With Warm regards Billy Liu kangkaisen 于2018年7月8日周日 下午3:38写道： > > The Apache Kylin team is pleased to announce the immediate availability of > the 2.3.2 release. > > This is a bug fix release after 2.3.1, with 12 bug fixes and enhancements; > All of the changes in this release can be found in: > https://kylin.apache.org/docs23/release_notes.html > > You can download the source release and binary packages from Apache Kylin's > download page: https://kylin.apache.org/download/ > > Apache Kylin is an open source Distributed Analytics Engine designed to > provide SQL interface and multi-dimensional analysis (OLAP) on Apache Hadoop, > supporting extremely large datasets. > > Apache Kylin lets you query massive data set at sub-second latency in 3 steps: > 1. Identify a star schema or snowflake schema data set on Hadoop. > 2. Build Cube on Hadoop. > 3. Query data with ANSI-SQL and get results in sub-second, via ODBC, JDBC or > RESTful API. > > Thanks everyone who have contributed to the 2.3.2 release. > > We welcome your help and feedback. For more information on how to > report problems, and to get involved, visit the project website at > https://kylin.apache.org/ > > > -- > Best regards, > > Kaisen Kang 康凯森
[Announce] Apache Kylin 2.3.2 released
The Apache Kylin team is pleased to announce the immediate availability of the 2.3.2 release. This is a bug fix release after 2.3.1, with 12 bug fixes and enhancements; All of the changes in this release can be found in: https://kylin.apache.org/docs23/release_notes.html You can download the source release and binary packages from Apache Kylin's download page: https://kylin.apache.org/download/ Apache Kylin is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Apache Hadoop, supporting extremely large datasets. Apache Kylin lets you query massive data set at sub-second latency in 3 steps: 1. Identify a star schema or snowflake schema data set on Hadoop. 2. Build Cube on Hadoop. 3. Query data with ANSI-SQL and get results in sub-second, via ODBC, JDBC or RESTful API. Thanks everyone who have contributed to the 2.3.2 release. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kylin.apache.org/ -- Best regards, Kaisen Kang 康凯森
Re: Apache Kylin Chinese documents updated / Kylin 中文文档已更新
--- Regards! Aron Tao 在 2018/7/2 23:20，“ShaoFeng Shi” 写入: Hi Kylin users, The documents of Chinese version are updated for Kylin v2.4 and v2.3. More will be translated in the future. Latest version: https://kylin.apache.org/cn/docs/ v2.3: https://kylin.apache.org/cn/docs23/ Chrome is the recommended browser; You may need to clean the browser cache to get the new content. We welcome public contribution on documents as well, regarding how to write and contribute, please check: https://kylin.apache.org/development/howto_docs.html -- Best regards, Shaofeng Shi 史少锋
Re: kylin2.1 NoSuchMethodError: org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment.getRegion()
Thanks, hbase verison 1.3.1 is ok. -- Sent from: http://apache-kylin.74782.x6.nabble.com/
cube build intermediate table
When kylin build a cube, a hive intermediate wide table will be created firstly. Can I use a exist hive table as the kylin's intermediate table? I can build a wide table through ETL and it can be more efficiently. -- Sent from: http://apache-kylin.74782.x6.nabble.com/
