[GitHub] orc pull request #121: Check the result schema after column selection

2017-05-16 Thread dongjoon-hyun
Github user dongjoon-hyun closed the pull request at: https://github.com/apache/orc/pull/121 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] orc pull request #121: Check the result schema after column selection

2017-05-16 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/orc/pull/121 Check the result schema after column selection cc @omalley . You can merge this pull request into a Git repository by running: $ git pull https://github.com/dongjoon-hyun/orc

Re: [VOTE] Should we release ORC 1.4.0rc1?

2017-05-04 Thread Dongjoon Hyun
+1 (non-binding) I checked the followings with RC1. - checksum / signature - building and install with 1.4.0 correctly. - unit testing for Java module on Mac/JDK 1.8.0_131 - some integration tests with new `nohive` jar for both record/RowBatch reader Everything looks good to me. Thank

Re: [VOTE] Should we release ORC 1.3.4rc0?

2017-10-13 Thread Dongjoon Hyun
+1 Bests, Dongjoon. On 2017-10-12 16:14, "Owen O'Malley" wrote: > +1 > > I checked: > * gpg signature > * sha256 signature > * build on 7 linux variants and MacOS > * reviewed git log > > .. Owen > > On Thu, Oct 12, 2017 at 1:55 AM, Prasanth Jayachandran

Re: [VOTE] Should we release ORC 1.4.1rc0?

2017-10-12 Thread Dongjoon Hyun
+1 I tested the followings. - Shasum and GPG sign is verified. - All Java UTs passed: `mvn install` in `java` directory. - All Spark tests passed (including new fixes) Thank you so much! Bests, Dongjoon. On 2017-10-12 13:56, Prasanth Jayachandran wrote: > I did both

[GitHub] orc pull request #160: ORC-233 Allow `orc.include.columns` to be empty

2017-08-22 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/orc/pull/160#discussion_r134398544 --- Diff: java/mapreduce/src/test/org/apache/orc/mapreduce/TestMapreduceOrcOutputFormat.java --- @@ -153,11 +153,55 @@ public void testColumnSelection

[GitHub] orc issue #160: ORC-233 Allow `orc.include.columns` to be empty

2017-08-22 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/orc/pull/160 Hi, @omalley . Could you review this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] orc pull request #160: ORC-233 Allow `orc.include.columns` to be empty

2017-08-22 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/orc/pull/160#discussion_r134398860 --- Diff: java/mapreduce/src/test/org/apache/orc/mapreduce/TestMapreduceOrcOutputFormat.java --- @@ -153,11 +153,55 @@ public void testColumnSelection

[GitHub] orc pull request #160: ORC-233 Allow `orc.include.columns` to be empty

2017-08-22 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/orc/pull/160#discussion_r134398823 --- Diff: java/mapreduce/src/test/org/apache/orc/mapreduce/TestMapreduceOrcOutputFormat.java --- @@ -153,11 +153,55 @@ public void testColumnSelection

[GitHub] orc pull request #160: ORC-233 Allow `orc.include.columns` to be empty

2017-08-22 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/orc/pull/160#discussion_r134398776 --- Diff: java/mapreduce/src/test/org/apache/orc/mapreduce/TestMapreduceOrcOutputFormat.java --- @@ -153,11 +153,55 @@ public void testColumnSelection

[GitHub] orc pull request #160: ORC-233 Allow `orc.include.columns` to be empty

2017-08-22 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/orc/pull/160#discussion_r134399015 --- Diff: java/mapreduce/src/test/org/apache/orc/mapreduce/TestMapreduceOrcOutputFormat.java --- @@ -153,11 +153,55 @@ public void testColumnSelection

[GitHub] orc pull request #160: ORC-233 Allow `orc.include.columns` to be empty

2017-08-22 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/orc/pull/160#discussion_r134399046 --- Diff: java/mapreduce/src/test/org/apache/orc/mapreduce/TestMapreduceOrcOutputFormat.java --- @@ -153,11 +153,55 @@ public void testColumnSelection

[GitHub] orc pull request #160: ORC-233 Allow `orc.include.columns` to be empty

2017-08-21 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/orc/pull/160#discussion_r134293310 --- Diff: java/mapreduce/src/java/org/apache/orc/mapred/OrcInputFormat.java --- @@ -58,7 +58,7 @@ */ public static boolean[] parseInclude

Re: [DISCUSS] Making bug fix releases of 1.3 and 1.4

2017-10-11 Thread Dongjoon Hyun
It's a great news, especially 1.4.1! :) Bests, Dongjoon. On 2017-10-11 08:39, "Owen O'Malley" wrote: > All, >We've fixed some important bugs and I'd like to make a release of 1.3 > and 1.4. Does anyone have anything they'd like to include? > > .. Owen >

Re: [VOTE] Should we release ORC 1.4.1rc0?

2017-10-17 Thread Dongjoon Hyun
Ur, I checked Maven central today and found that ORC 1.4.1 seems to bring unexpected dependency accidentally. This is not a feature issue. [INFO] +- io.airlift:aircompressor:jar:0.8:compile [INFO] | \- io.airlift:slice:jar:0.29:compile [INFO] | \- org.openjdk.jol:jol-core:jar:0.2:compile -

Re: [VOTE] Should we release ORC 1.4.1rc0?

2017-10-18 Thread Dongjoon Hyun
ansitive dependency. > > .. Owen > > On Tue, Oct 17, 2017 at 11:25 AM, Dongjoon Hyun <dongj...@apache.org> wrote: > > > Ur, I checked Maven central today and found that ORC 1.4.1 seems to bring > > unexpected dependency accidentally. This is not a feature issue. > &

Apache Spark 2.3 and Apache ORC 1.4 finally

2017-12-05 Thread Dongjoon Hyun
Hi, All. Today, Apache Spark starts to use Apache ORC 1.4 as a `native` ORC implementation. SPARK-20728 Make OrcFileFormat configurable between `sql/hive` and `sql/core`. - https://github.com/apache/spark/commit/326f1d6728a7734c228d8bfaa69442a1c7b92e9b Thank you so much for all your supports

Re: Vectorized ORC Reader in Apache Spark 2.3 with Apache ORC 1.4.1.

2018-01-28 Thread Dongjoon Hyun
; Hi > > Thanks for this work. > > Will this affect both: > 1) spark.read.format("orc").load("...") > 2) spark.sql("select ... from my_orc_table_in_hive") > > ? > > > Le 10 janv. 2018 à 20:14, Dongjoon Hyun écrivait : > > Hi, All. > > > >

[GitHub] orc pull request #218: [ORC-301] `extractFileTail` should open a file in `tr...

2018-02-14 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/orc/pull/218 [ORC-301] `extractFileTail` should open a file in `try` statement This PR moves the file open position to prevent opened file leakage more robustly. You can merge this pull request into a Git

[GitHub] orc issue #218: ORC-301. `extractFileTail` should open a file in `try` state...

2018-02-14 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/orc/pull/218 Hi, @omalley . Could you review this PR? ---

[GitHub] orc pull request #218: ORC-301. `extractFileTail` should open a file in `try...

2018-02-14 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/orc/pull/218#discussion_r168372943 --- Diff: java/core/src/java/org/apache/orc/impl/ReaderImpl.java --- @@ -516,12 +516,13 @@ OrcTail buildEmptyTail() { protected OrcTail

[GitHub] orc pull request #218: ORC-301. `extractFileTail` should open a file in `try...

2018-02-14 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/orc/pull/218#discussion_r168372882 --- Diff: java/core/src/java/org/apache/orc/impl/ReaderImpl.java --- @@ -516,12 +516,13 @@ OrcTail buildEmptyTail() { protected OrcTail

[GitHub] orc issue #218: ORC-301. `extractFileTail` should open a file in `try` state...

2018-02-15 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/orc/pull/218 Thank you for merging, @prasanthj ! ---

[GitHub] orc issue #218: ORC-301. `extractFileTail` should open a file in `try` state...

2018-02-15 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/orc/pull/218 Thank you so much, @prasanthj ! ---

[GitHub] orc issue #316: Fix a table row ending markup

2018-10-05 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/orc/pull/316 Hi, @prasanthj . Could you review this PR when you have some time? ---

[GitHub] orc issue #316: Fix a table row ending markup

2018-10-05 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/orc/pull/316 Thank you, @prasanthj ! ---

[GitHub] orc issue #316: Fix a table row ending markup

2018-10-05 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/orc/pull/316 Oh, thank you for merging, @omalley ! ---

Re: Fixing the docker builds

2018-10-29 Thread Dongjoon Hyun
+1 for the removals and additions. Bests, Dongjoon. On Mon, Oct 29, 2018 at 11:20 AM Owen O'Malley wrote: > All, >We've let the docker build scripts decay badly. I'm fixing them, but > along the way, I'd like to update the set of supported Linux versions. In > particular, debian 7 "wheezy"

[GitHub] orc pull request #316: Fix a table row ending markup

2018-10-04 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/orc/pull/316 Fix a table row ending markup Currently, a table in ORC website is broken. This PR aims to fix it. - https://orc.apache.org/docs/hive-config.html **Before** ![before](https

Re: [DISCUSS] Releasing ORC-1.5.4

2018-12-17 Thread Dongjoon Hyun
+1 for releasing ORC-1.5.4. I've been waiting for ORC-416 and ORC-419, too. Thanks, Dongjoon. On Mon, Dec 17, 2018 at 10:12 AM Vaibhav Gumashta wrote: > Hi all, > > I’d like to get your thoughts on making a minor ORC release off branch-1.5 > (current released version is ORC-1.5.3). I’m

Re: [VOTE] Should we release ORC 1.5.4rc1?

2018-12-20 Thread Dongjoon Hyun
PM Eugene Koifman < > ekoif...@hortonworks.com> > wrote: > > > +1 > > > > Ran Java portion on Mac, ran ORC tests, built Hive (master) against > 1.5.4 > > and ran some Hive UTs > > > > > > Eugene >

Re: [VOTE] Should we release ORC 1.5.4rc1?

2018-12-18 Thread Dongjoon Hyun
+1 (non-binding) I checked building and Java unit testing on Mac. Also, I built Apache Spark master branch with this and checked that all Spark UT passed. Thank you! Bests, Dongjoon. On Tue, Dec 18, 2018 at 3:27 PM Owen O'Malley wrote: > +1 > > I checked: > > Signatures are correct > The

Re: [RESULT][VOTE] Shall we release ORC 1.5.6rc1?

2019-06-26 Thread Dongjoon Hyun
Hi, All. Sorry, but Apache ORC 1.5.6-rc1 seems to have a regression. Unlike Apache ORC 1.5.5, resource leakage are observed during Apache Spark sql module unit tests. I've been spending time to retest this to make it sure. Could you give me more time? Bests, Dongjoon. On Wed, Jun 26, 2019 at

Re: [RESULT][VOTE] Shall we release ORC 1.5.6rc1?

2019-06-26 Thread Dongjoon Hyun
make sure things didn't leak, but that > was the change that was sharing a file handle between the ReaderImpl and > the RecordReaderImpl so that we didn't end up with two NN operations when > reading a file. > > .. Owen > > On Wed, Jun 26, 2019 at 8:51 PM Dongjoon Hyun > wr

Re: [RESULT][VOTE] Shall we release ORC 1.5.6rc1?

2019-06-28 Thread Dongjoon Hyun
blem. I believe the 1.5.6rc1 is actually better for > most users than 1.5.5. > > On Wed, Jun 26, 2019 at 10:06 PM Dongjoon Hyun > wrote: > > > Thank you, Owen. > > > > Yes, I know that ORC-498 resolved the two NN operations issue and the > code > > is dir

Re: [VOTE] Should we release ORC 1.5.8rc0 and 1.6.2rc0?

2019-11-21 Thread Dongjoon Hyun
+1 for both. Thank you all. For both versions, I built and tested Java unit tests and ran with Apache Spark unit tests. (with JDK8 on Mac) For me, 1.6.2 is the first version in `1.6.x` line which passed the Apache Spark unit tests. Thanks! I've been waiting for this because of ZStandard support.

Re: [VOTE] Shall we release ORC 1.4.5rc1?

2019-12-06 Thread Dongjoon Hyun
+1 for Apache ORC 1.4.5 release. Thank you for making the release. I'd like to mention some notable changes here. Apache ORC 1.4.5 is not a drop-in replacement for 1.4.4 because of the following. ORC-498: ReaderImpl and RecordReaderImpl open separate file handles. Applications should be

Re: Rolling back ORC-546.

2019-10-21 Thread Dongjoon Hyun
+1 for rollback. Thanks, Dongjoon. On Mon, Oct 21, 2019 at 11:35 Owen O'Malley wrote: > All, >TimestampColumnVector is awkwardly defined with both the millis since > 1970 and nanos with in a second. Hive's use is such that it doesn't matter > if the millis have the last three digits set or

Re: [VOTE] Should we release ORC 1.5.7r2 and ORC 1.6.1rc2?

2019-10-25 Thread Dongjoon Hyun
>From https://issues.apache.org/jira/browse/ORC/versions/12345702 (1.5.7), shall we remove the following `Issue To Do`? https://issues.apache.org/jira/browse/ORC-541 Bests, Dongjoon. On Fri, Oct 25, 2019 at 12:48 PM Alan Gates wrote: > Ok, so it works, I just did it wrong, since I tried to

Re: [VOTE] Should we release ORC 1.5.7r2 and ORC 1.6.1rc2?

2019-10-25 Thread Dongjoon Hyun
oon. On Fri, Oct 25, 2019 at 1:46 PM Owen O'Malley wrote: > Thanks, Alan for checking the release. > > Dongjoon, thanks for the catch. I just removed the fixVersion from ORC-541. > > .. Owen > > On Fri, Oct 25, 2019 at 1:31 PM Dongjoon Hyun > wrote: > > > From h

Re: [VOTE] Should we release ORC-1.5.9rc0?

2020-01-26 Thread Dongjoon Hyun
Hi, All. ORC 1.5.9 seems to have some disruptive changes which breaks downstream. Unlike 1.5.8, the following Apache ORC changes cause a failure. "ORC-578: Addendum fixing up the stripe statistics" seems to remove `public` API. +++ b/java/core/src/java/org/apache/orc/impl/OrcTail.java

Re: [VOTE] Should we release ORC-1.5.9rc1?

2020-01-28 Thread Dongjoon Hyun
+1. 1. Checked Shasum and GPG signature 2. Tested building and testing unit tests with JDK8 and JDK11 on Mac. 3. Checked JDK11 readiness on new dependency `threeten-extra-1.5.0.jar` (228K) 4. Tested with Spark ORC tests with new `hive-storage-api` (2.7.1). Thank you, Owen. Bests, Dongjoon. On

Re: Release 1.5.9

2020-01-24 Thread Dongjoon Hyun
+1 for 1.5.9 release with them. Nothing from my side. Thanks, Dongjoon. On Fri, Jan 24, 2020 at 9:46 AM Owen O'Malley wrote: > I'd like to get a 1.5 release out with ORC-27 and ORC-578 on the Java side > and ORC-574 on the C++ side. Is there anything else we should get into a > new 1.5

Re: Autolink from GitHub PR and commit log to Apache ORC Jira issue

2020-03-12 Thread Dongjoon Hyun
is > feature. > I believe we should open an INFRA ticket for this? > > Cheers, > Panagiotis > > > On 11 Mar 2020, at 23:34, Dongjoon Hyun wrote: > > > > Hi, All. > > > > Shall we use GitHub autolink feature? > > > > https://github.blog/201

Autolink from GitHub PR and commit log to Apache ORC Jira issue

2020-03-11 Thread Dongjoon Hyun
Hi, All. Shall we use GitHub autolink feature? https://github.blog/2019-10-14-introducing-autolink-references/ It will recognizes `ORC-XXX` pattern (inside PR description and commit log) and automatically link to https://issues.apache.org/jira/browse/ORC-XXX It was very convenient in other

Re: New 1.6 release?

2020-03-30 Thread Dongjoon Hyun
>From my side, +1 for new release. Bests, Dongjoon. On Mon, Mar 30, 2020 at 9:59 AM Panos Garefalakis wrote: > Hey Owen, > > I believe ORC-616 is an important fix that should be included, also > ORC-611 is related to Timestamps and could be included. > > Cheers, > Panagiotis > > > On 30 Mar

Re: [VOTE] Shall we release ORC-1.6.3rc1?

2020-04-23 Thread Dongjoon Hyun
Hi, Owen. The artifacts for 1.6.3 RC1 are in the same situation. # gpg --verify orc-1.6.3rc1.tar.gz.asc gpg: assuming signed data in 'orc-1.6.3rc1.tar.gz' gpg: Signature made Thu Apr 23 17:12:02 2020 PDT gpg:using RSA key 75EBAAECF7A297FF22E8C18DD19EB09DAD1C5877 gpg: Can't check

Re: [VOTE] Shall we release ORC-1.5.10rc1?

2020-04-23 Thread Dongjoon Hyun
Hi, Owen. Could you check the GPG sign? I'm hitting GPG verification failure like the following. # gpg --verify orc-1.5.10rc1.tar.gz.asc gpg: assuming signed data in 'orc-1.5.10rc1.tar.gz' gpg: Signature made Thu Apr 23 17:12:16 2020 PDT gpg:using RSA key

Re: [VOTE] Shall we release ORC-1.5.10rc1?

2020-04-24 Thread Dongjoon Hyun
the same > master key (47660BC98BC433F01E5C90581209E7F13D0C92B9). > > Thanks, >Owen > > On Thu, Apr 23, 2020 at 8:49 PM Dongjoon Hyun > wrote: > > > Hi, Owen. > > > > Could you check the GPG sign? I'm hitting GPG verification failure like > the > >

Re: [VOTE] Shall we release ORC-1.5.10rc1?

2020-04-24 Thread Dongjoon Hyun
+1 1. Checked the checksum and signature. 2. Tested building and running Java unit tests with JDK8 and JDK11 on Mac. 3. Tested with Apache Spark Thank you, Owen. Bests, Dongjoon On Thu, Apr 23, 2020 at 5:15 PM Owen O'Malley wrote: > All, > > Should we release the following artifacts as ORC

Re: [VOTE] Shall we release ORC-1.6.3rc1?

2020-04-24 Thread Dongjoon Hyun
Hi, All. +1 for 1.6.3 RC1. BTW, although this is not a regression, Apache ORC 1.6.0 ~ 1.6.3rc1 doesn't work with all Apache Hive (2.x/3.x/4.0.0-SNAPSHOT) releases due to the breaking change by ORC-520. ORC-520: Fix file merging for column encryption

New releases (1.5.11 / 1.6.4)

2020-08-21 Thread Dongjoon Hyun
Hi, All. The last Apache ORC releases were on April 26th. - https://orc.apache.org/news/2020/04/26/ORC-1.6.3 - https://orc.apache.org/news/2020/04/26/ORC-1.5.10 Can we have new maintenance releases (1.5.11 and 1.6.4) in September? I'd like to volunteer for the release manager of next

Re: [VOTE] Shall we release ORC 1.5.12rc0?

2020-09-29 Thread Dongjoon Hyun
+1 for Apache ORC 1.5.12-rc0. Thanks, Dongjoon. On Fri, Sep 25, 2020 at 2:52 PM Owen O'Malley wrote: > All, > > Should we release the following artifacts as ORC 1.5.12? > > tar: http://home.apache.org/~omalley/orc-1.5.12/ > tag: https://github.com/apache/orc/releases/tag/release-1.5.12rc0 >

Re: [VOTE] Should we release ORC-1.6.4rc1?

2020-09-29 Thread Dongjoon Hyun
gt; On Sun, Sep 20, 2020 at 4:32 AM Dongjoon Hyun > wrote: > >> Hi, Owen, Alan, Jesus and all. >> >> Sorry for being late, but it seems that 1.6.4 and 1.5.11 introduced a >> correctness regression in the following patch. >> >> ORC-644: Support positional

Re: [VOTE] Shall we release 1.6.5rc0?

2020-09-30 Thread Dongjoon Hyun
+1 for 1.6.5 RC0. Thanks, Dongjoon. On Wed, Sep 30, 2020 at 9:49 AM Alan Gates wrote: > +1. Checked signature and hash, checked to make sure all the source files > had the license and no binary files beyond images and type fonts were > included. Did a build in ubuntu 18 docker. > > Alan. > >

Re: [VOTE] Shall we release 1.6.5rc0?

2020-10-01 Thread Dongjoon Hyun
- https://github.com/apache/orc/pull/547 Bests, Dongjoon. On Wed, Sep 30, 2020 at 10:27 PM Dongjoon Hyun wrote: > +1 for 1.6.5 RC0. > > Thanks, > Dongjoon. > > On Wed, Sep 30, 2020 at 9:49 AM Alan Gates wrote: > >> +1. Checked signature and hash, checked

Re: [VOTE] Should we release ORC-1.6.4rc1?

2020-09-19 Thread Dongjoon Hyun
Hi, Owen, Alan, Jesus and all. Sorry for being late, but it seems that 1.6.4 and 1.5.11 introduced a correctness regression in the following patch. ORC-644: Support positional mapping for nested types. Although Apache ORC configuration, 'orc.force.positional.evolution', is false, positional

Re: [DISCUSS] Remove support for Debian 8 and Ubuntu 14

2020-10-23 Thread Dongjoon Hyun
+1 for the removal. Bests, Dongjoon. On Tue, Oct 20, 2020 at 9:38 AM Owen O'Malley wrote: > All, >In ORC-674 , I commented that > some of the recent changes in trunk have broken older versions of cmake. > Rather than figure out how to fix it, I

[DRAFT][REPORT] ORC Board report for November 2020

2020-10-26 Thread Dongjoon Hyun
Hi, All. It seems that we missed the ORC Board report. > The following reports were not received and are expected next month: >Report from the Apache ORC Project [Owen O'Malley] I made a draft for that except the `Community Health` section. Could you finalize and submit, Owen? ##

Re: Avro to ORC Conversion

2020-07-15 Thread Dongjoon Hyun
Hi Ryan. If you need to build from the scratch, you may want to see a standalone converter example in Apache ORC repository. - https://github.com/apache/orc/blob/master/java/tools/src/java/org/apache/orc/tools/convert/ConvertTool.java Although it doesn't support Avro, there are CsvReader

Use GitHub PR Template?

2020-08-01 Thread Dongjoon Hyun
Hi, All. I'd like to propose to use GitHub PR Template to help PR reviews in the Apache ORC community. https://github.com/apache/orc/pull/525/files#diff-08be8c154901f5e7701f12712f2fc966 GitHub PR Template has been helpful in other projects. What do you think about that? Bests, Dongjoon.

Re: [DISCUSS] Support for CentOS 6?

2020-06-23 Thread Dongjoon Hyun
+1 for dropping CentOS 6. Bests, Dongjoon. On Tue, Jun 23, 2020 at 8:55 AM Owen O'Malley wrote: > Hi all, >The master branch is currently broken on CentOS 6. (Some of the new C++ > work used some of the C++ 11 constructs that the old g++ didn't support. We > could fix it, but CentOS 6 is

Re: Avro to ORC Conversion

2020-07-16 Thread Dongjoon Hyun
It's good for you, Ryan, because there are many alternatives. FYI, Apache Spark 3.0.0 is using Apache Hive 2.3.7. And, everything is running in a local mode on the single container. > Would the entire thing run within the same container and then I leverage the Spark APIs from that in local mode?

Re: Avro to ORC Conversion

2020-07-16 Thread Dongjoon Hyun
hema); > > TypeDescription orcSchema = > > TypeDescription.fromString(orcInfo.getTypeName()); > > Writer orcWriter = OrcWriter.createWriter(orcSchema, > > driver.generateTmpPath()); > > > *Sample Data:* > struct > > On Wed, Jul 15, 2020 at 11:28 PM Dongjoon Hyu

Re: Disable `Create a merge commit` option from Apache ORC `GitHub` PR merge button

2021-01-11 Thread Dongjoon Hyun
Hi, All. This setting is applied. https://issues.apache.org/jira/browse/INFRA-21289 https://issues.apache.org/jira/browse/ORC-725 Thanks, Dongjoon. On Sun, Jan 10, 2021 at 4:15 PM Dongjoon Hyun wrote: > Thank you so much, Panos. > > Yes, exactly that's the intention. > >

Disable `Create a merge commit` option from Apache ORC `GitHub` PR merge button

2021-01-07 Thread Dongjoon Hyun
Hi, All. GitHub provides three merge options like the following. I'd like to propose to disable the `Create a merge commit` option (the first one) explicitly to keep the same behavior with our merge practice before GitHub Era. It will remove accidental `merging and force-push` situations. What do

[VOTE] Should we release ORC 1.6.6rc0?

2020-12-03 Thread Dongjoon Hyun
All, Should we release the following artifacts as ORC 1.6.6? tag: https://github.com/apache/orc/releases/tag/release-1.6.6rc0 binary: https://dist.apache.org/repos/dist/dev/orc/orc-1.6.6rc0 jiras: https://issues.apache.org/jira/projects/ORC/versions/12348859 This vote will be open until 10th

Apache ORC 1.6.6 Release

2020-12-03 Thread Dongjoon Hyun
changes in ReaderImpl.java As of today, the snapshot release passed Apache Spark and Apache Iceberg UTs. https://github.com/dongjoon-hyun/spark/pull/41 https://github.com/dongjoon-hyun/iceberg/pull/1 I start to roll 1.6.6-rc0. After 1.6.6 release, 1.6.7 will focus on Apache Hive. Thanks, Dongjoon.

Re: [VOTE] Should we release ORC 1.6.6rc0?

2020-12-04 Thread Dongjoon Hyun
+1 from me. 1. Checksum and GPG sign verified. 2. Build and test Java module at both JDK 8 and 11. 3. The integration tests were shared before. - https://github.com/dongjoon-hyun/spark/pull/41 - https://github.com/dongjoon-hyun/iceberg/pull/1 Bests, Dongjoon. On 2020/12/03 21:56:47, Dongjoon

[FYI] Accessing Apache ORC snapshots

2020-12-17 Thread Dongjoon Hyun
Hi, All. Apache ORC snapshots are available here like the other Apache projects. https://repository.apache.org/content/repositories/snapshots/org/apache/orc/orc/ - 1.7.0-SNAPSHOT - 1.6.7-SNAPSHOT - 1.5.13-SNAPSHOT Currently, we are using `GitHub Action` to publish it at every

[VOTE][RESULT] Release Apache ORC 1.6.6rc0

2020-12-10 Thread Dongjoon Hyun
The vote passes. Thanks to all who helped with the release! (* = binding) +1: - Dongjoon Hyun * - Panos Garefalakis - Owen O'Malley * - Jesus Camacho Rodriguez * +0: None -1: None

Re: [VOTE] Should we release ORC 1.6.6rc0?

2020-12-10 Thread Dongjoon Hyun
cked signature and hash, compiled cpp and java code and ran the test > > > suites. > > > > > > Cheers, > > > Panagiotis > > > > > > On Fri, Dec 4, 2020 at 8:25 PM Dongjoon Hyun > > > wrote: > > > > > > > +1

[ANNOUNCE] Announcing Apache ORC 1.6.6

2020-12-11 Thread Dongjoon Hyun
Hi All. We are happy to announce the availability of Apache ORC 1.6.6! https://orc.apache.org/news/2020/12/10/ORC-1.6.6/ 1.6.6 is a maintenance release containing several backward-compatibility fixes. This release is based on the branch-1.6 maintenance branch of Apache ORC. It's available

[REPORT] ORC Board report for November 2020

2020-11-08 Thread Dongjoon Hyun
## Description: The mission of ORC is the creation and maintenance of software related to the smallest, fastest columnar storage for Hadoop workloads ## Issues: There are no issues that require the board's attention. ## Membership Data: Apache ORC was founded 2015-04-21 (6 years ago) There are

Re: Disable `Create a merge commit` option from Apache ORC `GitHub` PR merge button

2021-01-10 Thread Dongjoon Hyun
e) but we would avoid tricky situations caused by > merging using the GitHub UI. > > Cheers, > Panagiotis > > On Fri, Jan 8, 2021 at 2:10 AM Dongjoon Hyun > wrote: > > > Hi, All. > > > > GitHub provides three merge options like the following. > > I'

Re: Apache ORC 1.6.7 Release

2021-01-15 Thread Dongjoon Hyun
It's great. Thank you so much for leading this, Panos. +1 for starting Apache Spark 1.6.7 release. I'm also expecting a release for the following patch which was merged last week. ORC-711: Support CryptoExtension in create/decryptLocalKey For now, the current snapshot seems to keep working

Re: Apache ORC 1.6.7 Release

2021-01-16 Thread Dongjoon Hyun
This is the result of Apache ORC 1.6.7-SNAPSHOT with Spark and Iceberg. All UTs passed. - https://github.com/dongjoon-hyun/spark/pull/49 (Test Apache ORC 1.6.7-SNAPSHOT) - https://github.com/dongjoon-hyun/iceberg/pull/2 (Test Apache ORC 1.6.7-SNAPSHOT) Bests, Dongjoon. On Fri, Jan 15, 2021

[ANNOUNCE] Announcing Apache ORC 1.6.7

2021-01-22 Thread Dongjoon Hyun
Hi All. We are happy to announce the availability of Apache ORC 1.6.7! https://orc.apache.org/news/2021/01/22/ORC-1.6.7/ 1.6.7 is a maintenance release containing several backward-compatibility fixes. This release is based on the branch-1.6 maintenance branch of Apache ORC. It's available

Re: [VOTE] Should we release ORC 1.6.7rc0?

2021-01-22 Thread Dongjoon Hyun
n 20, 2021 at 10:19 PM Deepak Majeti > wrote: > > > +1 for releasing 1.6.7rc0 (binding) > > > > * Checked signature and hash > > * Compiled and ran CPP and Java test suites successfully > > > > > > On Tue, Jan 19, 2021 at 10:51 PM Dongjoon Hyun >

[VOTE][RESULT] Release Apache ORC 1.6.7rc0

2021-01-22 Thread Dongjoon Hyun
The vote passes. Thanks to all who helped with the release! (* = binding) +1: - Panos Garefalakis - Dongjoon Hyun * - Deepak Majeti * - Owen O'Malley * +0: None -1: None

Re: [VOTE] Should we release ORC 1.6.7rc0?

2021-01-19 Thread Dongjoon Hyun
benchmark profile > * Double-checked latest commits (since 1.6.6) > > Cheers, > Panagiotis > > On Mon, Jan 18, 2021 at 7:16 PM Dongjoon Hyun > wrote: > > > All, > > > > Should we release the following artifacts as ORC 1.6.7? > > > > tag: https

[VOTE] Should we release ORC 1.6.7rc0?

2021-01-18 Thread Dongjoon Hyun
All, Should we release the following artifacts as ORC 1.6.7? tag: https://github.com/apache/orc/releases/tag/release-1.6.7rc0 binary: https://dist.apache.org/repos/dist/dev/orc/orc-1.6.7-rc0 jiras: https://issues.apache.org/jira/projects/ORC/versions/12349470 This vote will be open until 21st

Re: Please grant me contributor role

2021-01-18 Thread Dongjoon Hyun
Sure, Panos. Welcome to Apache ORC community, Ying. You are added to the Apache ORC contributor group. Bests, Dongjoon. On Mon, Jan 18, 2021 at 2:26 AM Panos Garefalakis wrote: > Hello there, > > Thanks for your interest in the ORC project ! > @Dongjoon Hyun can we ple

Re: [VOTE] Should we release ORC 1.6.7rc0?

2021-01-19 Thread Dongjoon Hyun
Thank you for the clarification, Justin. To All. This vote was started at `2021-01-18 19:16` and will be open until `2021-01-21 19:16` (for a minimum of 72 hours) or until we have enough votes. Bests, Dongjoon. On 2021/01/20 03:24:15, Justin Mclean wrote: > Hi, > > It's suggested that votes

Re: Apache ORC 1.6.8 Release?

2021-05-10 Thread Dongjoon Hyun
wrote: > +1 for 1.6.8 thanks Dongjoon for driving this! > Also need to think about releasing 1.7 at some point but that's a different > email :) > > Cheers, > Panagiotis > > On Sat, May 8, 2021 at 9:33 PM Dongjoon Hyun > wrote: > > > Thank you so much,

Re: [VOTE] Should we release ORC 1.6.8rc0?

2021-05-17 Thread Dongjoon Hyun
/dongjoon-hyun/spark/pull/55 - https://github.com/dongjoon-hyun/iceberg/pull/3 Bests, Dongjoon. On Mon, May 17, 2021 at 12:40 AM Dongjoon Hyun wrote: > All, > > Should we release the following artifacts as ORC 1.6.8? > > tag: https://github.com/apache/orc/releases/tag/release-1.

[VOTE] Should we release ORC 1.6.8rc0?

2021-05-17 Thread Dongjoon Hyun
All, Should we release the following artifacts as ORC 1.6.8? tag: https://github.com/apache/orc/releases/tag/release-1.6.8rc0 binary: https://dist.apache.org/repos/dist/dev/orc/orc-1.6.8-rc0 jiras: https://issues.apache.org/jira/projects/ORC/versions/12349617 This vote will be open until 21st

Re: Apache ORC 1.6.8 Release?

2021-05-06 Thread Dongjoon Hyun
FYI, Today's Apache ORC 1.6.8-SNAPSHOT seems to work well with Apache Spark and Iceberg. https://github.com/dongjoon-hyun/spark/pull/55 (Test Apache ORC 1.6.8-SNAPSHOT) https://github.com/dongjoon-hyun/iceberg/pull/3 (Test Apache ORC 1.6.8-SNAPSHOT) Bests, Dongjoon. On Thu, May 6, 2021 at 7:46

Apache ORC 1.6.8 Release?

2021-05-06 Thread Dongjoon Hyun
Hi, All. Since Apache ORC 1.6.8, 21 patches have landed on branch-1.6. Shall we have a new release, Apache ORC 1.6.8? WDYT? I'd like to volunteer as a release manager of 1.6.8. Also, please let me know if we need more backports from the `main` branch. Bests, Dongjoon.

Re: Apache ORC 1.6.8 Release?

2021-05-08 Thread Dongjoon Hyun
Thank you so much, William. Bests, Dongjoon. On Fri, May 7, 2021 at 7:51 PM William Hyun wrote: > Sounds good to me! > +1 > > On 2021/05/07 04:15:05, Dongjoon Hyun wrote: > > FYI, Today's Apache ORC 1.6.8-SNAPSHOT seems to work well with Apache > Spark > >

Re: Apache ORC 1.6.8 Release?

2021-05-12 Thread Dongjoon Hyun
I'll start a vote for Apache ORC 1.6.8 next Monday. Bests, Dongjoon. On 2021/05/10 21:48:30, Dongjoon Hyun wrote: > Thank you, Panos. > > Yes, definitely! That should be considered in a separate email with more QA > efforts. > Recently, at William's PR, I noticed that he

Re: [VOTE] Should we release ORC 1.6.8rc0?

2021-05-20 Thread Dongjoon Hyun
> - Built source code and ran unit tests for both Java and C++. > > > > > > Best, > > > Gang > > > > > > > > > On Mon, May 17, 2021 at 3:52 PM Dongjoon Hyun > > > > wrote: > > > > > > > I'll start with my +1

Re: [VOTE] Should we release ORC 1.6.8rc0?

2021-05-22 Thread Dongjoon Hyun
The vote passed. I'll finalize the vote and proceed to release it. Dongjoon. On 2021/05/22 03:13:15, Dongjoon Hyun wrote: > Thank you, Pavan and Owen! > > Bests, > Dongjoon. > > On Fri, May 21, 2021 at 2:22 PM Owen O'Malley > wrote: > > > +1 > > > &

[VOTE][RESULT] Release Apache ORC 1.6.8rc0

2021-05-22 Thread Dongjoon Hyun
The vote passes. Thanks to all who helped with the release! (* = binding) +1: - Dongjoon Hyun * - Gang Wu * - Panos Garefalakis * - William Hyun - Pavan Lanka - Owen O'Malley * +0: None -1: None

Re: [VOTE] Should we release ORC 1.6.8rc0?

2021-05-21 Thread Dongjoon Hyun
gt; > > +1 (non-binding) > > > > I verified C++ and Java builds and tests > > > > Regards, > > Pavan > > > > > On May 19, 2021, at 11:22 PM, Dongjoon Hyun > > wrote: > > > > > > Thank you so much, Gang, Panos, William! &g

[ANNOUNCE] Announcing Apache ORC 1.6.8

2021-05-22 Thread Dongjoon Hyun
Hi All. We are happy to announce the availability of Apache ORC 1.6.8! https://orc.apache.org/news/2021/05/21/ORC-1.6.8/ 1.6.8 is a maintenance release containing several important fixes. This release is based on the branch-1.6 maintenance branch of Apache ORC. It's available in Apache

Adding `releasenotes` label for Apache ORC 1.7.0

2021-06-03 Thread Dongjoon Hyun
Hi, All. Please add a label, `releasenotes`, to the notable JIRA issues which you want to add to the Apache ORC 1.7.0 release notes. This will be the first step toward Apache ORC 1.7.0 release. Bests, Dongjoon.

branch-1.7 for Apache ORC 1.7 preparation?

2021-06-24 Thread Dongjoon Hyun
Hi, All. Shall we do branch cut and start to prepare Apache ORC 1.7? WDYT? Bests, Dongjoon.

Re: [VOTE] Should we release ORC 1.6.9rc0?

2021-07-02 Thread Dongjoon Hyun
Thank you all. This vote passed. I'll send a vote result email and proceed to release. Dongjoon. On Thu, Jul 1, 2021 at 11:12 AM Dongjoon Hyun wrote: > Thank you, Panos, William, Kyle, Gang. > > Bests, > Dongjoon > > On Wed, Jun 30, 2021 at 9:32 PM Gang Wu wrote: > &g

[VOTE][RESULT] Release Apache ORC 1.6.9rc0

2021-07-02 Thread Dongjoon Hyun
The vote passes. Thanks to all who helped with the release! (* = binding) +1: - Dongjoon Hyun * - Panos Garefalakis * - William Hyun - Kyle Bendickson - Gang Wu * +0: None -1: None

  1   2   3   4   5   6   7   8   9   >