[GitHub] hive pull request #425: Kafkahandler hive 20377

2018-12-04 Thread b-slim
Github user b-slim closed the pull request at:

https://github.com/apache/hive/pull/425


---


[GitHub] hive pull request #425: Kafkahandler hive 20377

2018-08-28 Thread b-slim
GitHub user b-slim opened a pull request:

https://github.com/apache/hive/pull/425

Kafkahandler hive 20377



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/b-slim/hive kafkahandler_HIVE-20377

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/425.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #425


commit 3996b5b2e86f7b3cd4ca319227163852e268aec6
Author: Slim Bouguerra 
Date:   2018-07-19T16:30:48Z

Working version of kafka storage handler

Change-Id: Ief161074d151917c3a7ed443cf78374bcaf7bcfc

trying random things

fix typo

working version for demo only change might be getRecordreader call

adding kafka Trimmer first cut

Change-Id: If9bf7f561b867e80ab31f5c8c3c40730128986af

link the code and add some docs

Change-Id: I7e15d90de772fffef8ee0930352069742af12ac7

add static function to avoid dep on hive exec

Change-Id: Ib61901cd45027d1469d72a890e26f73997402974

working version of filter pushdown partition and offsets

Change-Id: I3e3d157438fcc965491380e3f1afa9c81a6cd75b

fix case when offset filter is out of range and add some code comments

Change-Id: Ic3321a14cc9a06b8eeb85cc20ea89f21e2765a93

add filter push down based on ts

Change-Id: I5a1da7634cfc80990036add3463a28810ce642c2

clean code

Change-Id: I753cfe4e9f0a69396635b7a9fe16c29f7bb0675e

case filter is null can imply no filter

Change-Id: I68fa9afe09009329ebe8ac9e5d3f7923a2003ebb

some refactor for how to build consumer

Change-Id: If007a89d93c215542027aec7ea0aff2fa6dc83fb

major refactor:
removed and/or methods
switch logic of ANDing filters

Change-Id: Id36f45842db7c4579edaa1e6062bddd291d53bc9

adding tests and refactor fetch by time

Change-Id: I6329ca3fa8c6f29e90d0001034064d2a603d2580

adding more tests

Change-Id: Ic9d1f1a86ffd0f99b298965db5c5d1f36670b15b

more tests

Change-Id: I4aada643b67e3e1207a504267a50dc75bc0176e3

small refactor to where column names are stored

Change-Id: I0635c9627520f786e4f45e501eb63158f915d2a0

Start working on GenericSerde

Change-Id: I1adddfb639da7d6a64dde06c46bc67c072806469

first cut that uses default_json

Change-Id: Icad9eb9eb36b76eea4ba1342193c649a9d419287

cleaning some tests stuff

Change-Id: I889c4788250590f6cc7f0d9d7a1756f71e9e5cc5

setting the default serde for storage handler

Change-Id: I00179ec97d43d0a955500a23ebdab770d26930a7

fix how reading the property

Change-Id: I1bba7e19defda3316b4ddb0e0721e45cf11be063

working version of generic serde

Change-Id: I370a87aaf55f599db1695775ec2737e54af81270

fixup squash with previous

Change-Id: I6adfc93efed84c38aa1ad7092660e4cca49bc29a

use nanos for logging

Change-Id: I9055e0813b3b4bcbf72db0900ab9d2cb480c8f8b

major refactor plus tests working q files tests

Change-Id: I5ffc1cfcb4708e7a89163c371027e92782f2e4fc

adding q files test

Change-Id: I887fff5e3fdcdb0322770e52f9a8ab732a8dbe86

commit d28f1c94956b65374d58f3cda94fbbee5ed3e6b4
Author: Slim Bouguerra 
Date:   2018-08-13T18:00:55Z

re activate the test

Change-Id: I7f8ef8a44271286abbd5a36a92ccde87d2ef8839

commit f71f68d8f7458409d5f341c1ab262d6a894ebcc0
Author: Slim Bouguerra 
Date:   2018-08-13T20:02:07Z

refactor names and added copy jars

Change-Id: I11ec3aa4f9e96efc81ca8e9994c7409625384764

commit 5c442137e3f4b02086fd2c42ce354e4d4dbe4cd3
Author: Slim Bouguerra 
Date:   2018-08-13T20:11:35Z

fix headers

Change-Id: I478c0709ba2ca77a1139011006170e4ad0683617

commit dce3a0f8b4eb77a9929ff2b2edf9fde44d364244
Author: Slim Bouguerra 
Date:   2018-08-13T22:25:32Z

clean code and add comments

Change-Id: I1f8b3b748b5ab4f8f7e594bf85433affca83b50e

commit 80d9d5bbd55ea6d1a5d2de8ddffa393e495008ed
Author: Slim Bouguerra 
Date:   2018-08-14T00:10:11Z

fix hive package

Change-Id: I2f255590aab7cd0897583ab11ea02961d1114bbd

commit 172019a6ab06d6026a7ba69f4b2c719f2afb2408
Author: Slim Bouguerra 
Date:   2018-08-14T00:35:57Z

added more tests

Change-Id: I59c8bee67877bb54a4dcf5803b9e15ab2c8f0c42

commit 77700b20b7e2aa604caaad89bcd030dfc8b8e925
Author: Slim Bouguerra 
Date:   2018-08-14T01:01:09Z

intelliJ friendly warning supress

Change-Id: Ib6fb5a8a2fdc2e7cb13dde7f8386bf39b86a8926

commit 8cfbce6e3cd70a472ebb818f126d72596b39bd91
Author: Slim Bouguerra 
Date:   2018-08-14T20:29:04Z

fix style issue

Change-Id: I36be0353de253e46fbe16e35b52c258c7784a63a

commit