GitHub user anishek opened a pull request:
https://github.com/apache/hive/pull/214
Hive 16896: move replication load related work in semantic analysis phase
to execution phase using a task
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/anishek/hive HIVE-16896
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/hive/pull/214.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #214
----
commit 2c306a97291a186a4fbf1757934e33fa60434b8b
Author: Anishek Agarwal <[email protected]>
Date: 2017-07-13T05:28:50Z
first cut at code separation
commit 5e076404802943658372dd36bbdc81683ef2c3f6
Author: Anishek Agarwal <[email protected]>
Date: 2017-07-19T04:57:23Z
HIVE-16896 : move replication load related work in semantic analysis phase
to execution phase using a task
ability to have some sort of replication state getting populated when we
reach the desired number of tasks,
commit 2f495ed9f262a432054cc844be924f4c54e0f21b
Author: Anishek Agarwal <[email protected]>
Date: 2017-07-19T13:03:35Z
HIVE-16896 : move replication load related work in semantic analysis phase
to execution phase using a task
Iterator to go over directory structure to create tasks, replication state
used in iterator to give correct file, task tracker now tracks number of tasks
created. LoadTask does the work of assigning childTasks and creating
dependencyTask + next LoadTask.
commit 8f3579e717a09ef35187e4e68fedc94d36971400
Author: Anishek Agarwal <[email protected]>
Date: 2017-07-19T13:22:25Z
HIVE-16896 : move replication load related work in semantic analysis phase
to execution phase using a task
making sure that replication state while loading partitions is captured
more rigorously so we dont miss it out on subsequent loadTasks
commit 47bcbf22e2d919983288d25468a3781a4041cdbc
Author: Anishek Agarwal <[email protected]>
Date: 2017-07-21T08:22:49Z
HIVE-16896 : move replication load related work in semantic analysis phase
to execution phase using a task
adding function metadata handler during bootstrap
commit 3f22331f1f560ff5e2db19bd0ab909dde6652015
Author: Anishek Agarwal <[email protected]>
Date: 2017-07-26T10:35:18Z
HIVE-16896 : move replication load related work in semantic analysis phase
to execution phase using a task
implementing the iterator and correcting order of task execution
commit f772d408b75fb76181e7a86a4e022a316a829c9e
Author: Anishek Agarwal <[email protected]>
Date: 2017-07-26T11:00:38Z
HIVE-16896 : move replication load related work in semantic analysis phase
to execution phase using a task
configuration as to how many tasks we are going to allow to run in
execution phase for repl load
commit f2d604f283689d04f13e28f9f44e520ffd38c935
Author: Anishek Agarwal <[email protected]>
Date: 2017-07-26T11:26:05Z
HIVE-16896 : move replication load related work in semantic analysis phase
to execution phase using a task
setting the exception on the task if there is an error so we can take
corrective actions down stream
commit ed89c957807b3fb925ee6933681eb6240736b150
Author: Anishek Agarwal <[email protected]>
Date: 2017-07-26T11:55:12Z
HIVE-16896 : move replication load related work in semantic analysis phase
to execution phase using a task
changes to handle table only replication and not at database level.
commit 18198bf8fc576134a8b734aca691e91678f0fcf9
Author: Anishek Agarwal <[email protected]>
Date: 2017-07-27T09:08:10Z
HIVE-16896 : move replication load related work in semantic analysis phase
to execution phase using a task
package movement
commit 01cdaeb75733e260db9bb3598b097599739e2129
Author: Anishek Agarwal <[email protected]>
Date: 2017-07-27T09:12:34Z
HIVE-16896 : move replication load related work in semantic analysis phase
to execution phase using a task
moving / renaming classes
commit d3410098e9a47208b187ea556ad4289eaa928798
Author: Anishek Agarwal <[email protected]>
Date: 2017-07-27T09:18:46Z
HIVE-16896 : move replication load related work in semantic analysis phase
to execution phase using a task
access modifiers
commit 1d162378fe3c4d3c798ac9e7fdcabf6a2c331704
Author: Anishek Agarwal <[email protected]>
Date: 2017-07-27T11:32:58Z
HIVE-16896 : move replication load related work in semantic analysis phase
to execution phase using a task
Added tests
commit 9ec1736b000419ac23c549100e7b31faf792d2c8
Author: Anishek Agarwal <[email protected]>
Date: 2017-07-28T12:03:33Z
HIVE-16896 : move replication load related work in semantic analysis phase
to execution phase using a task
ability to check for multiple runs of load Tasks run
commit 0a4767300a9e2b93a50bf714c1714bb0918fa437
Author: Anishek Agarwal <[email protected]>
Date: 2017-07-28T12:24:50Z
HIVE-16896 : move replication load related work in semantic analysis phase
to execution phase using a task
making sure the last.repl.id is updated correctly
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
