Zihan Li created GOBBLIN-717:
Summary: Filter Out Empty MultiWorkUnits
Key: GOBBLIN-717
URL: https://issues.apache.org/jira/browse/GOBBLIN-717
Project: Apache Gobblin
Issue Type: Improvement
Zihan Li created GOBBLIN-715:
Summary: Unit test for KafkaSoure
Key: GOBBLIN-715
URL: https://issues.apache.org/jira/browse/GOBBLIN-715
Project: Apache Gobblin
Issue Type: Test
Zihan Li created GOBBLIN-726:
Summary: Enable Schema Verification During Primary Dataset
Deployment
Key: GOBBLIN-726
URL: https://issues.apache.org/jira/browse/GOBBLIN-726
Project: Apache Gobblin
Zihan Li created GOBBLIN-772:
Summary: Implement Schema Comparison Strategy during Disctp
Key: GOBBLIN-772
URL: https://issues.apache.org/jira/browse/GOBBLIN-772
Project: Apache Gobblin
Issue
Zihan Li created GOBBLIN-799:
Summary: Bugs in AvroSchemaCheckDefaultStrategy that not return
after check ENUM and FIXED
Key: GOBBLIN-799
URL: https://issues.apache.org/jira/browse/GOBBLIN-799
Project:
Zihan Li created GOBBLIN-806:
Summary: Enable metrics reporter during dataset discovery for
retention job
Key: GOBBLIN-806
URL: https://issues.apache.org/jira/browse/GOBBLIN-806
Project: Apache Gobblin
Zihan Li created GOBBLIN-747:
Summary: Set expected schema when creating workunits
Key: GOBBLIN-747
URL: https://issues.apache.org/jira/browse/GOBBLIN-747
Project: Apache Gobblin
Issue Type:
Zihan Li created GOBBLIN-859:
Summary: Let writer pass latest schema to workUnitState when
schema change
Key: GOBBLIN-859
URL: https://issues.apache.org/jira/browse/GOBBLIN-859
Project: Apache Gobblin
Zihan Li created GOBBLIN-861:
Summary: Skip getPartition() call to Hive Metastore when a
partition already exists
Key: GOBBLIN-861
URL: https://issues.apache.org/jira/browse/GOBBLIN-861
Project: Apache
Zihan Li created GOBBLIN-852:
Summary: Reorganize the code for hive registration to isolate
function
Key: GOBBLIN-852
URL: https://issues.apache.org/jira/browse/GOBBLIN-852
Project: Apache Gobblin
Zihan Li created GOBBLIN-863:
Summary: Handle race condition between concurrent Gobblin tasks
performing Hive registration
Key: GOBBLIN-863
URL: https://issues.apache.org/jira/browse/GOBBLIN-863
Project:
Zihan Li created GOBBLIN-872:
Summary: Only use one CouchbaseEnvironment per JVM
Key: GOBBLIN-872
URL: https://issues.apache.org/jira/browse/GOBBLIN-872
Project: Apache Gobblin
Issue Type: Task
Zihan Li created GOBBLIN-877:
Summary: Add column metadata for partition for inline hive
registration
Key: GOBBLIN-877
URL: https://issues.apache.org/jira/browse/GOBBLIN-877
Project: Apache Gobblin
Zihan Li created GOBBLIN-941:
Summary: Enhance DDL to add column and column.types with
case-preserving schema
Key: GOBBLIN-941
URL: https://issues.apache.org/jira/browse/GOBBLIN-941
Project: Apache
Zihan Li created GOBBLIN-961:
Summary: Bypass locked partitions when calculating src watermark
Key: GOBBLIN-961
URL: https://issues.apache.org/jira/browse/GOBBLIN-961
Project: Apache Gobblin
Zihan Li created GOBBLIN-967:
Summary: Change token refresh method in
YarnContainerSecirityManager
Key: GOBBLIN-967
URL: https://issues.apache.org/jira/browse/GOBBLIN-967
Project: Apache Gobblin
Zihan Li created GOBBLIN-975:
Summary: Add flag to enable/disable avro type check in AvroToOrc
Key: GOBBLIN-975
URL: https://issues.apache.org/jira/browse/GOBBLIN-975
Project: Apache Gobblin
Zihan Li created GOBBLIN-912:
Summary: Enable TTL caching on Hive Metastore client connection
Key: GOBBLIN-912
URL: https://issues.apache.org/jira/browse/GOBBLIN-912
Project: Apache Gobblin
Zihan Li created GOBBLIN-924:
Summary: Get rid of orc.schema.literal in ORC-ingestion and
registration
Key: GOBBLIN-924
URL: https://issues.apache.org/jira/browse/GOBBLIN-924
Project: Apache Gobblin
Zihan Li created GOBBLIN-921:
Summary: Make pull/push mode when registering partition to be
configurable
Key: GOBBLIN-921
URL: https://issues.apache.org/jira/browse/GOBBLIN-921
Project: Apache Gobblin
Zihan Li created GOBBLIN-916:
Summary: Make ContainerLaunchContext instantiation in YarnService
more efficient
Key: GOBBLIN-916
URL: https://issues.apache.org/jira/browse/GOBBLIN-916
Project: Apache
Zihan Li created GOBBLIN-981:
Summary: Handle backward compatibility issue in HiveSource
Key: GOBBLIN-981
URL: https://issues.apache.org/jira/browse/GOBBLIN-981
Project: Apache Gobblin
Issue
Zihan Li created GOBBLIN-986:
Summary: Persist the existing property of table when doing hive
registration
Key: GOBBLIN-986
URL: https://issues.apache.org/jira/browse/GOBBLIN-986
Project: Apache Gobblin
Zihan Li created GOBBLIN-902:
Summary: Enable gobblin yarn app luncher class configurable
Key: GOBBLIN-902
URL: https://issues.apache.org/jira/browse/GOBBLIN-902
Project: Apache Gobblin
Issue
Zihan Li created GOBBLIN-899:
Summary: Add a key in dataset config to disable schema check for a
specific dataset
Key: GOBBLIN-899
URL: https://issues.apache.org/jira/browse/GOBBLIN-899
Project: Apache
Zihan Li created GOBBLIN-1069:
-
Summary: Add NPE check in handleContainerCompletion method
Key: GOBBLIN-1069
URL: https://issues.apache.org/jira/browse/GOBBLIN-1069
Project: Apache Gobblin
Issue
Zihan Li created GOBBLIN-1064:
-
Summary: Add writer's schema to workUnitState
Key: GOBBLIN-1064
URL: https://issues.apache.org/jira/browse/GOBBLIN-1064
Project: Apache Gobblin
Issue Type: Task
[
https://issues.apache.org/jira/browse/GOBBLIN-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li updated GOBBLIN-1064:
--
Summary: Make KafkaAvroSchemaRegistry extendable (was: Add writer's schema
to workUnitState)
>
[
https://issues.apache.org/jira/browse/GOBBLIN-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li updated GOBBLIN-1023:
--
Summary: Fix the issue of lossing data when trying to commit (was: Fix the
issue of losing data
Zihan Li created GOBBLIN-1023:
-
Summary: Fix the issue of losing data when trying to commit
Key: GOBBLIN-1023
URL: https://issues.apache.org/jira/browse/GOBBLIN-1023
Project: Apache Gobblin
Zihan Li created GOBBLIN-1077:
-
Summary: Fix bug in HiveDataset.resolveConfig
Key: GOBBLIN-1077
URL: https://issues.apache.org/jira/browse/GOBBLIN-1077
Project: Apache Gobblin
Issue Type: Task
Zihan Li created GOBBLIN-1080:
-
Summary: Add configuration to preserve schema creation time in
converter
Key: GOBBLIN-1080
URL: https://issues.apache.org/jira/browse/GOBBLIN-1080
Project: Apache Gobblin
Zihan Li created GOBBLIN-1121:
-
Summary: Fix Issue that YarnService use the old token to acquire
new container
Key: GOBBLIN-1121
URL: https://issues.apache.org/jira/browse/GOBBLIN-1121
Project: Apache
Zihan Li created GOBBLIN-1136:
-
Summary: Make LogCopier be able to refresh FileSystem for long
running job use cases
Key: GOBBLIN-1136
URL: https://issues.apache.org/jira/browse/GOBBLIN-1136
Project:
Zihan Li created GOBBLIN-1133:
-
Summary: Add CompactionSuiteBaseWithConfigurableCompleteAction to
make complete action configurable
Key: GOBBLIN-1133
URL: https://issues.apache.org/jira/browse/GOBBLIN-1133
Zihan Li created GOBBLIN-1143:
-
Summary: Add a generic wrapper producer client to communicate with
Kafka
Key: GOBBLIN-1143
URL: https://issues.apache.org/jira/browse/GOBBLIN-1143
Project: Apache Gobblin
Zihan Li created GOBBLIN-1147:
-
Summary: Use one dfsClient in FsDataWriter to to rename and exists
check to avoid inconsistency
Key: GOBBLIN-1147
URL: https://issues.apache.org/jira/browse/GOBBLIN-1147
Zihan Li created GOBBLIN-1093:
-
Summary: Use method overloading in AvroUtils for add creation time
Key: GOBBLIN-1093
URL: https://issues.apache.org/jira/browse/GOBBLIN-1093
Project: Apache Gobblin
[
https://issues.apache.org/jira/browse/GOBBLIN-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li updated GOBBLIN-1158:
--
Summary: Use input dir to document old files instead of file pathes to
reduce memory cost in
Zihan Li created GOBBLIN-1158:
-
Summary: Use input dir to document old files instead of file
pathes to reduce memory cost
Key: GOBBLIN-1158
URL: https://issues.apache.org/jira/browse/GOBBLIN-1158
Zihan Li created GOBBLIN-1165:
-
Summary: Add config to enable user to set additional yarn
classpathes
Key: GOBBLIN-1165
URL: https://issues.apache.org/jira/browse/GOBBLIN-1165
Project: Apache Gobblin
Zihan Li created GOBBLIN-1210:
-
Summary: Force AM to read from token file to update token when
start up
Key: GOBBLIN-1210
URL: https://issues.apache.org/jira/browse/GOBBLIN-1210
Project: Apache Gobblin
Zihan Li created GOBBLIN-1185:
-
Summary: Enable dataset cleaner to emit kafka events
Key: GOBBLIN-1185
URL: https://issues.apache.org/jira/browse/GOBBLIN-1185
Project: Apache Gobblin
Issue Type:
Zihan Li created GOBBLIN-1183:
-
Summary: Enable additional yarn class path set for app master
Key: GOBBLIN-1183
URL: https://issues.apache.org/jira/browse/GOBBLIN-1183
Project: Apache Gobblin
[
https://issues.apache.org/jira/browse/GOBBLIN-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-912.
--
Resolution: Fixed
> Enable TTL caching on Hive Metastore client connection
>
[
https://issues.apache.org/jira/browse/GOBBLIN-902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-902.
--
Resolution: Fixed
> Enable gobblin yarn app luncher class configurable
>
[
https://issues.apache.org/jira/browse/GOBBLIN-1136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-1136.
---
Resolution: Fixed
> Make LogCopier be able to refresh FileSystem for long running job use cases
>
[
https://issues.apache.org/jira/browse/GOBBLIN-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-1147.
---
Resolution: Fixed
> Use one dfsClient in FsDataWriter to to rename and exists check to avoid
>
[
https://issues.apache.org/jira/browse/GOBBLIN-1133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-1133.
---
Resolution: Fixed
> Add CompactionSuiteBaseWithConfigurableCompleteAction to make complete action
[
https://issues.apache.org/jira/browse/GOBBLIN-1080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-1080.
---
Resolution: Fixed
> Add configuration to preserve schema creation time in converter
>
[
https://issues.apache.org/jira/browse/GOBBLIN-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-1121.
---
Resolution: Fixed
> Fix Issue that YarnService use the old token to acquire new container
>
[
https://issues.apache.org/jira/browse/GOBBLIN-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-1143.
---
Resolution: Fixed
> Add a generic wrapper producer client to communicate with Kafka
>
[
https://issues.apache.org/jira/browse/GOBBLIN-916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-916.
--
Resolution: Fixed
> Make ContainerLaunchContext instantiation in YarnService more efficient
>
[
https://issues.apache.org/jira/browse/GOBBLIN-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-921.
--
Resolution: Fixed
> Make pull/push mode when registering partition to be configurable
>
[
https://issues.apache.org/jira/browse/GOBBLIN-924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-924.
--
Resolution: Fixed
> Get rid of orc.schema.literal in ORC-ingestion and registration
>
[
https://issues.apache.org/jira/browse/GOBBLIN-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-1165.
---
Resolution: Fixed
> Add config to enable user to set additional yarn classpathes
>
[
https://issues.apache.org/jira/browse/GOBBLIN-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-1183.
---
Resolution: Fixed
> Enable additional yarn class path set for app master
>
[
https://issues.apache.org/jira/browse/GOBBLIN-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-1158.
---
Resolution: Fixed
> Use input dir to document old files instead of file pathes to reduce memory
>
[
https://issues.apache.org/jira/browse/GOBBLIN-863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-863.
--
Resolution: Fixed
> Handle race condition between concurrent Gobblin tasks performing Hive
>
[
https://issues.apache.org/jira/browse/GOBBLIN-861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-861.
--
Resolution: Fixed
> Skip getPartition() call to Hive Metastore when a partition already exists
>
[
https://issues.apache.org/jira/browse/GOBBLIN-859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-859.
--
Resolution: Fixed
> Let writer pass latest schema to workUnitState when schema change
>
[
https://issues.apache.org/jira/browse/GOBBLIN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-899.
--
Resolution: Fixed
> Add a key in dataset config to disable schema check for a specific dataset
>
[
https://issues.apache.org/jira/browse/GOBBLIN-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-877.
--
Resolution: Fixed
> Add column metadata for partition for inline hive registration
>
[
https://issues.apache.org/jira/browse/GOBBLIN-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-1064.
---
Resolution: Fixed
> Make KafkaAvroSchemaRegistry extendable
>
[
https://issues.apache.org/jira/browse/GOBBLIN-1077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-1077.
---
Resolution: Fixed
> Fix bug in HiveDataset.resolveConfig
>
>
[
https://issues.apache.org/jira/browse/GOBBLIN-1069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-1069.
---
Resolution: Fixed
> Add NPE check in handleContainerCompletion method
>
[
https://issues.apache.org/jira/browse/GOBBLIN-941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-941.
--
Resolution: Fixed
> Enhance DDL to add column and column.types with case-preserving schema
>
[
https://issues.apache.org/jira/browse/GOBBLIN-986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-986.
--
Resolution: Fixed
> Persist the existing property of table when doing hive registration
>
[
https://issues.apache.org/jira/browse/GOBBLIN-981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-981.
--
Resolution: Fixed
> Handle backward compatibility issue in HiveSource
>
[
https://issues.apache.org/jira/browse/GOBBLIN-975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-975.
--
Resolution: Fixed
> Add flag to enable/disable avro type check in AvroToOrc
>
[
https://issues.apache.org/jira/browse/GOBBLIN-852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-852.
--
Resolution: Fixed
> Reorganize the code for hive registration to isolate function
>
[
https://issues.apache.org/jira/browse/GOBBLIN-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-806.
--
Resolution: Fixed
> Enable metrics reporter during dataset discovery for retention job
>
[
https://issues.apache.org/jira/browse/GOBBLIN-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-1023.
---
Resolution: Won't Fix
> Fix the issue of lossing data when trying to commit
>
[
https://issues.apache.org/jira/browse/GOBBLIN-1210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-1210.
---
Resolution: Fixed
> Force AM to read from token file to update token when start up
>
[
https://issues.apache.org/jira/browse/GOBBLIN-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li resolved GOBBLIN-1185.
---
Resolution: Fixed
> Enable dataset cleaner to emit kafka events
>
Zihan Li created GOBBLIN-1223:
-
Summary: Change the criteria for re-compaction, limit the time for
re-compaction
Key: GOBBLIN-1223
URL: https://issues.apache.org/jira/browse/GOBBLIN-1223
Project: Apache
76 matches
Mail list logo
