[jira] [Resolved] (HUDI-442) Fix TestComplexKeyGenerator#testSingleValueKeyGenerator and testMultipleValueKeyGenerator NPE

[vinoyang (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

vinoyang resolved HUDI-442.
---
Resolution: Fixed

Fixed via hudi_test_refactor branch: 7484a0e2945739628b8069591346124ec745d679

> Fix TestComplexKeyGenerator#testSingleValueKeyGenerator and 
> testMultipleValueKeyGenerator NPE
> -
>
> Key: HUDI-442
> URL: https://issues.apache.org/jira/browse/HUDI-442
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>  Components: Testing
>Reporter: vinoyang
>Assignee: vinoyang
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> {code:java}
> Results :
> Tests in error: 
>   TestComplexKeyGenerator.testMultipleValueKeyGenerator:55 NullPointer
>   TestComplexKeyGenerator.testSingleValueKeyGenerator:38 NullPointer
> {code}
> log details: https://api.travis-ci.org/v3/job/627202478/log.txt



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[incubator-hudi] branch hudi_test_suite_refactor updated (ae5bd06 -> 9151ccf)

[vinoyang]

This is an automated email from the ASF dual-hosted git repository.

vinoyang pushed a change to branch hudi_test_suite_refactor
in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git.


from ae5bd06  [HUDI-391] Rename module name from hudi-bench to 
hudi-test-suite and fix some checkstyle issues (#1102)
 add 9151ccf  [HUDI-442] Fix 
TestComplexKeyGenerator#testSingleValueKeyGenerator and 
testMultipleValueKeyGenerator NPE (#1118)

No new revisions were added by this update.

Summary of changes:
 hudi-spark/src/main/java/org/apache/hudi/ComplexKeyGenerator.java | 5 -
 1 file changed, 5 deletions(-)

[jira] [Updated] (HUDI-442) Fix TestComplexKeyGenerator#testSingleValueKeyGenerator and testMultipleValueKeyGenerator NPE

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HUDI-442:

Labels: pull-request-available  (was: )

> Fix TestComplexKeyGenerator#testSingleValueKeyGenerator and 
> testMultipleValueKeyGenerator NPE
> -
>
> Key: HUDI-442
> URL: https://issues.apache.org/jira/browse/HUDI-442
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>  Components: Testing
>Reporter: vinoyang
>Assignee: vinoyang
>Priority: Major
>  Labels: pull-request-available
>
> {code:java}
> Results :
> Tests in error: 
>   TestComplexKeyGenerator.testMultipleValueKeyGenerator:55 NullPointer
>   TestComplexKeyGenerator.testSingleValueKeyGenerator:38 NullPointer
> {code}
> log details: https://api.travis-ci.org/v3/job/627202478/log.txt



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[GitHub] [incubator-hudi] yanghua opened a new pull request #1118: [HUDI-442] Fix TestComplexKeyGenerator#testSingleValueKeyGenerator and testMultipleValueKeyGenerator NPE

[GitBox]

yanghua opened a new pull request #1118: [HUDI-442] Fix 
TestComplexKeyGenerator#testSingleValueKeyGenerator and 
testMultipleValueKeyGenerator NPE
URL: https://github.com/apache/incubator-hudi/pull/1118
 
 
   
   
   ## What is the purpose of the pull request
   
   *Fix TestComplexKeyGenerator#testSingleValueKeyGenerator and 
testMultipleValueKeyGenerator NPE*
   
   ## Brief change log
   
 - *Fix TestComplexKeyGenerator#testSingleValueKeyGenerator and 
testMultipleValueKeyGenerator NPE*
   
   ## Verify this pull request
   
   This pull request is a trivial rework / code cleanup without any test 
coverage.
   
   
   ## Committer checklist
   
- [ ] Has a corresponding JIRA in PR title & commit

- [ ] Commit message is descriptive of the change

- [ ] CI is green
   
- [ ] Necessary doc changes done or have another open PR
  
- [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[jira] [Updated] (HUDI-442) Fix TestComplexKeyGenerator#testSingleValueKeyGenerator and testMultipleValueKeyGenerator NPE

[vinoyang (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

vinoyang updated HUDI-442:
--
Description: 

{code:java}
Results :
Tests in error: 
  TestComplexKeyGenerator.testMultipleValueKeyGenerator:55 NullPointer
  TestComplexKeyGenerator.testSingleValueKeyGenerator:38 NullPointer
{code}

log details: https://api.travis-ci.org/v3/job/627202478/log.txt

> Fix TestComplexKeyGenerator#testSingleValueKeyGenerator and 
> testMultipleValueKeyGenerator NPE
> -
>
> Key: HUDI-442
> URL: https://issues.apache.org/jira/browse/HUDI-442
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>  Components: Testing
>Reporter: vinoyang
>Assignee: vinoyang
>Priority: Major
>
> {code:java}
> Results :
> Tests in error: 
>   TestComplexKeyGenerator.testMultipleValueKeyGenerator:55 NullPointer
>   TestComplexKeyGenerator.testSingleValueKeyGenerator:38 NullPointer
> {code}
> log details: https://api.travis-ci.org/v3/job/627202478/log.txt



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (HUDI-442) Fix TestComplexKeyGenerator#testSingleValueKeyGenerator and testMultipleValueKeyGenerator NPE

[vinoyang (Jira)]

vinoyang created HUDI-442:
-

 Summary: Fix TestComplexKeyGenerator#testSingleValueKeyGenerator 
and testMultipleValueKeyGenerator NPE
 Key: HUDI-442
 URL: https://issues.apache.org/jira/browse/HUDI-442
 Project: Apache Hudi (incubating)
  Issue Type: Sub-task
  Components: Testing
Reporter: vinoyang
Assignee: vinoyang






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (HUDI-251) JDBC incremental load to HUDI with DeltaStreamer

[Vinoth Chandar (Jira)]

[ 
https://issues.apache.org/jira/browse/HUDI-251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000658#comment-17000658
 ] 

Vinoth Chandar commented on HUDI-251:
-

Done! 

> JDBC incremental load to HUDI with DeltaStreamer
> 
>
> Key: HUDI-251
> URL: https://issues.apache.org/jira/browse/HUDI-251
> Project: Apache Hudi (incubating)
>  Issue Type: New Feature
>  Components: deltastreamer
>Reporter: Taher Koitawala
>Assignee: Purushotham Pushpavanthar
>Priority: Trivial
>  Labels: pull-request-available
> Fix For: 0.5.1
>
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> Mirroring RDBMS to HUDI is one of the most basic use cases of HUDI. Hence, 
> for such use cases, DeltaStreamer should provide inbuilt support.
> DeltaSteamer should accept something like jdbc-source.properties where users 
> can define the RDBMS connection properties along with a timestamp column and 
> an interval which allows users to express how frequently HUDI should check 
> with RDBMS data source for new inserts or updates.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[incubator-hudi] branch master updated: [HUDI-415] Get commit time when Spark start (#1113)

[vinoth]

This is an automated email from the ASF dual-hosted git repository.

vinoth pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git


The following commit(s) were added to refs/heads/master by this push:
 new 36b3b6f  [HUDI-415] Get commit time when Spark start (#1113)
36b3b6f is described below

commit 36b3b6f5dd913d3f1c9aa116aff8daf6540fed65
Author: YanJia-Gary-Li 
AuthorDate: Thu Dec 19 22:19:06 2019 -0800

[HUDI-415] Get commit time when Spark start (#1113)
---
 .../src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala  | 7 ---
 1 file changed, 4 insertions(+), 3 deletions(-)

diff --git 
a/hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala 
b/hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala
index dcd96a6..122aeab 100644
--- a/hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala
+++ b/hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala
@@ -25,6 +25,7 @@ import org.apache.hadoop.fs.{FileSystem, Path}
 import org.apache.hadoop.hive.conf.HiveConf
 import org.apache.hudi.DataSourceWriteOptions._
 import org.apache.hudi.common.table.HoodieTableMetaClient
+import org.apache.hudi.common.table.timeline.HoodieActiveTimeline
 import org.apache.hudi.common.util.{FSUtils, TypedProperties}
 import org.apache.hudi.config.HoodieWriteConfig
 import org.apache.hudi.exception.HoodieException
@@ -74,11 +75,11 @@ private[hudi] object HoodieSparkSqlWriter {
   }
 
 var writeSuccessful: Boolean = false
-var commitTime: String = null
 var writeStatuses: JavaRDD[WriteStatus] = null
 
 val jsc = new JavaSparkContext(sparkContext)
 val basePath = new Path(parameters("path"))
+val commitTime = HoodieActiveTimeline.createNewInstantTime();
 val fs = basePath.getFileSystem(sparkContext.hadoopConfiguration)
 var exists = fs.exists(new Path(basePath, 
HoodieTableMetaClient.METAFOLDER_NAME))
 
@@ -145,7 +146,7 @@ private[hudi] object HoodieSparkSqlWriter {
 log.info("new batch has no new records, skipping...")
 return (true, common.util.Option.empty())
   }
-  commitTime = client.startCommit()
+  client.startCommitWithTime(commitTime)
   writeStatuses = DataSourceUtils.doWriteOperation(client, hoodieRecords, 
commitTime, operation)
   // Check for errors and commit the write.
   val errorCount = writeStatuses.rdd.filter(ws => ws.hasErrors).count()
@@ -223,7 +224,7 @@ private[hudi] object HoodieSparkSqlWriter {
   )
 
   // Issue deletes
-  commitTime = client.startCommit()
+  client.startCommitWithTime(commitTime)
   writeStatuses = DataSourceUtils.doDeleteOperation(client, 
hoodieKeysToDelete, commitTime)
   val errorCount = writeStatuses.rdd.filter(ws => ws.hasErrors).count()
   writeSuccessful =

[jira] [Updated] (HUDI-441) Rename WorkflowDagGenerator and some class names in test package

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HUDI-441:

Labels: pull-request-available  (was: )

> Rename WorkflowDagGenerator and some class names in test package
> 
>
> Key: HUDI-441
> URL: https://issues.apache.org/jira/browse/HUDI-441
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>  Components: Testing
>Reporter: vinoyang
>Assignee: vinoyang
>Priority: Major
>  Labels: pull-request-available
>
> There are some classes which exist naming issues such as 
> {{WorkflowDagGenerator}} and {{TestComplexDag}}. We should fix them.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[GitHub] [incubator-hudi] yanghua opened a new pull request #1117: [HUDI-441] Rename WorkflowDagGenerator and some class names in test package

[GitBox]

yanghua opened a new pull request #1117: [HUDI-441] Rename WorkflowDagGenerator 
and some class names in test package
URL: https://github.com/apache/incubator-hudi/pull/1117
 
 
   
   
   ## What is the purpose of the pull request
   
   *Rename WorkflowDagGenerator and some class names in test package*
   
   ## Brief change log
   
 - *Rename WorkflowDagGenerator and some class names in test package*
   
   ## Verify this pull request
   
   
   This pull request is a trivial rework / code cleanup without any test 
coverage.
   
   
   ## Committer checklist
   
- [ ] Has a corresponding JIRA in PR title & commit

- [ ] Commit message is descriptive of the change

- [ ] CI is green
   
- [ ] Necessary doc changes done or have another open PR
  
- [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #134

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 2.14 KB...]
/home/jenkins/tools/maven/apache-maven-3.5.4/bin:
m2.conf
mvn
mvn.cmd
mvnDebug
mvnDebug.cmd
mvnyjp

/home/jenkins/tools/maven/apache-maven-3.5.4/boot:
plexus-classworlds-2.5.2.jar

/home/jenkins/tools/maven/apache-maven-3.5.4/conf:
logging
settings.xml
toolchains.xml

/home/jenkins/tools/maven/apache-maven-3.5.4/conf/logging:
simplelogger.properties

/home/jenkins/tools/maven/apache-maven-3.5.4/lib:
aopalliance-1.0.jar
cdi-api-1.0.jar
cdi-api.license
commons-cli-1.4.jar
commons-cli.license
commons-io-2.5.jar
commons-io.license
commons-lang3-3.5.jar
commons-lang3.license
ext
guava-20.0.jar
guice-4.2.0-no_aop.jar
jansi-1.17.1.jar
jansi-native
javax.inject-1.jar
jcl-over-slf4j-1.7.25.jar
jcl-over-slf4j.license
jsr250-api-1.0.jar
jsr250-api.license
maven-artifact-3.5.4.jar
maven-artifact.license
maven-builder-support-3.5.4.jar
maven-builder-support.license
maven-compat-3.5.4.jar
maven-compat.license
maven-core-3.5.4.jar
maven-core.license
maven-embedder-3.5.4.jar
maven-embedder.license
maven-model-3.5.4.jar
maven-model-builder-3.5.4.jar
maven-model-builder.license
maven-model.license
maven-plugin-api-3.5.4.jar
maven-plugin-api.license
maven-repository-metadata-3.5.4.jar
maven-repository-metadata.license
maven-resolver-api-1.1.1.jar
maven-resolver-api.license
maven-resolver-connector-basic-1.1.1.jar
maven-resolver-connector-basic.license
maven-resolver-impl-1.1.1.jar
maven-resolver-impl.license
maven-resolver-provider-3.5.4.jar
maven-resolver-provider.license
maven-resolver-spi-1.1.1.jar
maven-resolver-spi.license
maven-resolver-transport-wagon-1.1.1.jar
maven-resolver-transport-wagon.license
maven-resolver-util-1.1.1.jar
maven-resolver-util.license
maven-settings-3.5.4.jar
maven-settings-builder-3.5.4.jar
maven-settings-builder.license
maven-settings.license
maven-shared-utils-3.2.1.jar
maven-shared-utils.license
maven-slf4j-provider-3.5.4.jar
maven-slf4j-provider.license
org.eclipse.sisu.inject-0.3.3.jar
org.eclipse.sisu.inject.license
org.eclipse.sisu.plexus-0.3.3.jar
org.eclipse.sisu.plexus.license
plexus-cipher-1.7.jar
plexus-cipher.license
plexus-component-annotations-1.7.1.jar
plexus-component-annotations.license
plexus-interpolation-1.24.jar
plexus-interpolation.license
plexus-sec-dispatcher-1.4.jar
plexus-sec-dispatcher.license
plexus-utils-3.1.0.jar
plexus-utils.license
slf4j-api-1.7.25.jar
slf4j-api.license
wagon-file-3.1.0.jar
wagon-file.license
wagon-http-3.1.0-shaded.jar
wagon-http.license
wagon-provider-api-3.1.0.jar
wagon-provider-api.license

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/ext:
README.txt

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/jansi-native:
freebsd32
freebsd64
linux32
linux64
osx
README.txt
windows32
windows64

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/jansi-native/freebsd32:
libjansi.so

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/jansi-native/freebsd64:
libjansi.so

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/jansi-native/linux32:
libjansi.so

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/jansi-native/linux64:
libjansi.so

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/jansi-native/osx:
libjansi.jnilib

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/jansi-native/windows32:
jansi.dll

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/jansi-native/windows64:
jansi.dll
Finished /home/jenkins/tools/maven/apache-maven-3.5.4 Directory Listing :
Detected current version as: 
'HUDI_home=
0.5.1-SNAPSHOT'
[INFO] Scanning for projects...
[INFO] 
[INFO] Reactor Build Order:
[INFO] 
[INFO] Hudi   [pom]
[INFO] hudi-common[jar]
[INFO] hudi-timeline-service  [jar]
[INFO] hudi-hadoop-mr [jar]
[INFO] hudi-client[jar]
[INFO] hudi-hive  [jar]
[INFO] hudi-spark [jar]
[INFO] hudi-utilities [jar]
[INFO] hudi-cli   [jar]
[INFO] hudi-hadoop-mr-bundle  [jar]
[INFO] hudi-hive-bundle   [jar]
[INFO] hudi-spark-bundle  [jar]
[INFO] hudi-presto-bundle [jar]
[INFO] hudi-utilities-bundle  [jar]
[INFO] hudi-timeline-server-bundle

[jira] [Created] (HUDI-441) Rename WorkflowDagGenerator and some class names in test package

[vinoyang (Jira)]

vinoyang created HUDI-441:
-

 Summary: Rename WorkflowDagGenerator and some class names in test 
package
 Key: HUDI-441
 URL: https://issues.apache.org/jira/browse/HUDI-441
 Project: Apache Hudi (incubating)
  Issue Type: Sub-task
  Components: Testing
Reporter: vinoyang
Assignee: vinoyang


There are some classes which exist naming issues such as 
{{WorkflowDagGenerator}} and {{TestComplexDag}}. We should fix them.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Assigned] (HUDI-440) Rework the hudi web site

[lamber-ken (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

lamber-ken reassigned HUDI-440:
---

Assignee: lamber-ken

> Rework the hudi web site
> 
>
> Key: HUDI-440
> URL: https://issues.apache.org/jira/browse/HUDI-440
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>Reporter: lamber-ken
>Assignee: lamber-ken
>Priority: Major
>
> Rework the hudi web site, the old web site is based on jekyll-doc[1] theme
> which is not active, replace it with minimal-mistakes[2] which is very 
> popular and 100% free.
>  
>  
> [1] https://github.com/tomjoht/documentation-theme-jekyll
> [2] https://github.com/mmistakes/minimal-mistakes
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (HUDI-440) Rework the hudi web site

[lamber-ken (Jira)]

lamber-ken created HUDI-440:
---

 Summary: Rework the hudi web site
 Key: HUDI-440
 URL: https://issues.apache.org/jira/browse/HUDI-440
 Project: Apache Hudi (incubating)
  Issue Type: Improvement
Reporter: lamber-ken


Rework the hudi web site, the old web site is based on jekyll-doc[1] theme
which is not active, replace it with minimal-mistakes[2] which is very popular 
and 100% free.
 
 
[1] https://github.com/tomjoht/documentation-theme-jekyll
[2] https://github.com/mmistakes/minimal-mistakes
 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[GitHub] [incubator-hudi] c-f-cooper opened a new issue #1116: lichangfu8...@gmail.com

[GitBox]

c-f-cooper opened a new issue #1116: lichangfu8...@gmail.com
URL: https://github.com/apache/incubator-hudi/issues/1116
 
 
   **_Tips before filing an issue_**
   
   - Have you gone through our 
[FAQs](https://cwiki.apache.org/confluence/display/HUDI/FAQ)?
   
   - Join the mailing list to engage in conversations and get faster support at 
dev-subscr...@hudi.apache.org.
   
   - If you have triaged this as a bug, then file an 
[issue](https://issues.apache.org/jira/projects/HUDI/issues) directly.
   
   **Describe the problem you faced**
   
   A clear and concise description of the problem.
   
   **To Reproduce**
   
   Steps to reproduce the behavior:
   
   1.
   2.
   3.
   4.
   
   **Expected behavior**
   
   A clear and concise description of what you expected to happen.
   
   **Environment Description**
   
   * Hudi version :
   
   * Spark version :
   
   * Hive version :
   
   * Hadoop version :
   
   * Storage (HDFS/S3/GCS..) :
   
   * Running on Docker? (yes/no) :
   
   
   **Additional context**
   
   Add any other context about the problem here.
   
   **Stacktrace**
   
   ```Add the stacktrace of the error.```
   
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[jira] [Commented] (HUDI-251) JDBC incremental load to HUDI with DeltaStreamer

[Purushotham Pushpavanthar (Jira)]

[ 
https://issues.apache.org/jira/browse/HUDI-251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999876#comment-16999876
 ] 

Purushotham Pushpavanthar commented on HUDI-251:


Thanks [~vinoth]. Below are the cWiki usernames
* pushpavanthar
* rushirajchavan

> JDBC incremental load to HUDI with DeltaStreamer
> 
>
> Key: HUDI-251
> URL: https://issues.apache.org/jira/browse/HUDI-251
> Project: Apache Hudi (incubating)
>  Issue Type: New Feature
>  Components: deltastreamer
>Reporter: Taher Koitawala
>Assignee: Purushotham Pushpavanthar
>Priority: Trivial
>  Labels: pull-request-available
> Fix For: 0.5.1
>
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> Mirroring RDBMS to HUDI is one of the most basic use cases of HUDI. Hence, 
> for such use cases, DeltaStreamer should provide inbuilt support.
> DeltaSteamer should accept something like jdbc-source.properties where users 
> can define the RDBMS connection properties along with a timestamp column and 
> an interval which allows users to express how frequently HUDI should check 
> with RDBMS data source for new inserts or updates.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (HUDI-392) Introduce DIstributedTestDataSource to generate test data

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HUDI-392:

Labels: pull-request-available  (was: )

> Introduce DIstributedTestDataSource to generate test data
> -
>
> Key: HUDI-392
> URL: https://issues.apache.org/jira/browse/HUDI-392
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>  Components: Testing
>Reporter: vinoyang
>Assignee: vinoyang
>Priority: Major
>  Labels: pull-request-available
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[GitHub] [incubator-hudi] yanghua opened a new pull request #1115: [HUDI-392] Introduce DIstributedTestDataSource to generate test data

[GitBox]

yanghua opened a new pull request #1115: [HUDI-392] Introduce 
DIstributedTestDataSource to generate test data
URL: https://github.com/apache/incubator-hudi/pull/1115
 
 
   
   ## What is the purpose of the pull request
   
   *Introduce DIstributedTestDataSource to generate test data*
   
   ## Brief change log
   
 - *Introduce DIstributedTestDataSource to generate test data*
   
   ## Verify this pull request
   
   *(Please pick either of the following options)*
   
   
   This change added tests and can be verified as follows:
   
   
 - *TestHoodieTestSuiteJob#testDistributeSourceInsert*
   
   ## Committer checklist
   
- [ ] Has a corresponding JIRA in PR title & commit

- [ ] Commit message is descriptive of the change

- [ ] CI is green
   
- [ ] Necessary doc changes done or have another open PR
  
- [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services