Kudu: Disable fsnyc in the mini-cluster The Kudu team recommended disabling this for testing purposes. This should help with timeouts in cloud machines (ec2/gce). Disabling fsyncs could lead to data loss if the system crashed before the OS had a chance to write the data to disk. Our test setups don't need that level of reliability.
Change-Id: I72fd85ce5c4bc71f071b854ea6a9ebe60fc1305f Reviewed-on: http://gerrit.cloudera.org:8080/2734 Reviewed-by: Casey Ching <[email protected]> Tested-by: Internal Jenkins Project: http://git-wip-us.apache.org/repos/asf/incubator-impala/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-impala/commit/9bb1b8a3 Tree: http://git-wip-us.apache.org/repos/asf/incubator-impala/tree/9bb1b8a3 Diff: http://git-wip-us.apache.org/repos/asf/incubator-impala/diff/9bb1b8a3 Branch: refs/heads/master Commit: 9bb1b8a3660f5b76f92670d6e0273ca49f41e3b9 Parents: 8311f5e Author: Casey Ching <[email protected]> Authored: Thu Apr 7 19:54:11 2016 -0700 Committer: Tim Armstrong <[email protected]> Committed: Tue Apr 12 14:03:43 2016 -0700 ---------------------------------------------------------------------- testdata/cluster/node_templates/cdh5/etc/kudu/master.conf.tmpl | 5 +++++ testdata/cluster/node_templates/cdh5/etc/kudu/tserver.conf.tmpl | 5 +++++ 2 files changed, 10 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/9bb1b8a3/testdata/cluster/node_templates/cdh5/etc/kudu/master.conf.tmpl ---------------------------------------------------------------------- diff --git a/testdata/cluster/node_templates/cdh5/etc/kudu/master.conf.tmpl b/testdata/cluster/node_templates/cdh5/etc/kudu/master.conf.tmpl index 17b8d0d..3984d43 100644 --- a/testdata/cluster/node_templates/cdh5/etc/kudu/master.conf.tmpl +++ b/testdata/cluster/node_templates/cdh5/etc/kudu/master.conf.tmpl @@ -1,3 +1,8 @@ -fs_wal_dir=${NODE_DIR}/var/lib/kudu/master/wal -fs_data_dirs=${NODE_DIR}/var/lib/kudu/master/data -log_dir=${NODE_DIR}/var/log/kudu/master + +# fsync is disabled for additional speed. Sometimes operations are slow on EC2/GCE test +# machines. Some data loss could occur if the system crashes before the OS has a chance +# to flush data to disk but that is acceptable for development purposes. +-never_fsync http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/9bb1b8a3/testdata/cluster/node_templates/cdh5/etc/kudu/tserver.conf.tmpl ---------------------------------------------------------------------- diff --git a/testdata/cluster/node_templates/cdh5/etc/kudu/tserver.conf.tmpl b/testdata/cluster/node_templates/cdh5/etc/kudu/tserver.conf.tmpl index a39a38e..2625b8a 100644 --- a/testdata/cluster/node_templates/cdh5/etc/kudu/tserver.conf.tmpl +++ b/testdata/cluster/node_templates/cdh5/etc/kudu/tserver.conf.tmpl @@ -3,3 +3,8 @@ -fs_wal_dir=${NODE_DIR}/var/lib/kudu/ts/wal -fs_data_dirs=${NODE_DIR}/var/lib/kudu/ts/data -log_dir=${NODE_DIR}/var/log/kudu/ts + +# fsync is disabled for additional speed. Sometimes operations are slow on EC2/GCE test +# machines. Some data loss could occur if the system crashes before the OS has a chance +# to flush data to disk but that is acceptable for development purposes. +-never_fsync
