Repository: flume Updated Branches: refs/heads/trunk 630083228 -> 4b6b841ab
Add Impala and Hive recommendation on hdfs.writeFormat setting in the user guide This closes #89 Reviewers: Denes Arvay, Jeff Holoman (Attila Simon via Bessenyei Balázs Donát) Project: http://git-wip-us.apache.org/repos/asf/flume/repo Commit: http://git-wip-us.apache.org/repos/asf/flume/commit/4b6b841a Tree: http://git-wip-us.apache.org/repos/asf/flume/tree/4b6b841a Diff: http://git-wip-us.apache.org/repos/asf/flume/diff/4b6b841a Branch: refs/heads/trunk Commit: 4b6b841ab79162151af8d5e162fcc963f8009c69 Parents: 6300832 Author: Attila Simon <[email protected]> Authored: Fri Nov 18 16:42:14 2016 +0100 Committer: Bessenyei Balázs Donát <[email protected]> Committed: Fri Feb 17 22:12:43 2017 +0000 ---------------------------------------------------------------------- flume-ng-doc/sphinx/FlumeUserGuide.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/flume/blob/4b6b841a/flume-ng-doc/sphinx/FlumeUserGuide.rst ---------------------------------------------------------------------- diff --git a/flume-ng-doc/sphinx/FlumeUserGuide.rst b/flume-ng-doc/sphinx/FlumeUserGuide.rst index afa6625..d863068 100644 --- a/flume-ng-doc/sphinx/FlumeUserGuide.rst +++ b/flume-ng-doc/sphinx/FlumeUserGuide.rst @@ -2012,7 +2012,7 @@ hdfs.fileType SequenceFile File format: currently ``SequenceFile``, ` (2)CompressedStream requires set hdfs.codeC with an available codeC hdfs.maxOpenFiles 5000 Allow only this number of open files. If this number is exceeded, the oldest file is closed. hdfs.minBlockReplicas -- Specify minimum number of replicas per HDFS block. If not specified, it comes from the default Hadoop config in the classpath. -hdfs.writeFormat -- Format for sequence file records. One of "Text" or "Writable" (the default). +hdfs.writeFormat Writable Format for sequence file records. One of ``Text`` or ``Writable``. Set to ``Text`` before creating data files with Flume, otherwise those files cannot be read by either Apache Impala (incubating) or Apache Hive. hdfs.callTimeout 10000 Number of milliseconds allowed for HDFS operations, such as open, write, flush, close. This number should be increased if many HDFS timeout operations are occurring. hdfs.threadsPoolSize 10 Number of threads per HDFS sink for HDFS IO ops (open, write, etc.)
