[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/6149 ---

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-25 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r197729438 --- Diff: flink-core/src/test/java/org/apache/flink/core/fs/LimitedConnectionsFileSystemTest.java --- @@ -122,6 +122,42 @@ public void

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-18 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r196008935 --- Diff: flink-core/src/test/java/org/apache/flink/core/fs/LimitedConnectionsFileSystemTest.java --- @@ -122,6 +122,42 @@ public void

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-15 Thread etiennecarriere
Github user etiennecarriere commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195687859 --- Diff: flink-core/src/test/java/org/apache/flink/core/fs/LimitedConnectionsFileSystemTest.java --- @@ -122,6 +122,42 @@ public void

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-15 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195685352 --- Diff: flink-core/src/test/java/org/apache/flink/core/fs/LimitedConnectionsFileSystemTest.java --- @@ -122,6 +122,42 @@ public void

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-15 Thread etiennecarriere
Github user etiennecarriere commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195682592 --- Diff: flink-core/src/main/java/org/apache/flink/core/fs/LimitedConnectionsFileSystem.java --- @@ -940,7 +932,9 @@ public int read() throws

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-15 Thread etiennecarriere
Github user etiennecarriere commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195682578 --- Diff: flink-core/src/test/java/org/apache/flink/core/fs/LimitedConnectionsFileSystemTest.java --- @@ -122,6 +122,42 @@ public void

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-15 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195657899 --- Diff: flink-core/src/main/java/org/apache/flink/core/fs/LimitedConnectionsFileSystem.java --- @@ -940,7 +932,9 @@ public int read() throws

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-15 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195681277 --- Diff: flink-core/src/test/java/org/apache/flink/core/fs/LimitedConnectionsFileSystemTest.java --- @@ -122,6 +122,42 @@ public void

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-14 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195341250 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/CoreOptions.java --- @@ -278,15 +278,15 @@ * Unlimited be default. */

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-14 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195345480 --- Diff: flink-filesystems/flink-hadoop-fs/src/main/java/org/apache/flink/runtime/util/HadoopUtils.java --- @@ -122,4 +125,28 @@ public static boolean

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-14 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195344817 --- Diff: flink-filesystems/flink-s3-fs-hadoop/src/main/java/org/apache/flink/fs/s3hadoop/S3FileSystemFactory.java --- @@ -132,7 +132,12 @@ else if

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-14 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195340311 --- Diff: docs/ops/filesystems.md --- @@ -102,8 +102,8 @@ fs..limit.input: (number, 0/-1 mean no limit) fs..limit.output: (number, 0/-1 mean no limit)

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-14 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195342365 --- Diff: flink-core/src/main/java/org/apache/flink/core/fs/LimitedConnectionsFileSystem.java --- @@ -313,14 +313,22 @@ public int

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-14 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195346228 --- Diff: flink-core/src/main/java/org/apache/flink/core/fs/LimitedConnectionsFileSystem.java --- @@ -1032,19 +1113,50 @@ public

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-13 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195142699 --- Diff: flink-core/src/main/java/org/apache/flink/core/fs/LimitedConnectionsFileSystem.java --- @@ -166,12 +174,47 @@ public

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-13 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195134150 --- Diff: docs/ops/filesystems.md --- @@ -102,6 +102,8 @@ fs..limit.input: (number, 0/-1 mean no limit) fs..limit.output: (number, 0/-1 mean no limit)

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-13 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195138248 --- Diff: flink-core/src/main/java/org/apache/flink/core/fs/LimitedConnectionsFileSystem.java --- @@ -741,6 +804,10 @@ public void write(int b) throws

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-13 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195138105 --- Diff: flink-core/src/main/java/org/apache/flink/core/fs/LimitedConnectionsFileSystem.java --- @@ -731,6 +791,9 @@ public boolean

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-13 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195134228 --- Diff: docs/ops/filesystems.md --- @@ -102,6 +102,8 @@ fs..limit.input: (number, 0/-1 mean no limit) fs..limit.output: (number, 0/-1 mean no limit)

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-13 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195137063 --- Diff: flink-core/src/main/java/org/apache/flink/core/fs/LimitedConnectionsFileSystem.java --- @@ -88,6 +90,12 @@ /** The nanoseconds that a

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-13 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195136244 --- Diff: flink-core/src/main/java/org/apache/flink/core/fs/ConnectionLimitingFactory.java --- @@ -62,7 +62,9 @@ public FileSystem create(URI fsUri)

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-13 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/6149#discussion_r195134923 --- Diff: docs/ops/filesystems.md --- @@ -89,9 +89,9 @@ For example, if the default file system configured as `fs.default-scheme: hdfs:/

[GitHub] flink pull request #6149: [FLINK-9560] Add RateLimiting for FileSystem

2018-06-11 Thread etiennecarriere
GitHub user etiennecarriere opened a pull request: https://github.com/apache/flink/pull/6149 [FLINK-9560] Add RateLimiting for FileSystem ## Contribution Checklist - Make sure that the change passes the automated tests, i.e., `mvn clean verify` passes. You can set up