[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2020-09-11 Thread Andrey Zagrebin (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194197#comment-17194197
 ] 

Andrey Zagrebin commented on FLINK-6900:


ping [~chesnay]

> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Runtime / Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2019-10-11 Thread Till Rohrmann (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949329#comment-16949329
 ] 

Till Rohrmann commented on FLINK-6900:
--

[~chesnay] is this still a valid problem? Is the PR still up to date?

> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Runtime / Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-12 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083898#comment-16083898
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user NicoK commented on a diff in the pull request:

https://github.com/apache/flink/pull/4110#discussion_r126940120
  
--- Diff: 
flink-metrics/flink-metrics-statsd/src/test/java/org/apache/flink/metrics/statsd/StatsDReporterTest.java
 ---
@@ -60,6 +60,20 @@
 public class StatsDReporterTest extends TestLogger {
 
@Test
+   public void testNameTruncating() {
+   StatsDReporter reporter = new StatsDReporter();
+
+   MetricConfig config = new MetricConfig();
+   config.setProperty(StatsDReporter.ARG_HOST, "localhost");
+   config.setProperty(StatsDReporter.ARG_PORT, "12345");
+   config.setProperty(StatsDReporter.ARG_MAX_COMPONENT_LENGTH, 
"10");
+   
+   reporter.open(config);
+   
+   assertEquals("0123456789", 
reporter.filterCharacters("0123456789DEADBEEF"));
--- End diff --

hmm, seems something was lost during the transfer :(

iirc, I wanted to ask whether it makes sense to also test that things like 
`a.b.0123456789DEADBEEF.c` are properly truncated to `a.b.0123456789.c` for the 
whole metric name


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-12 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083842#comment-16083842
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user greghogan commented on a diff in the pull request:

https://github.com/apache/flink/pull/4110#discussion_r126930326
  
--- Diff: docs/monitoring/metrics.md ---
@@ -376,6 +376,7 @@ Parameters:
 - `dmax` - hard limit for how long an old metric should be retained
 - `ttl` - time-to-live for transmitted UDP packets
 - `addressingMode` - UDP addressing mode to use (UNICAST/MULTICAST)
+- `maxComponentLength` - limits the size of each scope component
--- End diff --

Alright, works for me.


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-12 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083751#comment-16083751
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user zentol commented on a diff in the pull request:

https://github.com/apache/flink/pull/4110#discussion_r126915402
  
--- Diff: 
flink-metrics/flink-metrics-statsd/src/test/java/org/apache/flink/metrics/statsd/StatsDReporterTest.java
 ---
@@ -60,6 +60,20 @@
 public class StatsDReporterTest extends TestLogger {
 
@Test
+   public void testNameTruncating() {
+   StatsDReporter reporter = new StatsDReporter();
+
+   MetricConfig config = new MetricConfig();
+   config.setProperty(StatsDReporter.ARG_HOST, "localhost");
+   config.setProperty(StatsDReporter.ARG_PORT, "12345");
+   config.setProperty(StatsDReporter.ARG_MAX_COMPONENT_LENGTH, 
"10");
+   
+   reporter.open(config);
+   
+   assertEquals("0123456789", 
reporter.filterCharacters("0123456789DEADBEEF"));
--- End diff --

What about the tests?


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-12 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083766#comment-16083766
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user zentol commented on a diff in the pull request:

https://github.com/apache/flink/pull/4110#discussion_r126918307
  
--- Diff: docs/monitoring/metrics.md ---
@@ -376,6 +376,7 @@ Parameters:
 - `dmax` - hard limit for how long an old metric should be retained
 - `ttl` - time-to-live for transmitted UDP packets
 - `addressingMode` - UDP addressing mode to use (UNICAST/MULTICAST)
+- `maxComponentLength` - limits the size of each scope component
--- End diff --

"length of each scope component" would be better, I don't think we us "name 
of scope component" anywhere in the docs.


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-12 Thread Chesnay Schepler (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083761#comment-16083761
 ] 

Chesnay Schepler commented on FLINK-6900:
-

[~aljoscha] this isn't a blocker IMO.

> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-12 Thread Aljoscha Krettek (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083735#comment-16083735
 ] 

Aljoscha Krettek commented on FLINK-6900:
-

[~Zentol] should this be a blocker? Otherwise having 1.3.2 on there doesn't 
make sense anymore because the release should happen soon now.

> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080447#comment-16080447
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user NicoK commented on a diff in the pull request:

https://github.com/apache/flink/pull/4110#discussion_r126443486
  
--- Diff: 
flink-metrics/flink-metrics-statsd/src/test/java/org/apache/flink/metrics/statsd/StatsDReporterTest.java
 ---
@@ -60,6 +60,20 @@
 public class StatsDReporterTest extends TestLogger {
 
@Test
+   public void testNameTruncating() {
+   StatsDReporter reporter = new StatsDReporter();
+
+   MetricConfig config = new MetricConfig();
+   config.setProperty(StatsDReporter.ARG_HOST, "localhost");
+   config.setProperty(StatsDReporter.ARG_PORT, "12345");
+   config.setProperty(StatsDReporter.ARG_MAX_COMPONENT_LENGTH, 
"10");
+   
+   reporter.open(config);
+   
+   assertEquals("0123456789", 
reporter.filterCharacters("0123456789DEADBEEF"));
--- End diff --

...and the additional tests


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080470#comment-16080470
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user greghogan commented on a diff in the pull request:

https://github.com/apache/flink/pull/4110#discussion_r126446702
  
--- Diff: docs/monitoring/metrics.md ---
@@ -376,6 +376,7 @@ Parameters:
 - `dmax` - hard limit for how long an old metric should be retained
 - `ttl` - time-to-live for transmitted UDP packets
 - `addressingMode` - UDP addressing mode to use (UNICAST/MULTICAST)
+- `maxComponentLength` - limits the size of each scope component
--- End diff --

Could this be described as the "length of the name of each scope component" 
rather than simply "size"? I'm not sure that it's immediately obvious what this 
parameter is limiting.


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080449#comment-16080449
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user NicoK commented on a diff in the pull request:

https://github.com/apache/flink/pull/4110#discussion_r126443494
  
--- Diff: 
flink-metrics/flink-metrics-statsd/src/main/java/org/apache/flink/metrics/statsd/StatsDReporter.java
 ---
@@ -193,7 +198,10 @@ private void send(final String name, final String 
value) {
@Override
public String filterCharacters(String input) {
char[] chars = null;
-   final int strLen = input.length();
+   if (input.length() > maxComponentLength) {
+   log.warn("The metric name component {} exceeded the {} 
characters length limit and was truncated.", input, maxComponentLength);
+   }
+   final int strLen = Math.min(input.length(), maxComponentLength);
--- End diff --

same here about the `Math.min`


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080448#comment-16080448
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user NicoK commented on a diff in the pull request:

https://github.com/apache/flink/pull/4110#discussion_r126442516
  
--- Diff: 
flink-metrics/flink-metrics-dropwizard/src/main/java/org/apache/flink/dropwizard/ScheduledDropwizardReporter.java
 ---
@@ -184,7 +188,10 @@ public void notifyOfRemovedMetric(Metric metric, 
String metricName, MetricGroup
@Override
public String filterCharacters(String metricName) {
char[] chars = null;
-   final int strLen = metricName.length();
+   if (metricName.length() > maxComponentLength) {
+   log.warn("The metric name component {} exceeded the {} 
characters length limit and was truncated.", metricName, maxComponentLength);
+   }
+   final int strLen = Math.min(metricName.length(), 
maxComponentLength);
--- End diff --

You actually don't need to call `Math.min()` anymore after you already 
checked the condition for the warning message. You could thus assign `strLen` 
yourself.


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080304#comment-16080304
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user zentol commented on the issue:

https://github.com/apache/flink/pull/4110
  
I've update the PR.
* extended the change to cover the StatsDReporter
* added the warning as requested
* moved the limit into a configurable field
* updated documentation
* added tests


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080223#comment-16080223
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user NicoK commented on the issue:

https://github.com/apache/flink/pull/4110
  
@zentol then +1 after addressing @greghogan's comments (adding a warning + 
using a constant for the `80`)


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-06 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076678#comment-16076678
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user zentol commented on the issue:

https://github.com/apache/flink/pull/4110
  
@NicoK yes, that's how they would be stored in some backends.


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-06 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076674#comment-16076674
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user NicoK commented on the issue:

https://github.com/apache/flink/pull/4110
  
just for clarification, `a.b..c.d` would then be stored 
in `a/b//c/d` so that each component/file/directory is not 
larger than 80?


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-06 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076543#comment-16076543
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user zentol commented on the issue:

https://github.com/apache/flink/pull/4110
  
sure, i can do that.


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-06 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076531#comment-16076531
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user greghogan commented on the issue:

https://github.com/apache/flink/pull/4110
  
That sounds reasonable. Can we add a warning as in #4109 and replace `80` 
with a constant (I see just now in `TaskMetricGroup.java` that `80` is 
hard-coded in the log string rather than using the constant)?


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-06 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076506#comment-16076506
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user zentol commented on the issue:

https://github.com/apache/flink/pull/4110
  
We don't truncate the full identifier, but each individual component before 
assembling the final identifier.

I.e. `a.b..c.d` would become 
`a.b..c.d`.

The primary cause of this currently are the names of WindowOperators or 
long task chains; but given that the sections are partially controlled by the 
user there may be more cases.


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-06 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076484#comment-16076484
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user greghogan commented on the issue:

https://github.com/apache/flink/pull/4110
  
What can cause such a long metric identifier? It seems risky to truncate 
the full identifier which could even completely remove the base name.


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-05 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16075463#comment-16075463
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user zentol commented on the issue:

https://github.com/apache/flink/pull/4110
  
yes it is still required, but this PR does address a similar issue.

#4109 limits the size of the operator name in the metric identifier. This 
was a problem for all reporters, because a 200+ character name just isn't 
manageable.

This PR limits the size of all components of the metric identifier for 
DropwizardReporters, as the backends of several subclasses store metrics in 
files, with each component being one directory., like 
"taskmanager/abcde/job/myjob/task/mytask". Since they are used as names for 
directories they mustn't exceed a certain size (commonly 255). While 
technically a value close to 255 would suffice, i figure that anything above 80 
characters isn't really well manageable as well.


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-07-05 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16075252#comment-16075252
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

Github user greghogan commented on the issue:

https://github.com/apache/flink/pull/4110
  
@zentol since this has not yet been reviewed I'll chance a question: is 
this needed in addition to #4109?


> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.4.0, 1.3.2
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (FLINK-6900) Limit size of indiivual components in DropwizardReporter

2017-06-12 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16046572#comment-16046572
 ] 

ASF GitHub Bot commented on FLINK-6900:
---

GitHub user zentol opened a pull request:

https://github.com/apache/flink/pull/4110

[FLINK-6900] [metrics] Limit size of metric name components

This PR modifies the `ScheduledDropwizardReporter` to limit the size of 
every metric name component to 80 characters, with the same reasoning as #4109.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zentol/flink 6900

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/flink/pull/4110.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #4110






> Limit size of indiivual components in DropwizardReporter
> 
>
> Key: FLINK-6900
> URL: https://issues.apache.org/jira/browse/FLINK-6900
> Project: Flink
>  Issue Type: Improvement
>  Components: Metrics
>Affects Versions: 1.3.0, 1.4.0
>Reporter: Chesnay Schepler
>Assignee: Chesnay Schepler
> Fix For: 1.3.1, 1.4.0
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)