Re: [tor-bugs] #25644 [Metrics/CollecTor]: Write white paper about CollecTor's data processing

[Tor Bug Tracker & Wiki]

#25644: Write white paper about CollecTor's data processing
---+---
 Reporter:  iwakeh |  Owner:  irl
 Type:  task   | Status:  closed
 Priority:  Medium |  Milestone:
Component:  Metrics/CollecTor  |Version:
 Severity:  Normal | Resolution:  fixed
 Keywords: |  Actual Points:
Parent ID: | Points:
 Reviewer: |Sponsor:  Sponsor13
---+---
Changes (by irl):

 * status:  accepted => closed
 * resolution:   => fixed


Comment:

 https://research.torproject.org/techreports/modern-
 collector-2018-12-19.pdf

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #25644 [Metrics/CollecTor]: Write white paper about CollecTor's data processing

[Tor Bug Tracker & Wiki]

#25644: Write white paper about CollecTor's data processing
---+---
 Reporter:  iwakeh |  Owner:  irl
 Type:  task   | Status:  accepted
 Priority:  Medium |  Milestone:
Component:  Metrics/CollecTor  |Version:
 Severity:  Normal | Resolution:
 Keywords: |  Actual Points:
Parent ID: | Points:
 Reviewer: |Sponsor:  Sponsor13
---+---
Changes (by irl):

 * owner:  metrics-team => irl
 * status:  assigned => accepted


--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #25644 [Metrics/CollecTor]: Write white paper about CollecTor's data processing (was: Write white paper about CollecTor's data processing (Sponsor13, 1))

[Tor Bug Tracker & Wiki]

#25644: Write white paper about CollecTor's data processing
---+--
 Reporter:  iwakeh |  Owner:  metrics-team
 Type:  task   | Status:  assigned
 Priority:  Medium |  Milestone:
Component:  Metrics/CollecTor  |Version:
 Severity:  Normal | Resolution:
 Keywords: |  Actual Points:
Parent ID: | Points:
 Reviewer: |Sponsor:  Sponsor13
---+--
Changes (by karsten):

 * sponsor:   => Sponsor13


Comment:

 We changed the plan a bit by evaluating a rewrite of CollecTor's
 relaydescs module in Python (#28320). But the remaining report parts
 stayed the same. Keeping this ticket for writing the report after a
 working prototype in Python exists.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #25644 [Metrics/CollecTor]: Write white paper about CollecTor's data processing (Sponsor13, 1)

[Tor Bug Tracker & Wiki]

#25644: Write white paper about CollecTor's data processing (Sponsor13, 1)
---+--
 Reporter:  iwakeh |  Owner:  metrics-team
 Type:  task   | Status:  assigned
 Priority:  Medium |  Milestone:
Component:  Metrics/CollecTor  |Version:
 Severity:  Normal | Resolution:
 Keywords: |  Actual Points:
Parent ID: | Points:
 Reviewer: |Sponsor:
---+--
Changes (by iwakeh):

 * owner:  iwakeh => metrics-team
 * status:  accepted => assigned


--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #25644 [Metrics/CollecTor]: Write white paper about CollecTor's data processing (Sponsor13, 1)

[Tor Bug Tracker & Wiki]

#25644: Write white paper about CollecTor's data processing (Sponsor13, 1)
---+--
 Reporter:  iwakeh |  Owner:  iwakeh
 Type:  task   | Status:  accepted
 Priority:  Medium |  Milestone:
Component:  Metrics/CollecTor  |Version:
 Severity:  Normal | Resolution:
 Keywords: |  Actual Points:
Parent ID: | Points:
 Reviewer: |Sponsor:
---+--

Comment (by iwakeh):

 In 2013 JSR 352 Batch Applications for the Java Platform was finalized.
 As the main implementations are Java EE 7 and Spring Batch these two
 should be covered by this activity.  Other suitable frameworks can be
 found in streaming and data processing fields.  These focus usually on
 real-time processing, which is not CollecTor's concern, but also provide
 solutions for the main batch processing tasks: retrieve from a source,
 process, and write the data.  Thus, we should also take a look at
 [https://flink.apache.org/ Apache's Flink] streaming framework that
 explicitly features its own Batch DataSet API.  Flink is also well
 integrated into Apache's Java tooling/framework environment.

 Thus, the list of batch frameworks we evaluate is Java EE and Spring (as
 JSR 352 implementations) and Flink.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #25644 [Metrics/CollecTor]: Write white paper about CollecTor's data processing (Sponsor13, 1)

[Tor Bug Tracker & Wiki]

#25644: Write white paper about CollecTor's data processing (Sponsor13, 1)
---+--
 Reporter:  iwakeh |  Owner:  iwakeh
 Type:  task   | Status:  accepted
 Priority:  Medium |  Milestone:
Component:  Metrics/CollecTor  |Version:
 Severity:  Normal | Resolution:
 Keywords: |  Actual Points:
Parent ID: | Points:
 Reviewer: |Sponsor:
---+--

Comment (by karsten):

 Replying to [comment:1 iwakeh]:
 > Starting on this with the background from last year's tech report.

 Sounds great!

 > Which frameworks should we not forget to look at?

 Uhhmmm, fine question. How about Java EE and Spring?

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #25644 [Metrics/CollecTor]: Write white paper about CollecTor's data processing (Sponsor13, 1)

[Tor Bug Tracker & Wiki]

#25644: Write white paper about CollecTor's data processing (Sponsor13, 1)
---+--
 Reporter:  iwakeh |  Owner:  iwakeh
 Type:  task   | Status:  accepted
 Priority:  Medium |  Milestone:
Component:  Metrics/CollecTor  |Version:
 Severity:  Normal | Resolution:
 Keywords: |  Actual Points:
Parent ID: | Points:
 Reviewer: |Sponsor:
---+--
Changes (by iwakeh):

 * status:  new => accepted
 * owner:  metrics-team => iwakeh


Comment:

 Starting on this with the background from last year's tech report.

 Which frameworks should we not forget to look at?

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

[tor-bugs] #25644 [Metrics/CollecTor]: Write white paper about CollecTor's data processing (Sponsor13, 1)

[Tor Bug Tracker & Wiki]

#25644: Write white paper about CollecTor's data processing (Sponsor13, 1)
---+--
 Reporter:  iwakeh |  Owner:  metrics-team
 Type:  task   | Status:  new
 Priority:  Medium |  Milestone:
Component:  Metrics/CollecTor  |Version:
 Severity:  Normal |   Keywords:
Actual Points: |  Parent ID:
   Points: |   Reviewer:
  Sponsor: |
---+--
 This should become a Tor Tech Report detailing Tor Metrics data
 collection, aggregation, and presentation as well as an overview of why
 and how data is collected compared to available other frameworks.

 This is activity 1.1 of Sponsor 13 and covers the data pipeline up to
 activity 2 (see ticket #24217).

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs