Re: [tor-bugs] #24991 [Core Tor/Tor]: relay frequently claiming "missing descriptors for 1/2 of our primary entry guards"

[Tor Bug Tracker & Wiki]

#24991: relay frequently claiming "missing descriptors for 1/2 of our primary 
entry
guards"
-+-
 Reporter:  alecmuffett  |  Owner:  (none)
 Type:  defect   | Status:  closed
 Priority:  Medium   |  Milestone:  Tor:
 |  unspecified
Component:  Core Tor/Tor |Version:  Tor:
 |  0.3.0.1-alpha
 Severity:  Minor| Resolution:  fixed
 Keywords:  single-onion, guards, logging,   |  Actual Points:
  easy, 034-triage-20180328, |
  034-removed-20180328   |
Parent ID:  #23863   | Points:  0.5
 Reviewer:   |Sponsor:
-+-
Changes (by teor):

 * status:  needs_information => closed
 * resolution:   => fixed


Comment:

 It's not perfect, but this code is operating sufficiently well for our
 purposes.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24991 [Core Tor/Tor]: relay frequently claiming "missing descriptors for 1/2 of our primary entry guards"

[Tor Bug Tracker & Wiki]

#24991: relay frequently claiming "missing descriptors for 1/2 of our primary 
entry
guards"
-+-
 Reporter:  alecmuffett  |  Owner:  (none)
 Type:  defect   | Status:
 |  needs_information
 Priority:  Medium   |  Milestone:  Tor:
 |  unspecified
Component:  Core Tor/Tor |Version:  Tor:
 |  0.3.0.1-alpha
 Severity:  Minor| Resolution:
 Keywords:  single-onion, guards, logging,   |  Actual Points:
  easy, 034-triage-20180328, |
  034-removed-20180328   |
Parent ID:  #23863   | Points:  0.5
 Reviewer:   |Sponsor:
-+-

Comment (by starlight):

 Issue arrived, EDT:

 Jun 1 08:04:48 Tor[]: Our directory information is no longer up-to-date
 enough. . .
 Jun 1 08:04:48 Tor[]: I learned some more directory information. . .
 Jun 1 08:04:48 Tor[]: We now have enough directory information to build
 circuits.

 Provided debug log off-ticket due to sensitive content and difficulty of
 obfuscation.  Will provide to any interested dev.

 Looking it over, seems to me the authorities prepare consensus diff
 documents a couple of times each hour and about 50 or so generally arrive.
 Appears some descriptors are overlooked (rather odd odd, perhaps a bug),
 and curiously the handful of missing descriptors contains one of the
 relay's guard nodes about once a day.  The relay requests the missing/out-
 of-date descriptors which arrive shortly and repair the deficit.  What's
 strange is after performing DROPGUARDS it kept happening, implying that a
 significant percentage of guards fall into the "overlooked" group any
 given day.  This is casual observation and could be quite wrong--did not
 delve into it deeply.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24991 [Core Tor/Tor]: relay frequently claiming "missing descriptors for 1/2 of our primary entry guards"

[Tor Bug Tracker & Wiki]

#24991: relay frequently claiming "missing descriptors for 1/2 of our primary 
entry
guards"
-+-
 Reporter:  alecmuffett  |  Owner:  (none)
 Type:  defect   | Status:
 |  needs_information
 Priority:  Medium   |  Milestone:  Tor:
 |  unspecified
Component:  Core Tor/Tor |Version:  Tor:
 |  0.3.0.1-alpha
 Severity:  Minor| Resolution:
 Keywords:  single-onion, guards, logging,   |  Actual Points:
  easy, 034-triage-20180328, |
  034-removed-20180328   |
Parent ID:  #23863   | Points:  0.5
 Reviewer:   |Sponsor:
-+-

Comment (by starlight):

 Problem was no-show today.

 Removed [general] from the logging (98.5% of the log size) and will leave
 it running for a few days to see if it pops.  Will update.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24991 [Core Tor/Tor]: relay frequently claiming "missing descriptors for 1/2 of our primary entry guards"

[Tor Bug Tracker & Wiki]

#24991: relay frequently claiming "missing descriptors for 1/2 of our primary 
entry
guards"
-+-
 Reporter:  alecmuffett  |  Owner:  (none)
 Type:  defect   | Status:
 |  needs_information
 Priority:  Medium   |  Milestone:  Tor:
 |  unspecified
Component:  Core Tor/Tor |Version:  Tor:
 |  0.3.0.1-alpha
 Severity:  Minor| Resolution:
 Keywords:  single-onion, guards, logging,   |  Actual Points:
  easy, 034-triage-20180328, |
  034-removed-20180328   |
Parent ID:  #23863   | Points:  0.5
 Reviewer:   |Sponsor:
-+-

Comment (by teor):

 That log config looks fine.

 Please don't strip the log levels from your logs. Some of those messages
 have different log levels depending on internal state, and I need the log
 levels to debug this issue.

 I think that directory_info_has_arrived() is being called twice, probably
 for the consensus and for descriptors. Unless something else is going
 wrong, that's not a bug.

 But we can improve the log message by saying what kind of directory
 documents we just downloaded.

 I'll know when I see the debug logs.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24991 [Core Tor/Tor]: relay frequently claiming "missing descriptors for 1/2 of our primary entry guards"

[Tor Bug Tracker & Wiki]

#24991: relay frequently claiming "missing descriptors for 1/2 of our primary 
entry
guards"
-+-
 Reporter:  alecmuffett  |  Owner:  (none)
 Type:  defect   | Status:
 |  needs_information
 Priority:  Medium   |  Milestone:  Tor:
 |  unspecified
Component:  Core Tor/Tor |Version:  Tor:
 |  0.3.0.1-alpha
 Severity:  Minor| Resolution:
 Keywords:  single-onion, guards, logging,   |  Actual Points:
  easy, 034-triage-20180328, |
  034-removed-20180328   |
Parent ID:  #23863   | Points:  0.5
 Reviewer:   |Sponsor:
-+-

Comment (by starlight):

 Will log this for tomorrow around the expected time (24hrs + 10min) with

 {{{
 SETCONF LogMessageDomains=1 LogTimeGranularity=1 Log="notice syslog"
 Log="[*]notice [*]info [general,dir,dirserv,guard,heartbeat,consdiff]debug
 file logfile$(date '+%M%S')"
 }}}

 If a category is missing or `SafeLogging=0` should be set please advise.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24991 [Core Tor/Tor]: relay frequently claiming "missing descriptors for 1/2 of our primary entry guards"

[Tor Bug Tracker & Wiki]

#24991: relay frequently claiming "missing descriptors for 1/2 of our primary 
entry
guards"
-+-
 Reporter:  alecmuffett  |  Owner:  (none)
 Type:  defect   | Status:
 |  needs_information
 Priority:  Medium   |  Milestone:  Tor:
 |  unspecified
Component:  Core Tor/Tor |Version:  Tor:
 |  0.3.0.1-alpha
 Severity:  Minor| Resolution:
 Keywords:  single-onion, guards, logging,   |  Actual Points:
  easy, 034-triage-20180328, |
  034-removed-20180328   |
Parent ID:  #23863   | Points:  0.5
 Reviewer:   |Sponsor:
-+-

Comment (by starlight):

 Appears to me recovery is near instantaneous, which provoked the idea it
 might be a race condition in processing logic:

 {{{
 May 26 19:23:34 Tor[]: Heartbeat: Tor's uptime is 5 days 6:00 hours
 May 26 19:25:42 Tor[]: Our directory information is no longer up-to-date
 enough to build circuits: We're missing descriptors for 1/2 of our primary
 entry guards (total microdescriptors: 6346/6383).
 May 26 19:25:42 Tor[]: I learned some more directory information, but not
 enough to build a circuit: We're missing descriptors for 1/2 of our
 primary entry guards (total microdescriptors: 6346/6383).
 May 26 19:25:42 Tor[]: We now have enough directory information to build
 circuits.
 }}}

 {{{
 May 29 07:23:34 Tor[]: Heartbeat: Tor's uptime is 7 days 18:00 hours
 May 29 09:18:44 Tor[]: Our directory information is no longer up-to-date
 enough to build circuits: We're missing descriptors for 1/2 of our primary
 entry guards (total microdescriptors: 6307/6352).
 May 29 09:18:44 Tor[]: I learned some more directory information, but not
 enough to build a circuit: We're missing descriptors for 1/2 of our
 primary entry guards (total microdescriptors: 6307/6352).
 May 29 09:18:45 Tor[]: We now have enough directory information to build
 circuits.
 }}}

 {{{
 May 30 07:23:34 Tor[]: Heartbeat: Tor's uptime is 8 days 18:00 hours
 May 30 09:28:45 Tor[]: Our directory information is no longer up-to-date
 enough to build circuits: We're missing descriptors for 1/2 of our primary
 entry guards (total microdescriptors: 6317/6353).
 May 30 09:28:45 Tor[]: I learned some more directory information, but not
 enough to build a circuit: We're missing descriptors for 1/2 of our
 primary entry guards (total microdescriptors: 6317/6353).
 May 30 09:28:46 Tor[]: We now have enough directory information to build
 circuits.
 }}}

 Could log debug to disk with millisecond resolution if that helps.  Is
 full debug required or would a subsystem or two work?  If the latter
 please indicate which subsystem(s) to log.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24991 [Core Tor/Tor]: relay frequently claiming "missing descriptors for 1/2 of our primary entry guards"

[Tor Bug Tracker & Wiki]

#24991: relay frequently claiming "missing descriptors for 1/2 of our primary 
entry
guards"
-+-
 Reporter:  alecmuffett  |  Owner:  (none)
 Type:  defect   | Status:
 |  needs_information
 Priority:  Medium   |  Milestone:  Tor:
 |  unspecified
Component:  Core Tor/Tor |Version:  Tor:
 |  0.3.0.1-alpha
 Severity:  Minor| Resolution:
 Keywords:  single-onion, guards, logging,   |  Actual Points:
  easy, 034-triage-20180328, |
  034-removed-20180328   |
Parent ID:  #23863   | Points:  0.5
 Reviewer:   |Sponsor:
-+-
Changes (by teor):

 * status:  new => needs_information
 * version:  Tor: 0.3.4.1-alpha => Tor: 0.3.0.1-alpha


Comment:

 (This is a bug on 0.3.0.1-alpha, the earliest version with this issue.)

 You've stripped the times and the log levels from your log, so it's hard
 to analyse this bug.

 {{{
 Our directory information is no longer up-to-date enough to build
 circuits: We're missing descriptors for 1/2 of our primary entry guards
 (total microdescriptors: 6346/6383).
 I learned some more directory information, but not enough to build a
 circuit: We're missing descriptors for 1/2 of our primary entry guards
 (total microdescriptors: 6346/6383).
 We now have enough directory information to build circuits.
 }}}

 These logs show that Tor expires the microdescs for one of its guards,
 then fetches some more microdescs, then finally gets enough to use that
 guard again. How long did it take to recover?

 If it only took a minute or so, then that's ok. Maybe we should downgrade
 the log levels. But they are useful if the descriptor download fails.

 If it took a long time, then maybe we need to make the downloads more
 aggressive.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24991 [Core Tor/Tor]: relay frequently claiming "missing descriptors for 1/2 of our primary entry guards"

[Tor Bug Tracker & Wiki]

#24991: relay frequently claiming "missing descriptors for 1/2 of our primary 
entry
guards"
-+-
 Reporter:  alecmuffett  |  Owner:  (none)
 Type:  defect   | Status:  new
 Priority:  Medium   |  Milestone:  Tor:
 |  unspecified
Component:  Core Tor/Tor |Version:  Tor:
 |  0.3.4.1-alpha
 Severity:  Minor| Resolution:
 Keywords:  single-onion, guards, logging,   |  Actual Points:
  easy, 034-triage-20180328, |
  034-removed-20180328   |
Parent ID:  #23863   | Points:  0.5
 Reviewer:   |Sponsor:
-+-

Comment (by starlight):

 Perhaps the messages result from a race bug between the microdescriptor
 refresh tail-end and network reachable evaluation logic.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24991 [Core Tor/Tor]: relay frequently claiming "missing descriptors for 1/2 of our primary entry guards" (was: relay claims "missing descriptors for 1/2 of our primary entry guards",

[Tor Bug Tracker & Wiki]

#24991: relay frequently claiming "missing descriptors for 1/2 of our primary 
entry
guards"
-+-
 Reporter:  alecmuffett  |  Owner:  (none)
 Type:  defect   | Status:  new
 Priority:  Medium   |  Milestone:  Tor:
 |  unspecified
Component:  Core Tor/Tor |Version:  Tor:
 |  0.3.4.1-alpha
 Severity:  Minor| Resolution:
 Keywords:  single-onion, guards, logging,   |  Actual Points:
  easy, 034-triage-20180328, |
  034-removed-20180328   |
Parent ID:  #23863   | Points:  0.5
 Reviewer:   |Sponsor:
-+-

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs