You seem to be conflating my role, as Chair, with HARICA and how HARICA evaluates changes in ballots.

I'd like to start off by clarifying that each Member (HARICA as one of the voting Members), reviews each ballot independently and votes after evaluating the changes of each individual ballots. When a ballot passes, this means that each Member must prepare for the changes to be effective as soon as the IPR period is over. This has nothing to do with having 2-3 ballots being added in a single new version of the new Guideline, because the Member has already been aware of the upcoming changes because of the already voted ballot. This is my personal understanding of the situation, and I would even say that it's common sense.

As the Chair, to the best of my ability I interpret the Bylaws, and with the help of the Vice Chairs (who have worked with me as officers for almost two years) I am ultimately responsible for producing the necessary documents and all other activities according to the Bylaws. Aggregating ballots to a single version of a Guideline is not prohibited, it has been used several times already, yet you found an opportunity to attack me personally and imply things for HARICA that are totally irrelevant with this issue.

More answers inline.


On 2020-09-16 6:13 μ.μ., Ryan Sleevi wrote:


On Wed, Sep 16, 2020 at 2:12 AM Dimitris Zacharopoulos (HARICA) <[email protected] <mailto:[email protected]>> wrote:



    On 2020-09-16 2:43 π.μ., Ryan Sleevi wrote:


    On Tue, Sep 15, 2020 at 4:18 PM Dimitris Zacharopoulos (HARICA)
    <[email protected] <mailto:[email protected]>> wrote:



        On 2020-09-15 9:34 μ.μ., Ryan Sleevi wrote:


        Sure, I can do that but in any case I forwarded it the
        argument on the list. I also support this argument that
        aggregating new versions of the documents saves time.


    While you're the only one qualified to measure whether it saves
    time, as a browser, this raises a host of questions for
    understanding how CAs are staying abreast of changes and
    reviewing them. This is actually critical, given that I've seen
    multiple CA incidents where CAs have reported that they have
    trouble staying abreast of changes, even for ballots they voted
    for! So it suggests to me that some of the current ways that CAs
    are keeping up to date are flawed, or lend themselves to easy
    mistakes.


    I hope you realize that this is not related with Forum's
    activities. The Forum produces standards/Guidelines. Whether CAs,
    Relying Parties adhere to those standards/Guidelines and update
    their processes/products is a different issue.


I hope you realize that questions about the working mode of the Forum impacting the ability to make reliable use of the Forum's work product is, of course, essential to the continued value and participation in the Forum.

If the view of the Chair of the Forum is that the Forum should not consider how usable its work product is, which is voluntary standards that can be used by Browsers, then I think it raises deep concerns about the value of the Forum.


I still can't find the relevance of a CA doing its due diligence to review the ballots that were voted, with the production of an aggregated or individual Guideline. Perhaps someone else with better understanding of the issue could rephrase it so I can see how these two are connected. Dean, Wayne, can you please assist here?

    Naturally, if we had the specific member, we could ask them to
    describe their process for staying aware of changes, and why one
    document makes that easier. For example, I'd be deeply concerned
    if a CA was looking at an aggregated SC28+SC35, since they might
    mistake a meaningful normative change as a cleanup or
    clarification, or similarly, mistake or overlook an important
    clarification because they're distracted by logging changes.

    I don't think that's necessary. It seems very reasonable to me
    that reviewing one redline document that introduces changes from
    two or three ballots, is more convenient and simpler than having
    to review two or three redline documents to reach the same result.

    If there are questions about a new requirement or an introduced
    change, the discussion of the specific ballot that introduced the
    change is there for anyone to review and get a better
    understanding on the rationale and get clarifications. In some
    cases, even that is not enough, and we encourage people to submit
    questions to the [email protected]
    <mailto:[email protected]>, or if these questions come from
    Members, they can post questions directly to the WG public mailing
    list.


I am concerned that you're allowing your personal judgement, which unfortunately is seemingly clouded by confusion of the issues, to impair your ability to effectively and respectfully Chair, by selectively picking and choosing which viewpoints are respected.

My "personal judgement" on this topic was after consulting with the Vice Chairs and having exercised this practice 3-4 times already, publicly and transparently. So I don't understand where all this is suddenly coming from. If you had concerns about this practice, you had several opportunities to express them. Nevertheless, you expressed your concerns now, so we are discussing, publicly, to see if your concerns are well founded so we can make progress addressing them.


I realize you believe it's very reasonable, but that appears to be a lack of familiarity with the issues we, as browsers, are seeing. As a Forum CA Member, that's concerning for HARICA, but as a Chair, that's even more inexcusable.

No, that's not the case at all. It wasn't just me that though it's very reasonable. As I already mentioned, we had a discussion with the vice Chairs before following this aggregation practice. Right now, you are the only person that thinks that aggregating the final Guideline is not reasonable.


Ballots are specifically produced to group their logical related changes within a single ballot, to make it clear the many related things that need to change in order to accomplish a particular goal, as stated in the Ballot. The aggregation approach destroys that contextually relevant information.

The aggregation approach is only in the final Guideline, not the ballot. Each ballot is voted independently and each CA Member knows the changes that are voted on.


Your further suggestion that it's confusion that a CA is actively aware of, and thus can and should avail themselves of questions, when that cannot be further from what I stated. It is the lack of awareness that causes the issue, and this lack of awareness is heightened by the increasing number of changes that come in aggregation.


This doesn't make much sense to me. The changes will become effective on the same day, regardless if we publish 1 version of the Guideline or 3. Awareness-wise, it's the same and I would argue that it's easier for a CA to send one updated document to their compliance department to check what becomes effective, than three documents. All the important information for each change is in the independent ballots that don't just include the changes but also some rationale and even discussion that takes place before the vote.

The Chair has no control of when ballots enter the discussion and voting period. Proposers should be aware of other ballots being in the discussion period and should know when additional changes will become effective almost at the same time.

If proposers believe that the volume of changes is a critical point to adoption from the CAs, then it would make more sense to break down ballots, like the browser alignment ballot, into smaller ones, with enough time in between, so that CAs can adapt to fewer changes before introducing another set of changes.

As a member, HARICA represented that it was overloaded with reviewing changes, and concerned about the quality of results at the continued cadence in light of COVID. I would expect that you (HARICA), of all organizations, should thus be familiar with the risk of many changes causing important changes to be *overlooked*, rather than misunderstood.

HARICA was overloaded and thus we respectfully requested from the SCWG and the proposer of a particular ballot, to delay the voting so we can have more time to review the changes of *the Ballot*. Once the ballot passed, it means it will eventually become effective. It will become effective when the next version of the Guideline document is published. Whether that document contains changes of more than one ballot, is not an issue, because as a CA HARICA has to adapt and comply with everything that this document introduces.


Ultimately, I understand that you, individually, have a workmode that works for you. However, that workmode is demonstrably not working in industry. As Chair, I'm requesting you do not impose your preferences on the Forum, particularly when doing so impairs and impacts the ability for CAs to adhere to these Guidelines, and thus greatly diminishes the value of the Forum as a producer of such documents.

Wait, are you implying that the aggregation of guidelines has anything to do with impacting the ability for CAs to adhere to the produced Guidelines? And you are accusing me of being responsible for that? I hope this is just another misunderstanding otherwise I would kindly ask this to be clarified by the Vice Chairs because this sound like an unfounded accusation.


Again, the relevance of the Forum is how well it serves industry, and that has to be acknowledged as being how well its voluntary Guidelines, such as the Baseline Requirements, provide value to browser members as an alternative to direct vendor auditing, as practiced in many other ISMS-vendor relationships.

Aggregated guidelines or separate guidelines, the result is the same, the work product is the same, Browser Members will effectively supervise the same requirements whether that is in one or three documents being published on the same day. They will supervise the last version of the Guideline that will include the changes of the other two, so I honestly don't understand why we seem to have such a big disconnect.

    My priority here is to serve the SCWG and the Forum in a compliant
    and productive manner. If the SCWG Members have no objection to
    the current practice of aggregating Final Guidelines when we have
    timelines that permit this aggregation, I will continue with this
    practice.


Our concern is with aggregation, and while we recognize the value it brings to making the Chair's role easier, our belief is that it actively harms compliance and comprehension, and thus request you stop.

Ok, then we will stop this practice going forward. That's all you had to say. I expect Members to raise concerns when they think something is off. I don't consider me, or Dean, or Wayne to be perfect in interpreting the Forum's documents although in this particular case we decided on a practice that was not forbidden (you also agreed to that), had good reasons to do it, and went ahead with it without objections from Members.

Despite personally feeling that the final result is ultimately the same, I will respect your request and stop this practice.

        Can you point me to where you believe this practice is forbidden?


    Can you mention where I said it was forbidden? I'm not sure how
    best to answer your question, and so I think this might require
    disentangling what you think I said versus what I said.

    Perhaps I misunderstood this particular statement:

      * "The IP review necessitates the production of the Final
        document, so that sounds like more work, rather than less, and
        it seems to run in the same problem of commingling outputs."

    I'm glad we are in agreement that this practice is not forbidden
    and, of course, not required.

I hope you can recognize the logical fallacy in your statement, which I hope we can chalk to ignorance rather than malice.

You indeed misunderstood the statement, which is discussing Section 4.1 of the IPR policy.


I used your words. You said "there's nothing in our IP policy I'm aware of that requires you to send them as a combined review." and I believe you implied it was not forbidden. I may have expressed it in bad English so you can address it to anything else other than malice. Even the fact that you would consider me being "malicious" after my efforts and contributions to this Forum, makes me sad and disappointed.

        I honestly don't mind the extra work of creating more
        Guidelines but it seems pointless to create a document that
        nobody will ever read because it will be valid for just a few
        seconds.


    I described, at length, why it was meaningful, from both an IP
    perspective and from a document versioning perspective. It
    sounded like you agreed with, or at least understood, those
    challenges, so I'm not sure I understand what you're trying to
    say here.

    What I'm trying to say is that creating a document with version
    1.2.2 and 5 minutes later another with version 1.2.3, makes 1.2.2
    valid for just 5 minutes because everyone will just download and
    read 1.2.3 that incorporates the changes introduced in 1.2.2. It
    seems meaningless (from a practical standpoint) to create 1.2.2
    since it will not be of use by almost anyone.


I've repeatedly described to you how it's used, and you repeatedly appear to be dismissive of this. At this point, it's unclear to me whether this is deliberate, but I would encourage you that if something isn't clear to you, perhaps forming questions rather than stating absolutes would be useful.

This goes back to the questions you dismissed as outside the remit of the Forum at the outset, so perhaps by not being so dismissive, we can find common ground. Understanding the value of 1.2.2 vs 1.2.3 necessitates understanding how CAs are reviewing and integrating changes, and working to identify what good practices are to ensure good compliance. What we unambiguously know is that present practices are failing, and most recently, related to an aggregated version you produced. I'm sure it's easy to dismiss this as the "problem of the CA", but the very purpose of incident reports is to help effect systemic change. One of the systemic issues involves understanding how the work product is consumed, and that's absolutely in the realm of a Forum designed to help encourage good practices.

I already responded to that earlier.

        Documents with the *same effective date* would create a lot
        of confusion to CAs and Relying Parties.


    I'm also not really sure I understand this. It appears you're
    saying here that CAs ignore the version, and focus on the date,
    while in the past, you've specifically objected to changes in
    versioning, because you've argued that CAs focus on the version.

    Are you saying that having a BRs 1.2.0, 1.2.1, and 1.2.2, and
    1.2.3 creates a lot of confusion to CAs and Relying Parties?
    Because that's /four/ versions within the 3 day window of the
    Bylaws. (14 Oct - 16 Oct).
    But if the review periods end Oct 14 - 16, I will prefer to spend
    one day working with the final guidelines and post the results. I
    probably don't want to spend one day producing 1.2.1, publish the
    resulting document to the mailing lists, update the web site, then
    do the same the next day for 1.2.2. This means that all these
    Guidelines will be sent (and thus become effective) on -say- 16 Oct.


OK, so don't run for Chair then?

Wow! After all the work I did for this Forum, is this what I deserve? This statement made me even more disappointed and sad. I hope other Members don't feel the same way about my work at the Forum and how I exercised my duties as Chair.

    From a compliance perspective, all 4 documents (with 4 distinct
    versions) would be effective on 16 Oct which might create
    challenges and confusion. I would like to avoid that an either
    aggregate or ensure we have different effective dates so that at
    every single day there is one and only one normative version of
    the Guideline in effect. Hope this makes more sense then the
    previous attempt.


Thanks. Then it is clear that your argument has limited basis in demonstrated reality, as you appear to be unaware of it being harmful, and appear to be shutting down discussion about improving it.

I believe your assumptions that aggregating guidelines lead CAs to be unable to follow the introduced changes are unfounded, as I explained earlier. CAs have to adapt to the changes that become effective regardless if they are included in 1, 2 or 3 versions of the Guideline being published on the same day. The latest version will include the changes of the previous documents issued on the same day.

In conclusion, as mentioned, we will stop this practice going forward. Please let me know if you would like to reset the Review period and create two separate review notices which will produce two distinct final guidelines and then figure out how to combine them (since both redlines will be against the current version).

Dimitris.

_______________________________________________
Public mailing list
[email protected]
https://lists.cabforum.org/mailman/listinfo/public

Reply via email to