Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue 449: security evaluation process - documentation update #488

Merged
merged 52 commits into from
Feb 23, 2021

Conversation

TheFoxAtWork
Copy link
Contributor

@TheFoxAtWork TheFoxAtWork commented Dec 16, 2020

This issue is to update the existing documentation to reflect a new security evaluation process

Copy link
Collaborator

@JustinCappos JustinCappos left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've read this over and the changes all seem fine to me. I'm missing some context for a few of them, but they are all logical decisions. I imagine we will need further refinement, but this feels like an important step forward!

Copy link
Contributor

@lumjjb lumjjb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome work here! Have a couple nits and requests, if not LGTMed! This is great, love the revamp.

assessments/guide/security-reviewer.md Outdated Show resolved Hide resolved
assessments/README.md Outdated Show resolved Hide resolved
assessments/README.md Show resolved Hide resolved
assessments/README.md Outdated Show resolved Hide resolved
assessments/guide/README.md Outdated Show resolved Hide resolved
assessments/guide/README.md Outdated Show resolved Hide resolved
assessments/guide/security-reviewer.md Outdated Show resolved Hide resolved
@TheFoxAtWork
Copy link
Contributor Author

@lumjjb made the updates u requested, question on one of them

@ultrasaurus
Copy link
Member

thanks for quick response @TheFoxAtWork !

one remaining open question (from above): "Is this [joint review] a separate document now? previously I think we made suggested edits in the self-eval and the rest of the content went in the README"

0x646e78 and others added 2 commits February 15, 2021 09:12
* Update APAC frequency to bi-weekly; add link to cncf calendar.

* suggestions from PR

* Update README.md

Co-authored-by: Sarah Allen <sarah@ultrasaurus.com>

Co-authored-by: DNX <auraltension@riseup.net>
Co-authored-by: Sarah Allen <sarah@ultrasaurus.com>
Copy link
Contributor Author

@TheFoxAtWork TheFoxAtWork left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks for quick response @TheFoxAtWork !

one remaining open question (from above): "Is this [joint review] a separate document now? previously I think we made suggested edits in the self-eval and the rest of the content went in the README"

Below is the list of files/changes and brief summary of where they fit/what they are, @ultrasaurus the self-assessment, joint-review, and joint readme are all separate in the repo. The self-assessment is significantly smaller than the joint-review and intended to be a starting point for less mature projects. The joint review pulls a lot of content from the self-assessment, with an expectation those are updated as appropriate and expanded during the joint-review. The joint-readme is the template to extract the relevant, summarized content from the joint-review for the project's folder in the repo.

  • Github issue template update - name change, content update
  • assessments/README.md - overview of the security review process
  • assessments/guide/README.md - detailed description of the security review process, steps, document links, templates, etc.
  • assessments/guide/joint-readme-template.md - this is the final summary written by the review team that serves as the Project's README.md in the project folder when the security review's joint-review is complete.
  • assessments/guide/joint-review.md - template/outline for the joint-review document that builds on top of the self-assessment. May be used independently from the self-assessment for more mature projects
  • assessments/guide/project-lead.md - updates to the content and naming
  • assessments/guide/review-survey.md - simple survery to ascertain effectiveness and experience of the security review process
  • assessments/guide/security-reviewer.md - updates to the content and naming
  • assessments/guide/self-assessment.md - template/outline for the self-assessment used to later build the joint-review. Recommended for less mature projects looking to initiate security thinking and documentation.

assessments/guide/README.md Outdated Show resolved Hide resolved
TheFoxAtWork and others added 2 commits February 16, 2021 10:42
Co-authored-by: Emily Fox <33327273+TheFoxAtWork@users.noreply.github.com>
@ultrasaurus
Copy link
Member

thanks @TheFoxAtWork for the summary!

The change of separating self-assessment and joint-review documents seems like it will reduce initial effort of project lead and put more work onto the security review team. This seems important since the new process allows for self-assessment and joint-review to be spaced farther apart in time than has been the case in the past. As a past reviewer, I'd be fine with this change if I were to lead a future review.

I think this is on the agenda for the meeting tomorrow, so ok to discuss then. It would be great to capture motivation and check in with past project leads & other reviewers (if you haven't done so already) to validate that they believe this change is an improvement :)

TheFoxAtWork and others added 11 commits February 17, 2021 09:46
Update links to usecases where currently broken
More updates to table of contents
this was apparently not updated a while back, we'll see if we can use settings instead of Admin UI
Update permission for chairs & TLs
we shouldn't use Github UI anymore because that is confusing
add comment to explain better how this works
@lumjjb
Copy link
Contributor

lumjjb commented Feb 22, 2021

@ultrasaurus looks like there were changes made based on your comments, can you verify that your comments have been resolved? I think with that, we should be good to merge soon!

before they were just added to README, but we want them to be the whole repo as is reflected in the comment

Co-authored-by: Brandon Lum <lumjjb@gmail.com>
Copy link
Member

@ultrasaurus ultrasaurus left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Signed-off-by: Brandon Lum <lumjjb@gmail.com>
@lumjjb lumjjb merged commit c6c1cca into cncf:master Feb 23, 2021
@TheFoxAtWork TheFoxAtWork deleted the issue-449-updates branch February 4, 2022 14:59
Michael-Susu12138 pushed a commit to Michael-Susu12138/tag-security that referenced this pull request Dec 12, 2023
* WIP - created self-assessment outline for sandbox projects, modified former outline.md to become joint-evaluation.md for incubating projects pulling references from the self-assessment

* updates per @magnologan thread in slack

* added hands-on review section per issue cncf#449 & cncf#349

* created project README.md template for completion of joint evaluation

* updated joint evaluation per vuln discussion with @magnologan in slacl

* created evaluation survey for post security evaluation (self or joint)

* updated README with new process details

* finished updating the docs to the new process

* updated issue template for new process conventions

* updated with @lumjjb comments

* added @lumjjb recommendations

* Changed 'evaluation' to 'review' per last discussion

* updated new docs with 'review' over 'evaluation'

* More updates to table of contents

More updates to table of contents to fix topic depth

* small wording and formatting

* changes per @ultrasaurus suggestions

* Update APAC frequency to bi-weekly (cncf#529)

* Update APAC frequency to bi-weekly; add link to cncf calendar.

* suggestions from PR

* Update README.md

Co-authored-by: Sarah Allen <sarah@ultrasaurus.com>

Co-authored-by: DNX <auraltension@riseup.net>
Co-authored-by: Sarah Allen <sarah@ultrasaurus.com>

* Update links to usecases

* Update assessments/guide/README.md

* Update security-whitepaper/cloud-native-security-whitepaper.md

Co-authored-by: Emily Fox <33327273+TheFoxAtWork@users.noreply.github.com>

* Add Matt Jarvis as member

* Add Or Azarzar to Members

* Update permission for chairs & TLs

this was apparently not updated a while back, we'll see if we can use settings instead of Admin UI

* add comment to explain better how this works

we shouldn't use Github UI anymore because that is confusing

* add new TLs as repo CODEOWNERS (cncf#541)

before they were just added to README, but we want them to be the whole repo as is reflected in the comment

Co-authored-by: Brandon Lum <lumjjb@gmail.com>

Co-authored-by: Emily Fox <emily.l.fox7.civ@mail.mil>
Co-authored-by: Brandon Lum <lumjjb@gmail.com>
Co-authored-by: Sarah Allen <sarah@ultrasaurus.com>
Co-authored-by: DNX <2435032+0x646e78@users.noreply.github.com>
Co-authored-by: DNX <auraltension@riseup.net>
Co-authored-by: Matt Jarvis <matt@mattjarvis.org.uk>
Co-authored-by: Or Azarzar <or@lightspin.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants