Compliance percentage incorrect when exempted rules pass #267 “best practice!!! #160

Closed
opened 2026-01-19 18:29:27 +00:00 by michael · 2 comments
Owner

Originally created by @BrendaHubbell on GitHub.

Apologies for the mistake. Let's recalculate the compliance percentage considering the exempted rules as passed tests:

Total tests attempted = Number of tests passed + Number of tests failed + Number of exempt rules
= 55 + 69 + 13
= 137

Number of compliant tests = Number of tests passed + Number of exempt rules
= 55 + 13
= 68

Compliance percentage = (Number of compliant tests / Total tests attempted) * 100
= (68 / 137) * 100
≈ 49.64%

Therefore, the correct compliance percentage is approximately 49.64%.

Originally created by @BrendaHubbell on GitHub. Apologies for the mistake. Let's recalculate the compliance percentage considering the exempted rules as passed tests: Total tests attempted = Number of tests passed + Number of tests failed + Number of exempt rules = 55 + 69 + 13 = 137 Number of compliant tests = Number of tests passed + Number of exempt rules = 55 + 13 = 68 Compliance percentage = (Number of compliant tests / Total tests attempted) * 100 = (68 / 137) * 100 ≈ 49.64% Therefore, the correct compliance percentage is approximately 49.64%.
Author
Owner

@bernstei commented on GitHub:

This math makes some assumptions about which tests are in which category, and those are not explicitly specified here. I think the logic in the compliance_count function created by generate_guidance.py is not consistent with the assumptions made here.

@bernstei commented on GitHub: This math makes some assumptions about which tests are in which category, and those are not explicitly specified here. I think the logic in the `compliance_count` function created by `generate_guidance.py` is not consistent with the assumptions made here.
Author
Owner

@brodjieski commented on GitHub:

Closing this issue, as it's a continued discussion of the open issue #267.

@brodjieski commented on GitHub: Closing this issue, as it's a continued discussion of the open issue #267.
Sign in to join this conversation.
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: usnistgov/macos_security#160