Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add OpenRefactory October 2024 and November 2024 Report #437

Merged
merged 2 commits into from
Dec 3, 2024
Merged

Add OpenRefactory October 2024 and November 2024 Report #437

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
d9e57ce
OpenRefactory October 2024 Report.
openrefactory Nov 5, 2024
3d6b8d6
OpenRefactory November 2024 Report.
openrefactory Dec 3, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions alpha/engagements/2024/OpenRefactory/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,8 @@ This engagement started in July 2023. Reports for 2023 are available here: https
* [July 2024](update-2024-07.md)
* [August 2024](update-2024-08.md)
* [September 2024](update-2024-09.md)
* [October 2024](update-2024-10.md)
* [November 2024](update-2024-11.md)

## Primary Contacts

Expand Down
115 changes: 115 additions & 0 deletions alpha/engagements/2024/OpenRefactory/update-2024-10.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,115 @@
# OpenRefactory Update: October 2024


## Scan Results
Link to results: https://docs.google.com/spreadsheets/d/1K8dc6SrSEoqqh46cFisZM1tiN4CigaXsqkCKfCM8UTs/

We first show the work done month over month. This is followed by the cumulative results. Finally we show language specific breakdown of the cumulative results.


### October
| Month | Dec 2023 | Jan 2024 | Feb 2024 | Mar 2024 | Apr 2024 | May 2024 | Jun 2024 | Jul 2024 | Aug 2024 | Sep 2024 | Oct 2024 |
|--------------------------------------|----------|----------|----------|----------|----------|----------|----------|----------|----------|----------|----------|
| Projects analyzed | 328 | 300 | 530 | 780 | 712 | 785 | 1,198 | 896 | 1,206 | 1,296 | 51 |
| Projects with no bugs | 293 | 279 | 525 | 776 | 708 | 784 | 1,198 | 896 | 1,198 | 1,286 | 37 |
| Total bugs filed | 56 | 13 | 7 | 7 | 4 | 7 | 1 | 0 | 0 | 11 | 17 |
| Security/Reliability bugs filed | 15 | 8 | 6 | 5 | 2 | 5 | 2 | 0 | 1 | 6 | 6 |
| Bugs with a fix suggestion | 50 | 10 | 2 | 2 | 4 | 0 | 1 | 0 | 19 | 7 | 4 |
| Bugs with a PoC exploit | 4 | 1 | 2 | 3 | 0 | 0 | 0 | 0 | 1 | 0 | 2 |
| Fixes merged by maintainers | 27 | 10 | 5 | 3 | 4 | 0 | 1 | 1 | 6 | 7 | 5 |
| Security/Reliability fixes merged | 6 | 6 | 2 | 1 | 0 | 0 | 0 | 1 | 7 | 1 | 3 |
| Fixes ignored by maintainers | 1 | 1 | 1 | 0 | 2 | 0 | 2 | 0 | 6 | 0 | 6 |
| Reports still open | 28 | 2 | 1 | 4 | 0 | 7 | 0 | 0 | 0 | 4 | 6 |


### High Severity Bugs (Cumulative)
| Month | Dec 2023 | Jan 2024 | Feb 2024 | Mar 2024 | Apr 2024 | May 2024 | Jun 2024 | Jul 2024 | Aug 2024 | Sep 2024 | Oct 2024 |
|---------------------------|----------|----------|----------|----------|----------|----------|----------|----------|----------|----------|----------|
| Weak Crypto | 8 | 8 | 8 | 8 | 8 | 8 | 8 | 8 | 9 | 12 | 12 |
| Data Race | 2 | 5 | 5 | 5 | 6 | 6 | 6 | 6 | 6 | 6 | 6 |
| XSS | 5 | 5 | 7 | 8 | 8 | 8 | 8 | 8 | 8 | 8 | 8 |
| Log Injection | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 5 | 5 | 5 |
| Path Manipulation | 0 | 0 | 3 | 5 | 5 | 5 | 5 | 5 | 5 | 5 | 6 |
| Insecure Deserialization | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 3 |
| OS Command Injection | 0 | 0 | 0 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 2 |
| Inappropriate umask | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
| Open Redirect | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
| Security Misconfiguration | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 2 |
| Sensitive Data Leak | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
| SSRF | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
| Null Dereference | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 |
| XXE | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 |
| **TOTAL** | 25 | 29 | 34 | 39 | 40 | 40 | 40 | 40 | 42 | 46 | 51 |



#### 5 High Severity Bugs
- Path Manipulation
(Java) jenkinsci/remoting @ 3261.v9c670a_4748a_9
https://issues.jenkins.io/projects/security/issues/security-3468?filter=allopenissues

- Insecure Deserialization
(Java) testng-team/testng @ 6.8.13
https://github.com/testng-team/testng/security/advisories/ghsa-64q8-xxxx-2fq8

- Security Misconfiguration
(Java) apache/ant @ 1.10.15
https://bz.apache.org/bugzilla/show_bug.cgi?id=69416

- XXE 1
(Java) jenkinsci/jelly @ 1.1-jenkins-20240903
https://issues.jenkins.io/projects/security/issues/security-3475?filter=allissues

- XXE 2
(Java) spring-projects/spring-framework @ 6.1.12
https://github.com/spring-projects/security-advisories/security/advisories/ghsa-76cx-9mr9-hjm8



### Cumulative Data
| Month | Dec 2023 | Jan 2024 | Feb 2024 | Mar 2024 | Apr 2024 | May 2024 | Jun 2024 | Jul 2024 | Aug 2024 | Sep 2024 | Oct 2024 |
|--------------------------------------|-------------|------------|-------------|--------------|--------------|--------------|-------------|-----------------|--------------|--------------|----------|
| Projects analyzed | 1,407 | 1,707 | 2,237 | 3,017 | 3,729 | 4,514 | 5,712 | 6,608 | 7,813 | 9,109 | 9,160 |
| Projects with no bugs | 1,231 | 1,510 | 2,035 | 2,811 | 3,519 | 4,303 | 5,501 | 6,091 | 7,595 | 8,881 | 8,918 |
| Total bugs filed | 224 | 237 | 244 | 251 | 255 | 262 | 263 | 263 | 262 | 273 | 290 |
| Security/Reliability bugs filed | 94 | 102 | 108 | 113 | 115 | 120 | 122 | 122 | 123 | 129 | 135 |
| Total high severity bugs filed | 25 | 29 | 34 | 39 | 40 | 40 | 40 | 40 | 42 | 46 | 51 |
| Bugs with a fix suggestion | 190 | 200 | 202 | 204 | 208 | 208 | 209 | 209 | 228 | 235 | 239 |
| Bugs with a PoC exploit | 26 | 27 | 29 | 32 | 32 | 32 | 32 | 32 | 33 | 33 | 35 |
| Fixes merged by maintainers | 103 (46%) | 113 (47.7%)| 118 (48.4%) | 121 (48.2%) | 125 (49.01%) | 125 (47.7%) | 126 (47.9%) | 127 (48.3%) | 133 (50.76%) | 140 (51.3%) | 145 |
| Security/Reliability fixes merged | 31 (32.9%) | 37 (36.2%) | 39 (36.1%) | 40 (35.4%) | 40 (34.78%) | 40 (33.33%) | 40 (32.8%) | 41 (33.6%) | 48 (39.02%) | 49 (38%) | 52 |
| Fixes ignored by maintainers | 10 (4.5%) | 11 (4.6%) | 12 (4.9%) | 12 (4.78%) | 14 (5.5%) | 14 (5.35%) | 16 (6.08%) | 16 (6.08%) | 22 (8.4%) | 22 (8.06%) | 28 |
| Reports still open | 111 (49.5%) | 113 (47.7%)| 114 (46.7%) | 118 (47.01%) | 116 (45.49%) | 123 (46.95%) | 121 (46%) | 120 (45.62%) | 107 (40.84%) | 111 (40.66%) | 117 |



### Language Specific Data (Cumulative)
| Language | Python | Java | Go | TOTAL |
| ---------------------------------------------- | -------- | ---- | ---- | ----- |
| \# of total projects analyzed | 8,795 | 210 | 155 | 9,160 |
| \# of total zerofix projects | 8,613 | 169 | 136 | 8,918 |
| \# of total bugs filed | 216 | 47 | 27 | 290 |
| \# of total security/reliablity bugs filed | 94 | 28 | 13 | 135 |
| \# of total bugs with fix suggestion | 189 | 27 | 23 | 239 |
| \# of total POC exploit | 27 | 7 | 1 | 35 |
| \# of total merged fixes | 115 | 14 | 16 | 145 |
| \# of total merged security/reliability fixes | 32 | 10 | 10 | 52 |
| \# of total ignored/rejected fixes | 14 | 11 | 3 | 28 |
| \# of total open fixes | 87 | 22 | 8 | 117 |



## Attestations
Link to attestations: https://github.com/OpenRefactory-Inc/attestations. A sample attestation JSON can be found [here](https://github.com/OpenRefactory-Inc/attestations/blob/master/aiohttp/4.0.0a1/2024-04-24/attestation.json).



### Cumulative Data
| Month | Mar 2024 | Apr 2024 | May 2024 | Jun 2024 | Jul 2024 | Aug 2024 | Sep 2024 | Oct 2024 |
|-------------------------------------|----------|----------|----------|----------|----------|----------|----------|----------|
| Total # of Unique Projects | 16 | 282 | 373 | 679 | 867 | 1,154 | 1,436 | 1,436 |
| Total # of Unique Releases/Versions | 75 | 1360 | 1,779 | 3,144 | 3,938 | 5,259 | 6,361 | 6,361 |
| Total # of Generated Attestations | 75 | 738 | 1,492 | 2,788 | 3,770 | 5,474 | 6,484 | 6,484 |

*No automated scanning took place during October 2024, so no attestations were created.

Loading
Loading