Skip to content

Commit

Permalink
Merge branch 'master' of https://github.com/jphall663/GWU_rml
Browse files Browse the repository at this point in the history
  • Loading branch information
jphall663 committed Jun 24, 2023
2 parents 7a7efad + 719aaff commit 6a74a4a
Showing 1 changed file with 31 additions and 0 deletions.
31 changes: 31 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,7 @@ Materials for a technical, nuts-and-bolts course about increasing transparency,
* Lecture 4: Machine Learning Security
* Lecture 5: Machine Learning Model Debugging
* Lecture 6: Responsible Machine Learning Best Practices
* Lecture 7: Preliminary Risk Mitigation Proposals for Language Models

Corrections or suggestions? Please file a [GitHub issue](https://github.com/jphall663/GWU_rml/issues/new).

Expand Down Expand Up @@ -347,3 +348,33 @@ Discrimination*](https://link.springer.com/content/pdf/10.1007/s10115-011-0463-8
* [NIST AI Risk Management Framework](https://www.nist.gov/itl/ai-risk-management-framework)
* [Interagency Guidance on Model Risk Management (SR 11-7)](https://www.federalreserve.gov/supervisionreg/srletters/sr1107a1.pdf)
* [Responsible AI Practices](https://ai.google/responsibilities/responsible-ai-practices/)

***

## Lecture 7: Preliminary Risk Mitigation Proposals for Language Models

![Past language model incidents.](/img/pastincidents.jpg)

<sub><sup>A number of headlines and images relating to language model incidents. **Source:** [Lecture 7 notes](tex/lecture_7.pdf).</sup></sub>

### Lecture 7 Class Materials

* [Lecture Notes](tex/lecture_7.pdf)

### Lecture 7 Additional Tools

* [BBQ Benchmark](https://github.com/nyu-mll/bbq)
* [DAIR.AI Prompt Engineering Guide](https://www.promptingguide.ai)
* [PAI’s Responsible Practices for Synthetic Media](https://syntheticmedia.partnershiponai.org/)
* [Real Toxicity Prompts](https://allenai.org/data/real-toxicity-prompts)
* [Truthful QA](https://github.com/sylinrl/TruthfulQA)
* [Winogender Schemas](https://github.com/rudinger/winogender-schemas)

### Lecture 7 Additional Reading

* **Introduction and Background**:
* [_Taxonomy of Risks posed by Language Models_](https://dl.acm.org/doi/pdf/10.1145/3531146.3533088)




0 comments on commit 6a74a4a

Please sign in to comment.