add lecture 3

README.md

@@ -49,7 +49,7 @@ Corrections or suggestions? Please file a [GitHub issue](https://github.com/jpha
   * [*Accurate Intelligible Models with Pairwise Interactions*](http://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
   * [*This Looks Like That: Deep Learning for Interpretable Image Recognition*](https://arxiv.org/pdf/1806.10574.pdf)
 
-* **Links from Lecture**:
+* **Links from Lecture 1**:
   * [Tay (bot)](https://en.wikipedia.org/wiki/Tay_(bot))
   * [New York Regulator Probes UnitedHealth Algorithm for Racial Bias](https://www.wsj.com/articles/new-york-regulator-probes-unitedhealth-algorithm-for-racial-bias-11572087601)
   * [When a Computer Program Keeps You in Jail](https://www.nytimes.com/2017/06/13/opinion/how-computers-are-harming-criminal-justice.html)
@@ -89,7 +89,7 @@ Corrections or suggestions? Please file a [GitHub issue](https://github.com/jpha
   * **Interpretable Machine Learning** - [Chapter 5](https://christophm.github.io/interpretable-ml-book/agnostic.html) and [Chapter 6](https://christophm.github.io/interpretable-ml-book/example-based.html)
   * [*Towards Better Understanding of Gradient-based Attribution Methods for Deep Neural Networks*](https://arxiv.org/pdf/1711.06104.pdf)
 
-* **Links from Lecture**:
+* **Links from Lecture 2**:
   * [On the Art and Science of Explainable Machine Learning](https://arxiv.org/pdf/1810.02909.pdf)
   * [Access Denied: Faulty Automated Background Checks Freeze Out Renters](https://themarkup.org/locked-out/2020/05/28/access-denied-faulty-automated-background-checks-freeze-out-renters)
   * [ML Attack Cheatsheet](https://github.com/jphall663/secure_ML_ideas/blob/master/img/cheatsheet.png)
@@ -102,6 +102,10 @@ Corrections or suggestions? Please file a [GitHub issue](https://github.com/jpha
 
 ## Lecture 3: Discrimination Testing and Remediation
 
+![Two hundred neural networks from a random grid search trained on the UCI Credit Card Default dataset](/img/lecture_3.png)
+<sub><sup>**Source:** [Lecture 3 Notes](tex/lecture_3.pdf)</sup></sub>
+
+
 ### Lecture 3 Class Materials
 
 * [Lecture Notes]() 
@@ -119,9 +123,9 @@ Corrections or suggestions? Please file a [GitHub issue](https://github.com/jpha
 
 * **Introduction and Background**: 
 
-* **Post-hoc Explanation Techniques**:
+* **Discrimination Testing and Remediation Techniques**:
 
-* **Links from Lecture**:
+* **Links from Lecture 3**:
 
 
 

tex/lecture_3.bib

@@ -1,3 +1,10 @@
+ @article{fair_washing,
+	title = {Fairwashing: the {R}isk of {R}ationalization},
+	author = {A{\"\i}vodji, Ulrich and Arai, Hiromi and Fortineau, Olivier and Gambs, S{\'e}bastien and Hara, Satoshi and Tapp, Alain},
+	journal = {arXiv preprint arXiv:1901.09749},
+	year = {2019}, 
+	note = {URL: \url{https://arxiv.org/pdf/1901.09749.pdf}}}
+
 @inproceedings{gender_shades,
 	title={Gender {S}hades: {I}ntersectional {A}ccuracy {D}isparities in {C}ommercial {G}ender {C}lassification},
 	author={Buolamwini, Joy and Gebru, Timnit},
@@ -39,6 +46,24 @@ @misc{kangdebugging
 	year={2019},
 	note={URL: \url{https://www-cs.stanford.edu/~matei/papers/2018/mlsys_model_assertions.pdf}}}
 
+@article{obermeyer2019dissecting,
+	title={Dissecting {R}acial {B}ias in an {A}lgorithm {U}sed to {M}anage the {H}ealth of {P}opulations},
+	author={Obermeyer, Ziad and Powers, Brian and Vogeli, Christine and Mullainathan, Sendhil},
+	journal={Science},
+	volume={366},
+	number={6464},
+	pages={447--453},
+	year={2019},
+	publisher={American Association for the Advancement of Science},
+	note={URL: \url{https://bit.ly/36XK6yk}}}
+
+@article{scaffolding,
+	title={How {C}an {W}e {F}ool {L}{I}{M}{E} and {S}{H}{A}{P}? {A}dversarial {A}ttacks on {P}ost-hoc {E}xplanation {M}ethods},
+	author={Slack, Dylan and Hilgard, Sophie and Jia, Emily and Singh, Sameer and Lakkaraju, Himabindu},
+	journal={arXiv preprint arXiv:1911.02508},
+	year={2019},
+	note={URL: \url{https://arxiv.org/pdf/1911.02508.pdf}}}
+
 @inproceedings{zemel2013learning,
 	title={Learning {F}air {R}epresentations},
 	author={Zemel, Rich and Wu, Yu and Swersky, Kevin and Pitassi, Toni and Dwork, Cynthia},