Here are tools and software you can use to replicate our work.
We are focusing on two different areas of research, aiming to contribute to the CleverHans repository. These areas are:
- Model inversion attack is the process of either the model parameters or the data used to train the data.
- Model Fooling/Evasion attacks are related to tricking a model into performing considerably worse on basic examples
The below is created by our visualization software. The actual PDF has links to the arxiv papers. For inverting neural networks, the following wording is of relevance:
For fooling neural networks, this is the following papers and relevant work:
$ git clone https://github.com/Lab41/cyphercat.git
$ cd cyphercat
$ virtualenv cyphercat_virtualenv
$ source cyphercat_virtualenv/bin/activate
$ pip install -r requirements.txt
$ ipython kernel install --user --name=cyphercat_virtualenvSelect cyphercat_virtualenv kernel when running Jupyter.
Attack_baselines/ - Baselines for various attack types.
Classification_baselines/ - Baselines for various model architectures on popular datasets.
Utils/ - Contains model definitions, training and evaluation scripts.
Visualizations/ - Scripts for generating taxonomy graphs.
We are using GraphViz for our research in order to get a handle on the papers in the space, as well as describe our research. You can view some of that here. To install visualization tools via Mac, use:
brew install graphviz
pip install graphviz
- Salem, Ahmed, et al. "ML-Leaks: Model and Data Independent Membership Inference Attacks and Defenses on Machine Learning Models." arXiv preprint arXiv:1806.01246 (2018). Link