Sharing Matters: Analysing Neurons Across Languages and Tasks in LLMs

This repository contains the data and codes for our paper "Sharing Matters: Analysing Neurons Across Languages and Tasks in LLMs".

1. Data

Download XNLI data, MzsRE data, fact probing data

2. Neuron Behavior

Behavior Pattern & Behavior-Repeating & Across tokens & Investigation with Threhold

neuron-behavior.ipynb

3. Neuron Attribution

Contribution Score & Effective Score

neuron-attribution.ipynb

Citation

If you find this work is useful or use the data in your work, please consider cite our paper:

@article{wang2024sharing,
  title={Sharing Matters: Analysing Neurons Across Languages and Tasks in LLMs},
  author={Wang, Weixuan and Haddow, Barry and Peng, Wei and Birch, Alexandra},
  journal={arXiv preprint arXiv:2406.09265},
  year={2024}
}