Implementation of Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning (https://arxiv.org/abs/2210.07565).

Oct 22, 2022. Released the first version of MPMP and the 45 datasets on Google Drive.

python 3.7 is recommended.

pip install transformers==4.11.3
pip install datasets
pip install cma
pip install fastNLP
pip install sklearn
pip install bayesian-optimization
pip install scipy

Please modify the meta path to the directory that contains the datasets in dataconfig.py.

Use the default parameters in run.py to reproduce the training of MPMP.

sh run.sh