You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
You can specify the GPU you want to use in the beginning of the command `CUDA_VISIBLE_DEVICES=...`. The script will:
58
+
You can specify the GPU you want to use at the beginning of the command `CUDA_VISIBLE_DEVICES=...`. The script will:
59
59
* Setup ConceptNet (e.g., extract English relations from ConceptNet, merge the original 42 relation types into 17 types)
60
60
* Convert the QA datasets into .jsonl files (e.g., stored in `data/csqa/statement/`)
61
-
* Identify all mentioned concepts in the questions and answers
61
+
* Identify all the mentioned concepts in the questions and answers
62
62
* Extract subgraphs for each q-a pair
63
63
64
64
The script to download and preprocess the [MedQA-USMLE](https://github.com/jind11/MedQA) data and the biomedical knowledge graph based on Disease Database and DrugBank is provided in `utils_biomed/`.
65
65
66
66
### Directly download preprocessed data
67
-
For your convenience, if you don't want to preprocess the data yourself, you can download all the preprocessed data [here](https://drive.google.com/drive/folders/1T6B4nou5P3u-6jr0z6e3IkitO8fNVM6f?usp=sharing). Download them into the top-level directory of this repo and unzip them. Move the `medqa_usmle` and `ddb` folders into the `data/` directory.
67
+
For your convenience, if you don't want to preprocess the data yourself, you can download all the preprocessed data [here](https://drive.google.com/drive/folders/16hEDRfkIaHyldyeUGqKG614fQByNhOPg?usp=sharing). Download them into the top-level directory of this repo and unzip them. Move the `medqa_usmle` and `ddb` folders into the `data/` directory.
68
68
69
69
### Resulting file structure
70
70
@@ -74,7 +74,7 @@ The resulting file structure should look like this:
74
74
.
75
75
├── README.md
76
76
├── data/
77
-
├── cpnet/ (prerocessed ConceptNet)
77
+
├── cpnet/ (preprocessed ConceptNet)
78
78
├── csqa/
79
79
├── train_rand_split.jsonl
80
80
├── dev_rand_split.jsonl
@@ -93,7 +93,7 @@ To train GreaseLM on CommonsenseQA, run
You can download a pretrained GreaseLM model on CommonsenseQA [here](https://drive.google.com/file/d/1QPwLZFA6AQ-pFfDR6TWLdBAvm3c_HOUr/view?usp=sharing), which achieves an IH-dev acc. of `79.0` and an IH-test acc. of `74.0`.
109
+
You can download a pretrained GreaseLM model on CommonsenseQA [here](https://drive.google.com/file/d/1iu-d7Q23tUD_MYcYu9jmJintqtD9LPv_/view?usp=sharing), which achieves an IH-dev acc. of `79.0` and an IH-test acc. of `74.0`.
110
110
111
-
You can also download a pretrained GreaseLM model on OpenbookQA [here](https://drive.google.com/file/d/1-QqyiQuU9xlN20vwfIaqYQ_uJMP8d7Pv/view?usp=sharing), which achieves an test acc. of `84.8`.
111
+
You can also download a pretrained GreaseLM model on OpenbookQA [here](https://drive.google.com/file/d/1mE6hUK2CIAz6wrFucxDaXU913pwdawdv/view?usp=sharing), which achieves a test acc. of `84.8`.
112
112
113
-
You can also download a pretrained GreaseLM model on MedQA-USMLE [here](https://drive.google.com/file/d/1j0QxiBiGbv0s9PhseSly6V6uiHWU5IEt/view?usp=sharing), which achieves an test acc. of `38.5`.
113
+
You can also download a pretrained GreaseLM model on MedQA-USMLE [here](https://drive.google.com/file/d/1-P3hngsRfnflHAay6JnkNke069gYwdVb/view?usp=sharing), which achieves a test acc. of `38.5`.
114
114
115
115
## 5. Evaluating a pretrained model checkpoint
116
116
To evaluate a pretrained GreaseLM model checkpoint on CommonsenseQA, run
0 commit comments