yurakuratov commited on
Commit
855fef0
·
verified ·
1 Parent(s): 93c6676

readme: update bib entry and links - GENA in NAR

Browse files
Files changed (1) hide show
  1. README.md +14 -11
README.md CHANGED
@@ -19,7 +19,7 @@ Differences between GENA-LM (`gena-lm-bigbird-base-sparse-t2t`) and DNABERT:
19
 
20
  Source code and data: https://github.com/AIRI-Institute/GENA_LM
21
 
22
- Paper: https://www.biorxiv.org/content/10.1101/2023.06.12.544594v1
23
 
24
  ## Installation
25
  `gena-lm-bigbird-base-sparse-t2t` sparse ops require DeepSpeed.
@@ -103,19 +103,22 @@ GENA-LM (`gena-lm-bigbird-base-sparse-t2t`) model is trained in a masked languag
103
  We pre-trained `gena-lm-bigbird-base-sparse-t2t` using the latest T2T human genome assembly (https://www.ncbi.nlm.nih.gov/assembly/GCA_009914755.3/). The data was augmented by sampling mutations from 1000-genome SNPs (gnomAD dataset). Pre-training was performed for 800,000 iterations with batch size 256. We modified Transformer with [Pre-Layer normalization](https://arxiv.org/abs/2002.04745).
104
 
105
  ## Evaluation
106
- For evaluation results, see our paper: https://www.biorxiv.org/content/10.1101/2023.06.12.544594v1
107
 
108
  ## Citation
109
  ```bibtex
110
  @article{GENA_LM,
111
- author = {Veniamin Fishman and Yuri Kuratov and Maxim Petrov and Aleksei Shmelev and Denis Shepelin and Nikolay Chekanov and Olga Kardymon and Mikhail Burtsev},
112
- title = {GENA-LM: A Family of Open-Source Foundational Models for Long DNA Sequences},
113
- elocation-id = {2023.06.12.544594},
114
- year = {2023},
115
- doi = {10.1101/2023.06.12.544594},
116
- publisher = {Cold Spring Harbor Laboratory},
117
- URL = {https://www.biorxiv.org/content/early/2023/06/13/2023.06.12.544594},
118
- eprint = {https://www.biorxiv.org/content/early/2023/06/13/2023.06.12.544594.full.pdf},
119
- journal = {bioRxiv}
 
 
 
120
  }
121
  ```
 
19
 
20
  Source code and data: https://github.com/AIRI-Institute/GENA_LM
21
 
22
+ Paper: https://academic.oup.com/nar/article/53/2/gkae1310/7954523
23
 
24
  ## Installation
25
  `gena-lm-bigbird-base-sparse-t2t` sparse ops require DeepSpeed.
 
103
  We pre-trained `gena-lm-bigbird-base-sparse-t2t` using the latest T2T human genome assembly (https://www.ncbi.nlm.nih.gov/assembly/GCA_009914755.3/). The data was augmented by sampling mutations from 1000-genome SNPs (gnomAD dataset). Pre-training was performed for 800,000 iterations with batch size 256. We modified Transformer with [Pre-Layer normalization](https://arxiv.org/abs/2002.04745).
104
 
105
  ## Evaluation
106
+ For evaluation results, see our paper: https://academic.oup.com/nar/article/53/2/gkae1310/7954523
107
 
108
  ## Citation
109
  ```bibtex
110
  @article{GENA_LM,
111
+ author = {Fishman, Veniamin and Kuratov, Yuri and Shmelev, Aleksei and Petrov, Maxim and Penzar, Dmitry and Shepelin, Denis and Chekanov, Nikolay and Kardymon, Olga and Burtsev, Mikhail},
112
+ title = {GENA-LM: a family of open-source foundational DNA language models for long sequences},
113
+ journal = {Nucleic Acids Research},
114
+ volume = {53},
115
+ number = {2},
116
+ pages = {gkae1310},
117
+ year = {2025},
118
+ month = {01},
119
+ issn = {0305-1048},
120
+ doi = {10.1093/nar/gkae1310},
121
+ url = {https://doi.org/10.1093/nar/gkae1310},
122
+ eprint = {https://academic.oup.com/nar/article-pdf/53/2/gkae1310/61443229/gkae1310.pdf},
123
  }
124
  ```