BioGPT is a language model trained for biomedical tasks, it is trained on the PubMed dataset which contains 15 million abstracts.

Teaching machines to understand human language

Biomedical Language Models

Microsoft

<div class="public-DraftStyleDefault-ltr public-DraftStyleDefault-block" style="box-sizing: border-box; font-family: Poppins, sans-serif !important; text-align: inherit; position: relative; margin: 1em 0px; padding: 0px; direction: ltr"><span style="font-family: Poppins, sans-serif !important; margin: 0px; padding: 0px; box-sizing: border-box">BioGPT is a language model trained for biomedical tasks, it is trained on the PubMed dataset which contains 15 million abstracts. BioGPT outperforms larger, more general language models in biomedical language benchmarks.</span></div>
<div class="public-DraftStyleDefault-ltr public-DraftStyleDefault-block" style="box-sizing: border-box; font-family: Poppins, sans-serif !important; text-align: inherit; position: relative; margin: 1em 0px; padding: 0px; direction: ltr"><span style="font-family: Poppins, sans-serif !important; margin: 0px; padding: 0px; box-sizing: border-box; font-weight: bold">Example use case: </span><span style="font-family: Poppins, sans-serif !important; margin: 0px; padding: 0px; box-sizing: border-box">Generate text within the biomedical domain. See examples below.<br><br></span><span style="font-family: Poppins, sans-serif !important; margin: 0px; padding: 0px; box-sizing: border-box; font-weight: bold">Technology: </span><span style="font-family: Poppins, sans-serif !important; margin: 0px; padding: 0px; box-sizing: border-box">GPT-2 backbone<br></span><br><span style="font-weight: bold">Limitations: </span>Sometimes produces false information</div>

BioGPT: Text Generation