The baselines are normally generated towards the middle of November each year and contain all completed citations in MEDLINE as of that date. The baselines represent MEDLINE after the year-end processing has been completed. This means that the records have been revised with the upcoming year's new MeSH vocabulary terms. We currently have available the 2002 - current year MEDLINE/PubMed Baselines. The naming of the baselines represents this year-end processing. For example, the 2002 MEDLINE/PubMed Baseline contains all completed citations from the mid-1960's until the date the baseline was created in late November 2001 with the year-end processing assigning appropriate 2002 MeSH vocabulary terms, thus it is a baseline for the 2002 year.

The baselines also contain citations that are not MEDLINE. All of the baselines we have stored (2002 on) contain "Out-of-scope" citations which were renamed to "PubMed-not-MEDLINE" starting with the 2004 MEDLINE/PubMed Baseline. The PubMed-not-MEDLINE status refers to citations that reside in PubMed from journals included in MEDLINE and have undergone quality review but are not assigned MeSH headings because the cited item is not in scope for MEDLINE either by topic or by date of publication. Citations in the Out-of-scope or PubMed-not-MEDLINE status make up a very small percentage of the total number of citations contained in the baselines (For example, 0.51% or 75,271 records in the 2005 baseline and 1.8% or 323,919 records in the 2009 baseline).

Starting with the 2005 MEDLINE/PubMed Baseline, OLDMEDLINE citations are also included in the baselines. The OLDMEDLINE citations make up approximately 11% of the total number of baseline citations. The OLDMEDLINE citations are from international biomedical journals covering the fields of medicine, preclinical sciences, and allied health sciences. The citations were originally printed in hardcopy indexes published prior to 1966. For additional information, please refer to the following URL: https://www.nlm.nih.gov/databases/databases_oldmedline.html.

In the 2005 baseline the subject indexing from the OLDMEDLINE citations were stored solely in the "Other Term" (or "OT") tagged fields and not the MeSH Terms (or MH) tagged fields. This means that searching the 2005 baseline from our MBR Query Tool via the MH field does not include any OLDMEDLINE citations. The only way to include OLDMEDLINE records in the 2005 baseline is to do a timeframe query without specifying any field specific search criteria. Beginning with the 2006 baseline, Other Terms are starting to be mapped to current MeSH Terms so that searching via the MH field may retrieve some OLDMEDLINE records, but, not necessarily the complete set of possibilities.

Starting with the 2007 MEDLINE/PubMed Baseline, on records where all the OLDMEDLINE terms are converted to MeSH Headings, the citation status changes to MEDLINE. You need to rely on the <CitationSubset>OM</CitationSubset> element to determine if a citation is in the OLDMEDLINE subset.

Select the Baseline year to see the directory listing for that MEDLINE/PubMed Baseline allowing you to download all of the files for that baseline year. The DTDs link is for a gzipped tar file containing all of the required DTD files for that year's baseline files.

We generate a large number of data files during our normal processing of each set of baseline files. We make available the files that we think others might be able to use with the goal of trying to reduce any duplication of effort.

• Frequency Count Files: Represent a complete count of the MEDLINE baseline for each category. For example, the MH_freq_count file represents a count for each unique MeSH Heading found in MEDLINE for the given baseline year. We include an overall count for each term and a count of when the term has been starred (considered an IM or Index Medicus index term which represents the most significant points of an article) when applicable (MH and SH terms only).
        Latest README file describing all of the frequency count files.
        Go to the Frequency Count Download Directory
  
  
• Raw Data Files: Represents all of the MeSH Headings (MH), Subheadings (SH), and Chemicals (NM) terms for each citation within the baseline.
        Latest README file describing all of the raw data files.
        Go to the Raw Data Download Directory
  
  
• Usage History Files: Where we look at the frequency of MeSH Headings assigned to the completed citations during the given baseline based on either their MeSH Treecode(s) or UMLS Semantic Groupings (groups of Semantic Types).
        Latest README file describing all of the usage history files.
        Go to the Usage History Download Directory
  
  
• Stree File: File contains a mapping of MeSH Heading to Semantic Type.
        Latest README file describing all of the Stree files.
        Go to the Stree Download Directory
  
  
• Unique Words: Set of files containing frequency counts of single words and bigram words. The bigram words are made up of a sliding window using the last "valid" word and the current word.
        Latest README file describing all of the Word Count files.
        Go to the Word Count Directory

The MeSH FTP download site: ftp://nlmpubs.nlm.nih.gov/online/mesh/ now includes separate directories for each release year of MeSH. In addition, MeSH created the folder "MESH_FILES" with the latest release files that are updated every morning Monday - Friday. The yearly release folders span from 2011 to the latest full release which occurs in November of the preceding year (for example, 2016 MeSH was released in November of 2015). A single directory is also included for earlier files from 1999-2010.

Semantic Types and Groups: A parsable list of Semantic Types and their abbreviations from the UMLS and a parsable list of Semantic Groups and their mappings to the Semantic Types.
Semantic Types and Groups

The MEDLINE N-gram Set from The SPECIALIST Lexicon. N-grams of size 1 - 5 are identified from all of the Title and Abstract for each MEDLINE citation in baseline.
Latest information on the SPECIALIST Lexicon MEDLINE N-Gram Set

• 2014 N-Gram Set
  
• 2015 N-Gram Set
  
• 2016 N-Gram Set
  
• 2017 N-Gram Set
  
• 2018 N-Gram Set
  
• 2019 N-Gram Set
  
• 2020 N-Gram Set