It was surprisingly difficult to find the place to download PubMed dataset. After searching around I have finally found the official site for doing so:
XML for Data Mining via FTP
The files below contain XML (and only XML) files for ALL PMC open access articles. These files were created for users who need PMC XML for data mining and processing purposes, but do not need PDFs, images, or supplementary data.
pubmed pubmedcenteral central medline dataset database torrent download data dump pubmed central torrent 2010 download pubmed abstracts