Name | DL | Torrents | Total Size | Joe's Recommended Mirror List [edit] | 233 | 8.28TB | 1955 | 0 | Natural Language Processing Datasets (via ResearchRat) [edit] | 25 | 128.02GB | 90 | 0 | MLNet-alpha [edit] | 8 | 1.75TB | 77 | 0 |
LDC2020T02_Abstract_Meaning_Representation_AMR_Annotation_Release_3.0_NLP.tar.zst | 38.82MB |
Type: Dataset
Tags: Dataset, nlp, natural language, NIST, corpus, annotation, data, text, Annotated, newswire, DARPA, conversation, BOLT, abstract meaning representation, LDC, LDC2017T10, PropBank, weblog, forums, fiction, web text, OpenMT, LORELEI, GALE, DEFT, AMR
Bibtex:
Tags: Dataset, nlp, natural language, NIST, corpus, annotation, data, text, Annotated, newswire, DARPA, conversation, BOLT, abstract meaning representation, LDC, LDC2017T10, PropBank, weblog, forums, fiction, web text, OpenMT, LORELEI, GALE, DEFT, AMR
Bibtex:
@article{, title= {Abstract Meaning Representation AMR Annotation Release 3.0 LDC2017T10}, journal= {}, author= {Kevin Knight and Bianca Badarau and Laura Baranescu and Claire Bonial and Madalina Bardocz and Kira Griffitt and Ulf Hermjakob and Daniel Marcu and Martha Palmer and Tim O'Gorman and Nathan Schneider}, year= {2020}, url= {https://doi.org/10.35111/44cy-bp51}, doi= {10.35111/44cy-bp51}, ldc= {LDC2020T02}, isbn= {1-58563-915-X}, islrn= {676-697-177-821-8}, projects= {ACE, BOLT, DEFT, GALE, LORELEI}, applications= {coreference resolution, entity extraction, information extraction, semantic role labelling}, languages= {English}, abstract= {# Abstract Meaning Representation (AMR) Annotation Release 3.0 - Linguistic Data Consortium ### Introduction Abstract Meaning Representation (AMR) Annotation Release 3.0 was developed by the Linguistic Data Consortium (LDC), [SDL/Language Weaver, Inc.](https://www.sdl.com/software-and-services/translation-software/machine-translation/), the University of Colorado's [Computational Language and Educational Research](https://www.colorado.edu/lab/clear/) group and the [Information Sciences Institute](http://www.isi.edu/home) at the University of Southern California. It contains a sembank (semantic treebank) of over 59,255 English natural language sentences from broadcast conversations, newswire, weblogs, web discussion forums, fiction and web text. This release adds new data to, and updates material contained in, Abstract Meaning Representation 2.0 ([LDC2017T10](https://catalog.ldc.upenn.edu/LDC2017T10)), specifically: more annotations on new and prior data, new or improved PropBank-style frames, enhanced quality control, and multi-sentence annotations. AMR captures "who is doing what to whom" in a sentence. Each sentence is paired with a graph that represents its whole-sentence meaning in a tree-structure. AMR utilizes PropBank frames, non-core semantic roles, within-sentence coreference, named entity annotation, modality, negation, questions, quantities, and so on to represent the semantic structure of a sentence largely independent of its syntax. LDC also released Abstract Meaning Representation (AMR) Annotation Release 1.0 ([LDC2014T12](https://catalog.ldc.upenn.edu/LDC2014T12)), and Abstract Meaning Representation (AMR) Annotation Release 2.0 ([LDC2017T10](https://catalog.ldc.upenn.edu/LDC2017T10)). ### Data The source data includes discussion forums collected for the DARPA BOLT AND DEFT programs, transcripts and English translations of Mandarin Chinese broadcast news programming from China Central TV, Wall Street Journal text, translated Xinhua news texts, various newswire data from NIST OpenMT evaluations and weblog data used in the DARPA GALE program. New source data to AMR 3.0 includes sentences from _Aesop's Fables_, parallel text and the situation frame data set developed by LDC for the DARPA LORELEI program, and lead sentences from Wikipedia articles about named entities. The following table summarizes the number of training, dev, and test AMRs for each dataset in the release. Totals are also provided by partition and dataset: <table summary="summary of AMRs for each dataset"><tbody><tr><td><strong>Dataset</strong></td><td><strong>Training</strong></td><td><strong>Dev</strong></td><td><strong>Test</strong></td><td><strong>Totals</strong></td></tr><tr><td>BOLT DF MT</td><td>1061</td><td>133</td><td>133</td><td>1327</td></tr><tr><td>Broadcast conversation</td><td>214</td><td>0</td><td>0</td><td>214</td></tr><tr><td>Weblog and WSJ</td><td>0</td><td>100</td><td>100</td><td>200</td></tr><tr><td>BOLT DF English</td><td>7379</td><td>210</td><td>229</td><td>7818</td></tr><tr><td>DEFT DF English</td><td>32915</td><td>0</td><td>0</td><td>32915</td></tr><tr><td>Aesop fables</td><td>49</td><td>0</td><td>0</td><td>49</td></tr><tr><td>Guidelines AMRs</td><td>970</td><td>0</td><td>0</td><td>970</td></tr><tr><td>LORELEI</td><td>4441</td><td>354</td><td>527</td><td>5322</td></tr><tr><td>2009 Open MT</td><td>204</td><td>0</td><td>0</td><td>204</td></tr><tr><td>Proxy reports</td><td>6603</td><td>826</td><td>823</td><td>8252</td></tr><tr><td>Weblog</td><td>866</td><td>0</td><td>0</td><td>866</td></tr><tr><td>Wikipedia</td><td>192</td><td>0</td><td>0</td><td>192</td></tr><tr><td>Xinhua MT</td><td>741</td><td>99</td><td>86</td><td>926</td></tr><tr><td>Totals</td><td>55635</td><td>1722</td><td>1898</td><td>59255</td></tr></tbody></table> Data in the "split" directory contains 59,255 AMRs split roughly 93.9%/2.9%/3.2% into training/dev/test partitions, with most smaller datasets assigned to one of the splits as a whole. Note that splits observe document boundaries. The "unsplit" directory contains the same 59,255 AMRs with no train/dev/test partition. ### Samples Please view this [AMR sample](https://catalog.ldc.upenn.edu/desc/addenda/LDC2020T02.txt). ### Acknowledgements From University of Colorado We gratefully acknowledge the support of the National Science Foundation Grant NSF: 0910992 IIS:RI: Large: Collaborative Research: Richer Representations for Machine Translation and the support of Darpa BOLT - HR0011-11-C-0145 and DEFT - FA-8750-13-2-0045 via a subcontract from LDC. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation, DARPA or the US government. From Information Sciences Institute (ISI) Thanks to NSF (IIS-0908532) for funding the initial design of AMR, and to DARPA MRP (FA-8750-09-C-0179) for supporting a group to construct consensus annotations and the AMR Editor. The initial AMR bank was built under DARPA DEFT FA-8750-13-2-0045 (PI: Stephanie Strassel; co-PIs: Kevin Knight, Daniel Marcu, and Martha Palmer) and DARPA BOLT HR0011-12-C-0014 (PI: Kevin Knight). From Linguistic Data Consortium (LDC) This material is based on research sponsored by Air Force Research Laboratory and Defense Advance Research Projects Agency under agreement number FA8750-13-2-0045. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of Air Force Research Laboratory and Defense Advanced Research Projects Agency or the U.S. Government. We gratefully acknowledge the support of Defense Advanced Research Projects Agency (DARPA) Machine Reading Program under Air Force Research Laboratory (AFRL) prime contract no. FA8750-09-C-0184 Subcontract 4400165821. Any opinions, findings, and conclusion or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the view of the DARPA, AFRL, or the US government. From Language Weaver (SDL) This work was partially sponsored by DARPA contract HR0011-11-C-0150 to LanguageWeaver Inc. Any opinions, findings, and conclusion or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the view of the DARPA or the US government. }, keywords= {Dataset, nlp, natural language, NIST, corpus, annotation, data, text, Annotated, newswire, DARPA, conversation, BOLT, AMR, abstract meaning representation, LDC, LDC2017T10, PropBank, weblog, forums, fiction, web text, OpenMT, LORELEI, GALE, DEFT}, terms= {}, license= {}, superseded= {} }