Knowledge Bases . Structured databases of knowledge usually containing
2
WordNet (Miller 1995)
3
Knowledge Base Incompleteness
4
Relation Extraction w/ Neural Tensor Networks (Socher et al. 2013)
5
Relation Extraction w/ Hyperplane Translation (Wang et al. 2014) • Motivation it is not realistic to assume that al dimensions are relevant to a particular relation • Solution project the word vector…
6
Decomposable Relation Model (Xie et al. 2017)
7
Modeling Distant Supervision Noise in Neural Models (Luo et al. 2017)
8
Modeling Word Embeddings vs. Modeling Relations
9
Tensor Decomposition (Sutskever et al. 2009)
10
Retrofitting of Embeddings to Existing Lexicons (Faruqui et al. 2015)
Description:
Explore the intricacies of knowledge graphs and their applications in natural language processing in this 52-minute lecture from CMU's Neural Nets for NLP 2018 series. Delve into topics such as knowledge bases, structured databases, and WordNet. Examine the challenges of knowledge base incompleteness and learn about various relation extraction techniques, including Neural Tensor Networks and Hyperplane Translation. Discover the Decomposable Relation Model and methods for modeling distant supervision noise in neural models. Compare approaches for modeling word embeddings versus modeling relations, and investigate tensor decomposition. Conclude with an exploration of retrofitting embeddings to existing lexicons, gaining valuable insights into the intersection of knowledge representation and neural network technologies.
Neural Nets for NLP 2018 - Learning from-for Knowledge Graphs