Download:
by Shimon Edelman, Zach Solan, David Horn
http://neuron.tau.ac.il/~horn/./publications/workshopnips03.pdf
Add To MetaCart
Abstract:
We compare our model of unsupervised learning of linguistic structures, ADIOS [1], to some recent work in computational linguistics and in grammar theory. Our approach resembles the Construction Grammar in its general philosophy (e.g., in its reliance on structural generalizations rather than on syntax projected by the lexicon, as in the current generative theories), and the Tree Adjoining Grammar in its computational characteristics (e.g., in its apparent affinity with Mildly Context Sensitive Languages). The representations learned by our algorithm are truly emergent from the (unannotated) corpus data, whereas those found in published works on cognitive and construction grammars and on TAGs are hand-tailored. Thus, our results complement and extend both the computational and the more linguistically oriented research into language acquisition. We conclude by suggesting how empirical and formal study of language can be best integrated.
Citations
|
1133
|
Building a large annotated corpus of English: The Penn Treebank
– Marcus, Santorini, et al.
- 1993
|
|
418
|
Tree-Adjoining Grammars
– Joshi, Schabes
- 1997
|
|
110
|
Beyond Grammar: An experiencebased theory of language
– Bod
- 1998
|
|
91
|
Inducing probabilistic grammars by Bayesian model merging
– Stolcke, Omohundro
- 1994
|
|
79
|
Foundations of language
– Jackendoff
- 2002
|
|
59
|
What is the computational goal of the neocortex
– Barlow
- 1994
|
|
48
|
Grammatical Constructions and Linguistic Generalizations: �e What’s X Doing Y? Construction. Language
– Kay, Filmore
- 1999
|
|
46
|
Sensory mechanisms, the reduction of redundancy, and intelligence
– Barlow
- 1959
|
|
27
|
Unsupervised induction of stochastic contextfree grammars using distributional clustering
– Clark
- 2001
|
|
27
|
Radical Construction Grammar. Syntactic theory in typological perspective
– Croft
- 2001
|
|
25
|
Redundancy reduction as a strategy for unsupervised learning
– Redlich
- 1993
|
|
22
|
Learning Syntax and Meanings through Optimization and Distributional Analysis
– Wolff
- 1988
|
|
22
|
The construction of local grammars
– Gross
- 1997
|
|
18
|
ABL: Alignment-based learning
– Zaanen
- 2000
|
|
18
|
Constructions: A new theoretical approach to language
– Goldberg
- 2003
|
|
15
|
Automatic acquisition and efficient representation of syntactic structures
– Solan, Ruppin, et al.
- 2003
|
|
13
|
A Memory-Based Model of Syntactic Analysis: Data-Oriented Parsing
– Scha, Bod, et al.
- 1999
|
|
12
|
Formal grammar and information theory: Together again
– Pereira
|
|
12
|
Unsupervised Language Acquisition: Theory and Practice
– Clark
- 2001
|
|
11
|
Foundations of cognitive grammar, volume I: theoretical prerequisites
– Langacker
- 1987
|
|
11
|
Natural language grammar induction using a constituent-context model
– Klein, Manning
- 2002
|
|
7
|
The Child Language Exchange System
– MacWhinney, Snow
- 1985
|
|
6
|
Unsupervised efficient learning and representation of language structure
– Solan, Ruppin, et al.
- 2003
|
|
5
|
Variable length markov chains: Methodology, computing and software
– Mächler, Bühlmann
- 2002
|
|
2
|
The character of natural language semantics
– Pietroski
- 2003
|
