In this article we show how Optimality Theory yields a highly general Constraint Demotion principle for grammar learning. The resulting learning procedure specifically exploits the grammatical structure of Optimality Theory, independent of the content of substantive constraints defining any given grammatical module. We decompose the learning problem and present formal results for a central subproblem, deducing the constraint ranking particular to a target language, given structural descriptions of positive examples. The structure imposed on the space of possible grammars by Optimality Theory allows efficient convergence to a correct grammar. We discuss implications for learning from overt data only, as well as other learning issues. We argue that Optimality Theory promotes confluence of the demands of more effective learnability and deeper linguistic explanation.

Recent experimental work indicates that by the age of ten months, infants have already learned a great deal about the phonotactics (legal sounds and sound sequences) of their language. This learning occurs before infants can utter words or apprehend most phonological alternations. I will show that this early learning stage can be modeled with Optimality Theory. Specifically, the Markedness and Faithfulness constraints can be ranked so as to characterize the phonotactics, even when no information about morphology or phonological alternations is yet available. Later on, the information acquired in infancy can help the child in coming to grips with the alternation pattern. I also propose a procedure for undoing some learning errors that are likely to occur at the earliest stages. There are two formal proposals. One is a constraint ranking algorithm, based closely on Tesar and Smolensky’s Constraint Demotion, which mimics the early, “phonotactics only” form of learning seen in infants. I illustrate the algorithm’s effectiveness by having it learn the phonotactic pattern of a simplified language modeled on Korean. The other proposal is that there are three distinct default rankings for phonological constraints: low for ordinary Faithfulness (used in learning phonotactics); low for Faithfulness to adult forms (in the child’s own production system); and high for output-to-output correspondence constraints.

... document structure can be seen as an extension of Nunberg's `text-grammar'; it is also closely related to `logical' mark-up in languages like HTML and LATEX. We show that by using this intermediate representation, several subtasks in language generation and language understanding can be defined more cleanly.

this article represents a step toward just such a rethinking of the linguistic endeavor.

In this article I present a series of arguments that syntactic structures are built incrementally, in a strict left-to-right order. By assuming incremental structure building it becomes possible to explain the differences between the range of constituents available to different diagnostics of constituency, including movement, ellipsis, coordination, scope and binding. In an incremental derivation structure building creates new constituents, and in doing so may destroy existing constituents. The article presents detailed evidence for the prediction of incremental grammar, that a syntactic process may refer to only those constituents that are present at the point in the derivation when the process applies. Keywords: phrase structure, constituency, incrementality, coordination, binding, scope, ellipsis, movement. 1. Introduction Tests of constituency are basic components of the syntactician's toolbox. By investigating which strings of words can and cannot be moved, deleted...

It has been argued by Shepard that there is a robust psychological law that relates the distance between a pair of items in psychological space and the probability that they will be confused with each other. Specifically, the probability of confusion is a negative exponential function of the distance between the pair of items. In experimental contexts, distance is typically defined in terms of a multidimensional Euclidean space---but this assumption seems unlikely to hold for complex stimuli. We show that, nonetheless, the Universal Law of Generalization can be derived in the more complex setting of arbitrary stimuli, using a much more universal measure of distance. This universal distance is defined as the length of the shortest program that transforms the representations of the two items of interest into one another: the algorithmic information distance. It is universal in the sense that it minorizes every computable distance: it is the smallest computable distance. We show ...

Linguistic ambiguity is the greatest obstacle to achieving practical computational systems for natural language understanding. By contrast, people experience surprisingly little difficulty in interpreting ambiguous linguistic input. This dissertation explores distributed computational techniques for mimicking the human ability to resolve syntactic ambiguities efficiently and effectively. The competitive attachment theory of parsing formulates the processing of an ambiguity as a competition for activation within a hybrid connectionist network. Determining the grammaticality of an input relies on a new approach to distributed communication that integrates numeric and symbolic constraints on passing features through the parsing network. The method establishes syntactic relations both incrementally and efficiently, and underlies the ability of the model to establish long-distance syntactic relations using only local communication within a network. The competitive distribution of numeric ev...

this paper, it is shown that Marcus's "diagnostics" can be handled without any mechanisms beyond what is required to parse grammatical sentences and reject ungrammatical sentences. It is also shown that many other classes of ambiguity can be easily resolved as well

This article presents two self-paced reading experiments which investigate the role of storage costs associated with maintaining incomplete syntactic dependencies in structural ambiguity resolution. We argue that previous work has been equivocal regarding syntactic influences because it has examined ambiguities where there is little or no resource differential between competing alternatives. The candidate structures of the ambiguities explored here incur substantially different storage costs. The results indicate that storage-based biases can be sufficiently powerful to create difficulty for a structural alternative even when it is promoted by nonsyntactic factors. These findings are incorporated into a model of ambiguity resolution in which structural biases operate as independent graded constraints in selecting between structural alternatives.

It is argued that theoretical approaches to the nature of the influence of early experience on personality development have been vitiated by incorrect metaphysical assumptions, of a sort historically characteristic of immature sciences. In particular, mind and mental phenomena are construed in terms of various sorts of substances and structures, instead of in terms of process ontologies. We show that these underlying metaphysical assumptions have prevented the most central problems of the influence of early experience from being addressed, and, therefore, from being answered as well. These aporia seriously infect such contemporary approaches as object relations theory, attachment theory, and cognitive behavioral theory. We outline an alternative process ontology of mind and intentionality — specifically, a process-functional ontology for representation — and explore the form of early influence offered within this new perspective. The Influence of Early Experience