As online markets for the exchange of goods and services become more common, the study of markets composed at least in part of autonomous agents has taken on increasing importance. In contrast to traditional completeinformation economic scenarios, agents that are operating in an electronic marketplace often do so under considerable uncertainty. In order to reduce their uncertainty, these agents must learn about the world around them. When an agent producer is engaged in a learning task in which data collection is costly, such as learning the preferences of a consumer population, it is faced with a classic decision problem: when to explore and when to exploit. If the agent has a limited number of chances to experiment, it must explicitly consider the cost of learning (in terms of foregone profit) against the value of the information acquired. Information goods add an additional dimension to this problem; due to their flexibility, they can be bundled and priced according to a number of different price schedules. An optimizing producer should consider the profit each price schedule can extract, as well as the difficulty of learning of this schedule. In this paper, we demonstrate the tradeoff between complexity and profitability for a number of common price schedules. We begin with a one-shot decision as to which schedule to learn. Schedules with moderate complexity are preferred in the short and medium term, as they are learned quickly, yet extract a significant fraction of the available profit. We then turn to the repeated version of this one-shot decision and show that moderate complexity schedules, in
|
1713
|
Statecharts: A visual formalism for complex systems
– Harel
- 1987
|
|
1673
|
Reinforcement Learning: An Introduction
– Sutton, Barto
- 1998
|
|
607
|
A simplex method for function minimization
– Nelder, Mead
- 1965
|
|
562
|
The Esterel synchronous programming language: Design, semantics, implementation
– Berry, Gonthier
- 1992
|
|
438
|
Origins of Order: Self-Organization and Selection in Evolution
– Kauffman
- 1993
|
|
403
|
An Introduction to Computational Learning Theory
– Kearns, Vazirani
- 1994
|
|
403
|
Numerical recipes
– Press, Flannery, et al.
- 1986
|
|
387
|
Ptolemy: A framework for simulating and prototyping heterogeneous systems
– Buck, Ha, et al.
- 1994
|
|
283
|
The synchronous approach to reactive and real-time systems
– Benveniste, Berry
- 1991
|
|
186
|
The Michigan Internet AuctionBot: A Configurable Auction Server for
– Wurman, Wellman, et al.
- 1998
|
|
103
|
eMediator: A Next Generation Electronic Commerce Server
– Sandholm
- 1999
|
|
100
|
DJC: Introduction to Monte Carlo Methods
– MacKay
|
|
56
|
Hierarchical finite state machines with multiple concurrency models
– Girault, Lee, et al.
- 1999
|
|
39
|
Nonlinear Pricing
– Wilson
- 1993
|
|
37
|
On-line algorithms in machine learning
– Blum
- 1998
|
|
37
|
Monopoly with Incomplete Information
– Maskin, Riley
- 1984
|
|
33
|
Taming heterogeneity—The Ptolemy approach
– Eker, Janneck, et al.
- 2003
|
|
32
|
A two-armed bandit theory of market pricing
– Rothschild
- 1974
|
|
24
|
Optimal Control Systems
– Fe’ldbaum
- 1965
|
|
22
|
SyncCharts: a visual representation of reactive behaviors
– André
- 1996
|
|
20
|
Network delivery of information goods: Optimal pricing of articles and subscriptions
– Chuang, Sirbu
- 1998
|
|
17
|
Automated strategy searches in an electronic goods market: Learning and complex price schedules
– Brooks, Fay, et al.
- 1999
|
|
17
|
MAGNET: A multi-agent contracting system for plan execution
– Collins, Tsvetovatyy, et al.
- 1998
|
|
15
|
Optimal search for the best alternative
– Weitzman
- 1979
|
|
15
|
Modeling of sensor nets in Ptolemy II
– Baldwin, Kohli, et al.
- 2004
|
|
14
|
Pricing Information Bundles in a Dynamic Environment
– Kephart, Brooks, et al.
- 2001
|
|
13
|
Colif: A design representation for application-specific multiprocessor SOCs
– Cesário, Nicolescu, et al.
- 2001
|
|
12
|
A Methodology to design programmable embedded systems
– Kienhuis
- 2001
|
|
11
|
Price wars and niche discovery in an information economy
– Brooks, Durfee, et al.
- 2000
|
|
10
|
Competition Between Firms that Bundle Information Goods,” Working Paper
– Fay, Mackie-Mason
- 1999
|
|
9
|
The koala component model for consumer electronics software
– Ommering, Linden, et al.
- 2000
|
|
8
|
A comparison of Statecharts variants
– Beeck
- 1994
|
|
8
|
The effectiveness of synchronous languages for the development of safety-critical systems. White paper, Esterel Technologies
– Berry
- 2003
|
|
8
|
An End-toEnd Tool Chain for Multi-View Modeling and Analysis of Avionics Mission Computing Software
– Gu, Wang, et al.
- 2003
|
|
7
|
Compositional Modeling in Metropolis
– Goessler, Sangiovanni-Vincentelli
|
|
7
|
Type hierarchies and composition in modeling and meta-modeling languages
– Karsai, Maroti, et al.
- 2004
|
|
7
|
Model-integrated program synthesis environment
– Sztipanovits, Karsai, et al.
- 1996
|
|
4
|
Nonlinear pricing to produce information
– Braden, Oren
- 1994
|
|
4
|
Semantics of S.S.M (Safe State Machine
– André
- 2003
|
|
3
|
Endogenous Differentiation of Information Goods under Uncertainty
– Gazzale, MacKie-Mason
- 2001
|
|
3
|
Thrun and Knut Møller. Active exploration in dynamic environments
– Sebastian
- 1992
|
|
3
|
Sequential Simplex Optimization: A Technique for Improving Quality
– Walters, Parker, et al.
- 1991
|
|
3
|
Models of computation and languages for embedded system design
– Jantsch, Sander
- 2005
|
|
3
|
Leveraging synchronous language principles for heterogeneous modeling and design of embedded systems
– Lee, Zheng
- 2007
|
|
3
|
Synthesizing safe state machines from Esterel
– Prochnow, Traulsen, et al.
- 2006
|
|
2
|
A measure of landscapes
– Hordjik
- 1996
|
|
1
|
Multi-formalism modelling and model transformation for the design of reactive systems
– Feng, Zia, et al.
- 2007
|
|
1
|
Modhel’x: A component-oriented approach to multi- formalism modeling
– Hardebolle, Boulanger
|
|
1
|
Design of traffic light control systems using statecharts
– Huang
|
|
1
|
A graphical variant approach to object-oriented modeling of dynamic systems
– Kinnucan, Mosterman
|