- Poster presentation
- Open access
- Published:
A nonparametric Bayesian approach to adaptive sampling of psychometric functions
BMC Neuroscience volume 10, Article number: P353 (2009)
Psychometric functions express the relation between stimuli parameters and responses of subjects. As these functions have to be estimated from experimental data one encounters several difficulties:
1. Standard estimation techniques like the maximum likelihood method (see [1, 2]) result in large biases and it is usually hard to give precise statements about the confidence in the estimates.
2. It is common in the neurosciences that the number of experimental trials is strongly restricted: Data acquisition might be expensive, tested animals or humans might get tired or might learn too quickly, etc.
3. Usually psychometric functions are modeled by function families having only a small number of parameters [1, 2], thus parametric models might imply too strong assumptions about the psychometric function courses.
As an example for the third point, we refer to an ongoing research debate about the time course for early visual processing. For the detection and discrimination impairment of a stimulus by a closely followed second stimulus, two competing models exist (U-shaped vs. monotonically increasing, see [3]) that had been related to special types of experiments each. Recent experimental results, however, demonstrate severe violations of these experimental assumptions [4, 5], but the question whether any of these two models is appropriate at all remains open. A suitable nonparametric inference might help to find better descriptions of the experimental data and finally to develop new models with only a few parameters.
To overcome the problems above, we consider some recent ideas:
1. Making use of Bayesian techniques for estimating psychometric functions gives much more reliable estimates together with trustworthy confidences [6].
2. Adopting the nonparametric approach of multi binning for linking stimuli parameters and their responses for estimating peristimulus time histograms of spike trains [7].
3. Adaptive sampling with respect to maximize the information gain in each sample step should help to exploit a limited number of experimental trials [8].
By incorporating those ideas, we propose a universal estimation technique that will help to detect novel features in psychometric functions when there is only little prior knowledge about the underlying mechanisms.
References
Wichmann FA, Hill NJ: The psychometric function: I. Fitting, sampling, and goodness of fit. Percept Psychophys. 2001, 63: 1293-1313.
Wichmann FA, Hill NJ: The psychometric function: II. Bootstrap-based confidence intervals and sampling. Percept Psychophys. 2001, 63: 1314-1329.
Kolers PA: Intensity and contour effects in visual masking. Vision Res. 1962, 2: 277-294. 10.1016/0042-6989(62)90037-8.
Duangudom V, Francis G, Herzog MA: What is the strength of a mask in visual metacontrast masking?. J Vision. 2007, 7: 1-10. 10.1167/7.1.7.
Francis G, Cho YS: Effects of temporal integration masking on the shape of visual backward functions. J Exp Psychol-Hum Percept Perform. 2008, 34: 1116-1128. 10.1037/0096-1523.34.5.1116.
Kuss M, Jakel F, Wichmann FA: Bayesian inference for psychometric functions. J Vision. 2005, 5: 478-492. 10.1167/5.5.8.
Endres D, Oram M, Schindelin J, Földiák P: Bayesian binning beats approximate alternatives: estimating peri-stimulus time histograms. Advances in Neural Information Processing Systems 20. 2008, Cambridge: MIT Press
Tanner TG, Hill NJ, Rasmussen CE, Wichmann FA: Efficient adaptive sampling of the psychometric function by maximizing information gain. Proceedings of the 8th Tübinger Perception Conference. Edited by: Bülthoff HH, Mallot HA, Ulrich R, Wichmann FA. 2005, Knirsch Verlag: Kirchentellisfurt
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Elze, T., Jost, J. & Poppe, S. A nonparametric Bayesian approach to adaptive sampling of psychometric functions. BMC Neurosci 10 (Suppl 1), P353 (2009). https://doi.org/10.1186/1471-2202-10-S1-P353
Published:
DOI: https://doi.org/10.1186/1471-2202-10-S1-P353