Header logo is ei


2013


no image
A neural population model for visual pattern detection

Goris, R., Putzeys, T., Wagemans, J., Wichmann, F.

Psychological Review, 120(3):472–496, 2013 (article)

DOI [BibTex]

2013

DOI [BibTex]


no image
Accurate indel prediction using paired-end short reads

Grimm, D., Hagmann, J., Koenig, D., Weigel, D., Borgwardt, KM.

BMC Genomics, 14(132), 2013 (article)

Web DOI [BibTex]

Web DOI [BibTex]


no image
Counterfactual Reasoning and Learning Systems: The Example of Computational Advertising

Bottou, L., Peters, J., Quiñonero-Candela, J., Charles, D., Chickering, D., Portugualy, E., Ray, D., Simard, P., Snelson, E.

Journal of Machine Learning Research, 14, pages: 3207-3260, 2013 (article)

Web link (url) [BibTex]

Web link (url) [BibTex]


no image
When luminance increment thresholds depend on apparent lightness

Maertens, M., Wichmann, F.

Journal of Vision, 13(6):1-11, 2013 (article)

DOI [BibTex]

DOI [BibTex]


no image
Efficient network-guided multi-locus association mapping with graph cuts

Azencott, C., Grimm, D., Sugiyama, M., Kawahara, Y., Borgwardt, K.

Bioinformatics, 29(13):i171-i179, 2013 (article)

DOI [BibTex]

DOI [BibTex]


no image
Quantifying causal influences

Janzing, D., Balduzzi, D., Grosse-Wentrup, M., Schölkopf, B.

Annals of Statistics, 41(5):2324-2358, 2013 (article)

Web [BibTex]

Web [BibTex]


no image
Probabilistic movement modeling for intention inference in human-robot interaction

Wang, Z., Mülling, K., Deisenroth, M., Ben Amor, H., Vogt, D., Schölkopf, B., Peters, J.

International Journal of Robotics Research, 32(7):841-858, 2013 (article)

PDF DOI [BibTex]

PDF DOI [BibTex]


no image
Blind Retrospective Motion Correction of MR Images

Loktyushin, A., Nickisch, H., Pohmann, R., Schölkopf, B.

Magnetic Resonance in Medicine (MRM), 70(6):1608–1618, 2013 (article)

DOI [BibTex]

DOI [BibTex]


no image
Modeling fixation locations using spatial point processes

Barthelmé, S., Trukenbrod, H., Engbert, R., Wichmann, F.

Journal of Vision, 13(12):1-34, 2013 (article)

Abstract
Whenever eye movements are measured, a central part of the analysis has to do with where subjects fixate and why they fixated where they fixated. To a first approximation, a set of fixations can be viewed as a set of points in space; this implies that fixations are spatial data and that the analysis of fixation locations can be beneficially thought of as a spatial statistics problem. We argue that thinking of fixation locations as arising from point processes is a very fruitful framework for eye-movement data, helping turn qualitative questions into quantitative ones. We provide a tutorial introduction to some of the main ideas of the field of spatial statistics, focusing especially on spatial Poisson processes. We show how point processes help relate image properties to fixation locations. In particular we show how point processes naturally express the idea that image features' predictability for fixations may vary from one image to another. We review other methods of analysis used in the literature, show how they relate to point process theory, and argue that thinking in terms of point processes substantially extends the range of analyses that can be performed and clarify their interpretation.

Web DOI [BibTex]

Web DOI [BibTex]


no image
A probabilistic model for secondary structure prediction from protein chemical shifts

Mechelke, M., Habeck, M.

Proteins: Structure, Function, and Bioinformatics, 81(6):984–993, 2013 (article)

DOI [BibTex]

DOI [BibTex]


no image
Climate Extremes and the Carbon Cycle

Reichstein, M., Bahn, M., Ciais, P., Frank, D., Mahecha, M., Seneviratne, S., Zscheischler, J., Beer, C., Buchmann, N., Frank, D., Papale, D., Rammig, A., Smith, P., Thonicke, K., van der Velde, M., Vicca, S., Walz, A., Wattenbach, M.

Nature, 500, pages: 287-295, 2013 (article)

DOI [BibTex]

DOI [BibTex]


no image
Identification of stimulus cues in narrow-band tone-in-noise detection using sparse observer models

Schönfelder, V., Wichmann, F.

Journal of the Acoustical Society of America, 134(1):447-463, 2013 (article)

DOI [BibTex]

DOI [BibTex]


no image
Probabilistic Model-based Imitation Learning

Englert, P., Paraschos, A., Peters, J., Deisenroth, M.

Adaptive Behavior Journal, 21(5):388-403, 2013 (article)

PDF DOI [BibTex]

PDF DOI [BibTex]


no image
Metabolic cost as an organizing principle for cooperative learning

Balduzzi, D., Ortega, P., Besserve, M.

Advances in Complex Systems, 16(02n03):1350012, 2013 (article)

Web DOI [BibTex]

Web DOI [BibTex]


no image
MR-based PET Attenuation Correction for PET/MR Imaging

Bezrukov, I., Mantlik, F., Schmidt, H., Schölkopf, B., Pichler, B.

Seminars in Nuclear Medicine, 43(1):45-59, 2013 (article)

DOI [BibTex]

DOI [BibTex]


no image
MR-based Attenuation Correction Methods for Improved PET Quantification in Lesions within Bone and Susceptibility Artifact Regions

Bezrukov, I., Schmidt, H., Mantlik, F., Schwenzer, N., Brendle, C., Schölkopf, B., Pichler, B.

Journal of Nuclear Medicine, 54(10):1768-1774, 2013 (article)

Abstract
Hybrid PET/MR systems have recently entered clinical practice. Thus, the accuracy of MR-based attenuation correction in simultaneously acquired data can now be investigated. We assessed the accuracy of 4 methods of MR-based attenuation correction in lesions within soft tissue, bone, and MR susceptibility artifacts: 2 segmentation-based methods (SEG1, provided by the manufacturer, and SEG2, a method with atlas-based susceptibility artifact correction); an atlas- and pattern recognition–based method (AT&PR), which also used artifact correction; and a new method combining AT&PR and SEG2 (SEG2wBONE). Methods: Attenuation maps were calculated for the PET/MR datasets of 10 patients acquired on a whole-body PET/MR system, allowing for simultaneous acquisition of PET and MR data. Eighty percent iso-contour volumes of interest were placed on lesions in soft tissue (n = 21), in bone (n = 20), near bone (n = 19), and within or near MR susceptibility artifacts (n = 9). Relative mean volume-of-interest differences were calculated with CT-based attenuation correction as a reference. Results: For soft-tissue lesions, none of the methods revealed a significant difference in PET standardized uptake value relative to CT-based attenuation correction (SEG1, −2.6% ± 5.8%; SEG2, −1.6% ± 4.9%; AT&PR, −4.7% ± 6.5%; SEG2wBONE, 0.2% ± 5.3%). For bone lesions, underestimation of PET standardized uptake values was found for all methods, with minimized error for the atlas-based approaches (SEG1, −16.1% ± 9.7%; SEG2, −11.0% ± 6.7%; AT&PR, −6.6% ± 5.0%; SEG2wBONE, −4.7% ± 4.4%). For lesions near bone, underestimations of lower magnitude were observed (SEG1, −12.0% ± 7.4%; SEG2, −9.2% ± 6.5%; AT&PR, −4.6% ± 7.8%; SEG2wBONE, −4.2% ± 6.2%). For lesions affected by MR susceptibility artifacts, quantification errors could be reduced using the atlas-based artifact correction (SEG1, −54.0% ± 38.4%; SEG2, −15.0% ± 12.2%; AT&PR, −4.1% ± 11.2%; SEG2wBONE, 0.6% ± 11.1%). Conclusion: For soft-tissue lesions, none of the evaluated methods showed statistically significant errors. For bone lesions, significant underestimations of −16% and −11% occurred for methods in which bone tissue was ignored (SEG1 and SEG2). In the present attenuation correction schemes, uncorrected MR susceptibility artifacts typically result in reduced attenuation values, potentially leading to highly reduced PET standardized uptake values, rendering lesions indistinguishable from background. While AT&PR and SEG2wBONE show accurate results in both soft tissue and bone, SEG2wBONE uses a two-step approach for tissue classification, which increases the robustness of prediction and can be applied retrospectively if more precision in bone areas is needed.

Web DOI [BibTex]

Web DOI [BibTex]


no image
Learning output kernels for multi-task problems

Dinuzzo, F.

Neurocomputing, 118, pages: 119-126, 2013 (article)

DOI [BibTex]

DOI [BibTex]


no image
Analytical probabilistic modeling for radiation therapy treatment planning

Bangert, M., Hennig, P., Oelfke, U.

Physics in Medicine and Biology, 58(16):5401-5419, 2013 (article)

PDF DOI [BibTex]

PDF DOI [BibTex]


no image
Imaging Findings and Therapy Response Monitoring in Chronic Sclerodermatous Graft-Versus-Host Disease: Preliminary Data of a Simultaneous PET/MRI Approach

Sauter, A., Schmidt, H., Mantlik, F., Kolb, A., Federmann, B., Pfannenberg, C., Reimold, M., Pichler, B., Bethge, W., Horger, M.

Clinical Nuclear Medicine, 38(8):e309-e317, 2013 (article)

Abstract
PURPOSE: Our objective was a multifunctional imaging approach of chronic sclerodermatous graft-versus-host disease (ScGVHD) and its course during therapy using PET/MRI. METHODS: We performed partial-body PET/CT and PET/MRI of the calf in 6 consecutively recruited patients presenting with severe ScGVHD. The patients were treated with different immunosuppressive regimens and supportive therapies. PET/CT scanning started 60.5 +/- 3.3 minutes, PET/MRI imaging 139.5 +/- 16.7 minutes after F-FDG application. MRI acquisition included T1- (precontrast and postcontrast) and T2-weighted sequences. SUVmean, T1 contrast enhancement, and T2 signal intensity from region-of-interest analysis were calculated for different fascial and muscular compartments. In addition, musculoskeletal MRI findings and the modified Rodnan skin score were assessed. All patients underwent imaging follow-up. RESULTS: At baseline PET/MRI, ScGVHD-related musculoskeletal abnormalities consisted of increased signal and/or thickening of involved anatomical structures on T2-weighted and T1 postcontrast images as well as an increased FDG uptake. At follow-up, ScGVHD-related imaging findings decreased (SUVmean n = 4, mean T1 contrast enhancement n = 5, mean T2 signal intensity n = 3) or progressed (SUVmean n = 3, mean T1 contrast enhancement n = 2, mean T2 signal intensity n = 4). Clinically modified Rodnan skin score improved for 5 follow-ups and progressed for 2. SUVmean values correlated between PET/CT and PET/MRI acquisition (r = 0.660, P = 0.014), T1 contrast enhancement, and T2 signal (r = 0.668, P = 0.012), but not between the SUVmean values and the MRI parameters. CONCLUSIONS: PET/MRI as a combined morphological and functional technique seems to assess the inflammatory processes from different points of view and provides therefore in part complementary information

Web [BibTex]

Web [BibTex]


no image
A Survey on Policy Search for Robotics, Foundations and Trends in Robotics

Deisenroth, M., Neumann, G., Peters, J.

Foundations and Trends in Robotics, 2(1-2):1-142, 2013 (article)

DOI [BibTex]

DOI [BibTex]


no image
Reinforcement Learning in Robotics: A Review

Kober, J., Bagnell, D., Peters, J.

International Journal of Robotics Research, 32(11):1238–1274, 2013 (article)

PDF DOI [BibTex]

PDF DOI [BibTex]


no image
Multimodal information improves the rapid detection of mental fatigue

Laurent, F., Valderrama, M., Besserve, M., Guillard, M., Lachaux, J., Martinerie, J., Florence, G.

Biomedical Signal Processing and Control, 8(4):400 - 408, 2013 (article)

Web DOI [BibTex]

Web DOI [BibTex]


no image
Interactive Domain Adaptation for the Classification of Remote Sensing Images using Active Learning

Persello, C.

IEEE Geoscience and Remote Sensing Letters, 10(4):736-740, 2013 (article)

DOI [BibTex]


no image
Learning to Select and Generalize Striking Movements in Robot Table Tennis

Mülling, K., Kober, J., Kroemer, O., Peters, J.

International Journal of Robotics Research, 32(3):263-279, 2013 (article)

PDF DOI [BibTex]


no image
HiFiVE: A Hilbert Space Embedding of Fiber Variability Estimates for Uncertainty Modeling and Visualization

Schultz, T., Schlaffke, L., Schölkopf, B., Schmidt-Wilcke, T.

Computer Graphics Forum, 32(3):121-130, (Editors: B Preim, P Rheingans, and H Theisel), Blackwell Publishing, Oxford, UK, Eurographics Conference on Visualization (EuroVis), 2013 (article)

DOI [BibTex]

DOI [BibTex]


no image
Detection and attribution of large spatiotemporal extreme events in Earth observation data

Zscheischler, J., Mahecha, M., Harmeling, S., Reichstein, M.

Ecological Informatics, 15, pages: 66-73, 2013 (article)

Abstract
Latest climate projections suggest that both frequency and intensity of climate extremes will be substantially modified over the course of the coming decades. As a consequence, we need to understand to what extent and via which pathways climate extremes affect the state and functionality of terrestrial ecosystems and the associated biogeochemical cycles on a global scale. So far the impacts of climate extremes on the terrestrial biosphere were mainly investigated on the basis of case studies, while global assessments are widely lacking. In order to facilitate global analysis of this kind, we present a methodological framework that firstly detects spatiotemporally contiguous extremes in Earth observations, and secondly infers the likely pathway of the preceding climate anomaly. The approach does not require long time series, is computationally fast, and easily applicable to a variety of data sets with different spatial and temporal resolutions. The key element of our analysis strategy is to directly search in the relevant observations for spatiotemporally connected components exceeding a certain percentile threshold. We also put an emphasis on characterization of extreme event distribution, and scrutinize the attribution issue. We exemplify the analysis strategy by exploring the fraction of absorbed photosynthetically active radiation (fAPAR) from 1982 to 2011. Our results suggest that the hot spots of extremes in fAPAR lie in Northeastern Brazil, Southeastern Australia, Kenya and Tanzania. Moreover, we demonstrate that the size distribution of extremes follow a distinct power law. The attribution framework reveals that extremes in fAPAR are primarily driven by phases of water scarcity.

Web DOI [BibTex]

Web DOI [BibTex]


no image
Simultaneous PET/MR reveals Brain Function in Activated and Resting State on Metabolic, Hemodynamic and Multiple Temporal Scales

Wehrl, H., Hossain, M., Lankes, K., Liu, C., Bezrukov, I., Martirosian, P., Schick, F., Reischl, G., Pichler, B.

Nature Medicine, 19, pages: 1184–1189, 2013 (article)

Abstract
Combined positron emission tomography (PET) and magnetic resonance imaging (MRI) is a new tool to study functional processes in the brain. Here we study brain function in response to a barrel-field stimulus simultaneously using PET, which traces changes in glucose metabolism on a slow time scale, and functional MRI (fMRI), which assesses fast vascular and oxygenation changes during activation. We found spatial and quantitative discrepancies between the PET and the fMRI activation data. The functional connectivity of the rat brain was assessed by both modalities: the fMRI approach determined a total of nine known neural networks, whereas the PET method identified seven glucose metabolism–related networks. These results demonstrate the feasibility of combined PET-MRI for the simultaneous study of the brain at activation and rest, revealing comprehensive and complementary information to further decode brain function and brain networks.

Web DOI [BibTex]

Web DOI [BibTex]


no image
Finding Potential Support Vectors in Separable Classification Problems

Varagnolo, D., Del Favero, S., Dinuzzo, F., Schenato, L., Pillonetto, G.

IEEE Transactions on Neural Networks and Learning Systems, 24(11):1799-1813, 2013 (article)

DOI [BibTex]

DOI [BibTex]


no image
Open-Box Spectral Clustering: Applications to Medical Image Analysis

Schultz, T., Kindlmann, G.

IEEE Transactions on Visualization and Computer Graphics, 19(12):2100-2108, 2013 (article)

DOI [BibTex]

DOI [BibTex]


no image
im3shape: a maximum likelihood galaxy shear measurement code for cosmic gravitational lensing

Zuntz, J., Kacprzak, T., Voigt, L., Hirsch, M., Rowe, B., Bridle, S.

Monthly Notices of the Royal Astronomical Society, 434(2):1604-1618, Oxford University Press, 2013 (article)

DOI [BibTex]

DOI [BibTex]


no image
Accurate detection of differential RNA processing

Drewe, P., Stegle, O., Hartmann, L., Kahles, A., Bohnert, R., Wachter, A., Borgwardt, K. M., Rätsch, G.

Nucleic Acids Research, 41(10):5189-5198, 2013 (article)

DOI [BibTex]

DOI [BibTex]


no image
Detecting regulatory gene–environment interactions with unmeasured environmental factors

Fusi, N., Lippert, C., Borgwardt, K. M., Lawrence, N. D., Stegle, O.

Bioinformatics, 29(11):1382-1389, 2013 (article)

DOI [BibTex]

DOI [BibTex]


no image
Fragmentation of Slow Wave Sleep after Onset of Complete Locked-In State

Soekadar, S. R., Born, J., Birbaumer, N., Bensch, M., Halder, S., Murguialday, A. R., Gharabaghi, A., Nijboer, F., Schölkopf, B., Martens, S.

Journal of Clinical Sleep Medicine, 9(9):951-953, 2013 (article)

DOI [BibTex]

DOI [BibTex]


no image
Structural learning

Braun, D

Scholarpedia, 8(10):12312, October 2013 (article)

Abstract
Structural learning in motor control refers to a metalearning process whereby an agent extracts (abstract) invariants from its sensorimotor stream when experiencing a range of environments that share similar structure. Such invariants can then be exploited for faster generalization and learning-to-learn when experiencing novel, but related task environments.

DOI [BibTex]

DOI [BibTex]


no image
The effect of model uncertainty on cooperation in sensorimotor interactions

Grau-Moya, J, Hez, E, Pezzulo, G, Braun, DA

Journal of the Royal Society Interface, 10(87):1-11, October 2013 (article)

Abstract
Decision-makers have been shown to rely on probabilistic models for perception and action. However, these models can be incorrect or partially wrong in which case the decision-maker has to cope with model uncertainty. Model uncertainty has recently also been shown to be an important determinant of sensorimotor behaviour in humans that can lead to risk-sensitive deviations from Bayes optimal behaviour towards worst-case or best-case outcomes. Here, we investigate the effect of model uncertainty on cooperation in sensorimotor interactions similar to the stag-hunt game, where players develop models about the other player and decide between a pay-off-dominant cooperative solution and a risk-dominant, non-cooperative solution. In simulations, we show that players who allow for optimistic deviations from their opponent model are much more likely to converge to cooperative outcomes. We also implemented this agent model in a virtual reality environment, and let human subjects play against a virtual player. In this game, subjects' pay-offs were experienced as forces opposing their movements. During the experiment, we manipulated the risk sensitivity of the computer player and observed human responses. We found not only that humans adaptively changed their level of cooperation depending on the risk sensitivity of the computer player but also that their initial play exhibited characteristic risk-sensitive biases. Our results suggest that model uncertainty is an important determinant of cooperation in two-player sensorimotor interactions.

DOI [BibTex]

DOI [BibTex]


no image
Thermodynamics as a theory of decision-making with information-processing costs

Ortega, PA, Braun, DA

Proceedings of the Royal Society of London A, 469(2153):1-18, May 2013 (article)

Abstract
Perfectly rational decision-makers maximize expected utility, but crucially ignore the resource costs incurred when determining optimal actions. Here, we propose a thermodynamically inspired formalization of bounded rational decision-making where information processing is modelled as state changes in thermodynamic systems that can be quantified by differences in free energy. By optimizing a free energy, bounded rational decision-makers trade off expected utility gains and information-processing costs measured by the relative entropy. As a result, the bounded rational decision-making problem can be rephrased in terms of well-known variational principles from statistical physics. In the limit when computational costs are ignored, the maximum expected utility principle is recovered. We discuss links to existing decision-making frameworks and applications to human decision-making experiments that are at odds with expected utility theory. Since most of the mathematical machinery can be borrowed from statistical physics, the main contribution is to re-interpret the formalism of thermodynamic free-energy differences in terms of bounded rational decision-making and to discuss its relationship to human decision-making experiments.

DOI [BibTex]

DOI [BibTex]

2009


no image
Efficient Subwindow Search: A Branch and Bound Framework for Object Localization

Lampert, C., Blaschko, M., Hofmann, T.

IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(12):2129-2142, December 2009 (article)

Abstract
Most successful object recognition systems rely on binary classification, deciding only if an object is present or not, but not providing information on the actual object location. To estimate the object‘s location, one can take a sliding window approach, but this strongly increases the computational cost because the classifier or similarity function has to be evaluated over a large set of candidate subwindows. In this paper, we propose a simple yet powerful branch and bound scheme that allows efficient maximization of a large class of quality functions over all possible subimages. It converges to a globally optimal solution typically in linear or even sublinear time, in contrast to the quadratic scaling of exhaustive or sliding window search. We show how our method is applicable to different object detection and image retrieval scenarios. The achieved speedup allows the use of classifiers for localization that formerly were considered too slow for this task, such as SVMs with a spatial pyramid kernel or nearest-neighbor classifiers based on the chi^2 distance. We demonstrate state-of-the-art localization performance of the resulting systems on the UIUC Cars data set, the PASCAL VOC 2006 data set, and in the PASCAL VOC 2007 competition.

PDF Web DOI [BibTex]

2009

PDF Web DOI [BibTex]


no image
Generation of three-dimensional random rotations in fitting and matching problems

Habeck, M.

Computational Statistics, 24(4):719-731, December 2009 (article)

Abstract
An algorithm is developed to generate random rotations in three-dimensional space that follow a probability distribution arising in fitting and matching problems. The rotation matrices are orthogonally transformed into an optimal basis and then parameterized using Euler angles. The conditional distributions of the three Euler angles have a very simple form: the two azimuthal angles can be decoupled by sampling their sum and difference from a von Mises distribution; the cosine of the polar angle is exponentially distributed and thus straighforward to generate. Simulation results are shown and demonstrate the effectiveness of the method. The algorithm is compared to other methods for generating random rotations such as a random walk Metropolis scheme and a Gibbs sampling algorithm recently introduced by Green and Mardia. Finally, the algorithm is applied to a probabilistic version of the Procrustes problem of fitting two point sets and applied in the context of protein structure superposition.

PDF DOI [BibTex]

PDF DOI [BibTex]


no image
Adaptive Importance Sampling for Value Function Approximation in Off-policy Reinforcement Learning

Hachiya, H., Akiyama, T., Sugiyama, M., Peters, J.

Neural Networks, 22(10):1399-1410, December 2009 (article)

Abstract
Off-policy reinforcement learning is aimed at efficiently using data samples gathered from a policy that is different from the currently optimized policy. A common approach is to use importance sampling techniques for compensating for the bias of value function estimators caused by the difference between the data-sampling policy and the target policy. However, existing off-policy methods often do not take the variance of the value function estimators explicitly into account and therefore their performance tends to be unstable. To cope with this problem, we propose using an adaptive importance sampling technique which allows us to actively control the trade-off between bias and variance. We further provide a method for optimally determining the trade-off parameter based on a variant of cross-validation. We demonstrate the usefulness of the proposed approach through simulations.

PDF Web DOI [BibTex]

PDF Web DOI [BibTex]


no image
Guest editorial: special issue on structured prediction

Parker, C., Altun, Y., Tadepalli, P.

Machine Learning, 77(2-3):161-164, December 2009 (article)

PDF DOI [BibTex]

PDF DOI [BibTex]


no image
Structured prediction by joint kernel support estimation

Lampert, CH., Blaschko, MB.

Machine Learning, 77(2-3):249-269, December 2009 (article)

PDF DOI [BibTex]

PDF DOI [BibTex]


no image
A note on ethical aspects of BCI

Haselager, P., Vlek, R., Hill, J., Nijboer, F.

Neural Networks, 22(9):1352-1357, November 2009 (article)

Abstract
This paper focuses on ethical aspects of BCI, as a research and a clinical tool, that are challenging for practitioners currently working in the field. Specifically, the difficulties involved in acquiring informed consent from locked-in patients are investigated, in combination with an analysis of the shared moral responsibility in BCI teams, and the complications encountered in establishing effective communication with media.

Web DOI [BibTex]

Web DOI [BibTex]


no image
Model Learning with Local Gaussian Process Regression

Nguyen-Tuong, D., Seeger, M., Peters, J.

Advanced Robotics, 23(15):2015-2034, November 2009 (article)

Abstract
Precise models of robot inverse dynamics allow the design of significantly more accurate, energy-efficient and compliant robot control. However, in some cases the accuracy of rigid-body models does not suffice for sound control performance due to unmodeled nonlinearities arising from hydraulic cable dynamics, complex friction or actuator dynamics. In such cases, estimating the inverse dynamics model from measured data poses an interesting alternative. Nonparametric regression methods, such as Gaussian process regression (GPR) or locally weighted projection regression (LWPR), are not as restrictive as parametric models and, thus, offer a more flexible framework for approximating unknown nonlinearities. In this paper, we propose a local approximation to the standard GPR, called local GPR (LGP), for real-time model online learning by combining the strengths of both regression methods, i.e., the high accuracy of GPR and the fast speed of LWPR. The approach is shown to have competitive learning performance for hig h-dimensional data while being sufficiently fast for real-time learning. The effectiveness of LGP is exhibited by a comparison with the state-of-the-art regression techniques, such as GPR, LWPR and ν-support vector regression. The applicability of the proposed LGP method is demonstrated by real-time online learning of the inverse dynamics model for robot model-based control on a Barrett WAM robot arm.

PDF Web DOI [BibTex]


no image
Inferring textual entailment with a probabilistically sound calculus

Harmeling, S.

Natural Language Engineering, 15(4):459-477, October 2009 (article)

Abstract
We introduce a system for textual entailment that is based on a probabilistic model of entailment. The model is defined using a calculus of transformations on dependency trees, which is characterized by the fact that derivations in that calculus preserve the truth only with a certain probability. The calculus is successfully evaluated on the datasets of the PASCAL Challenge on Recognizing Textual Entailment.

PDF Web DOI [BibTex]

PDF Web DOI [BibTex]


no image
Modeling and Visualizing Uncertainty in Gene Expression Clusters using Dirichlet Process Mixtures

Rasmussen, CE., de la Cruz, BJ., Ghahramani, Z., Wild, DL.

IEEE/ACM Transactions on Computational Biology and Bioinformatics, 6(4):615-628, October 2009 (article)

Abstract
Although the use of clustering methods has rapidly become one of the standard computational approaches in the literature of microarray gene expression data, little attention has been paid to uncertainty in the results obtained. Dirichlet process mixture models provide a non-parametric Bayesian alternative to the bootstrap approach to modeling uncertainty in gene expression clustering. Most previously published applications of Bayesian model based clustering methods have been to short time series data. In this paper we present a case study of the application of non-parametric Bayesian clustering methods to the clustering of high-dimensional non-time series gene expression data using full Gaussian covariances. We use the probability that two genes belong to the same cluster in a Dirichlet process mixture model as a measure of the similarity of these gene expression profiles. Conversely, this probability can be used to define a dissimilarity measure, which, for the purposes of visualization, can be input to one of the standard linkage algorithms used for hierarchical clustering. Biologically plausible results are obtained from the Rosetta compendium of expression profiles which extend previously published cluster analyses of this data.

PDF Web DOI [BibTex]

PDF Web DOI [BibTex]


no image
Thermodynamic efficiency of information and heat flow

Allahverdyan, A., Janzing, D., Mahler, G.

Journal of Statistical Mechanics: Theory and Experiment, 2009(09):P09011, September 2009 (article)

Abstract
A basic task of information processing is information transfer (flow). P0 Here we study a pair of Brownian particles each coupled to a thermal bath at temperatures T1 and T2 . The information flow in such a system is defined via the time-shifted mutual information. The information flow nullifies at equilibrium, and its efficiency is defined as the ratio of the flow to the total entropy production in the system. For a stationary state the information flows from higher to lower temperatures, and its efficiency is bounded from above by (max[T1 , T2 ])/(|T1 − T2 |). This upper bound is imposed by the second law and it quantifies the thermodynamic cost for information flow in the present class of systems. It can be reached in the adiabatic situation, where the particles have widely different characteristic times. The efficiency of heat flow—defined as the heat flow over the total amount of dissipated heat—is limited from above by the same factor. There is a complementarity between heat and information flow: the set-up which is most efficient for the former is the least efficient for the latter and vice versa. The above bound for the efficiency can be (transiently) overcome in certain non-stationary situations, but the efficiency is still limited from above. We study yet another measure of information processing (transfer entropy) proposed in the literature. Though this measure does not require any thermodynamic cost, the information flow and transfer entropy are shown to be intimately related for stationary states.

PDF DOI [BibTex]

PDF DOI [BibTex]


no image
Does Cognitive Science Need Kernels?

Jäkel, F., Schölkopf, B., Wichmann, F.

Trends in Cognitive Sciences, 13(9):381-388, September 2009 (article)

Abstract
Kernel methods are among the most successful tools in machine learning and are used in challenging data analysis problems in many disciplines. Here we provide examples where kernel methods have proven to be powerful tools for analyzing behavioral data, especially for identifying features in categorization experiments. We also demonstrate that kernel methods relate to perceptrons and exemplar models of categorization. Hence, we argue that kernel methods have neural and psychological plausibility, and theoretical results concerning their behavior are therefore potentially relevant for human category learning. In particular, we believe kernel methods have the potential to provide explanations ranging from the implementational via the algorithmic to the computational level.

PDF Web DOI [BibTex]

PDF Web DOI [BibTex]


no image
Inference algorithms and learning theory for Bayesian sparse factor analysis

Rattray, M., Stegle, O., Sharp, K., Winn, J.

Journal of Physics: Conference Series , IW-SMI 2009, 197(1: International Workshop on Statistical-Mechanical Informatics 2009):1-10, (Editors: Inoue, M. , S. Ishii, Y. Kabashima, M. Okada), Institute of Physics, Bristol, UK, International Workshop on Statistical-Mechanical Informatics (IW-SMI), September 2009 (article)

Abstract
Bayesian sparse factor analysis has many applications; for example, it has been applied to the problem of inferring a sparse regulatory network from gene expression data. We describe a number of inference algorithms for Bayesian sparse factor analysis using a slab and spike mixture prior. These include well-established Markov chain Monte Carlo (MCMC) and variational Bayes (VB) algorithms as well as a novel hybrid of VB and Expectation Propagation (EP). For the case of a single latent factor we derive a theory for learning performance using the replica method. We compare the MCMC and VB/EP algorithm results with simulated data to the theoretical prediction. The results for MCMC agree closely with the theory as expected. Results for VB/EP are slightly sub-optimal but show that the new algorithm is effective for sparse inference. In large-scale problems MCMC is infeasible due to computational limitations and the VB/EP algorithm then provides a very useful computationally efficient alternative.

PDF Web DOI [BibTex]

PDF Web DOI [BibTex]


no image
Finite-time output stabilization with second order sliding modes

Dinuzzo, F., Ferrara, A.

Automatica, 45(9):2169-2171, September 2009 (article)

Abstract
In this note, a class of discontinuous feedback laws that switch over branches of parabolas in the auxiliary state plane is analyzed. Conditions are provided under which controllers belonging to this class are second order sliding-mode algorithms: they ensure uniform global finite-time output stability for uncertain systems of relative degree two.

Web DOI [BibTex]

Web DOI [BibTex]


no image
Robot Learning

Peters, J., Morimoto, J., Tedrake, R., Roy, N.

IEEE Robotics and Automation Magazine, 16(3):19-20, September 2009 (article)

Abstract
Creating autonomous robots that can learn to act in unpredictable environments has been a long-standing goal of robotics, artificial intelligence, and the cognitive sciences. In contrast, current commercially available industrial and service robots mostly execute fixed tasks and exhibit little adaptability. To bridge this gap, machine learning offers a myriad set of methods, some of which have already been applied with great success to robotics problems. As a result, there is an increasing interest in machine learning and statistics within the robotics community. At the same time, there has been a growth in the learning community in using robots as motivating applications for new algorithms and formalisms. Considerable evidence of this exists in the use of learning in high-profile competitions such as RoboCup and the Defense Advanced Research Projects Agency (DARPA) challenges, and the growing number of research programs funded by governments around the world.

PDF Web DOI [BibTex]

PDF Web DOI [BibTex]