Publications | Empirical Inference - Max Planck Institute for Intelligent Systems

47 results (View BibTeX file of all listed publications)

2017

Nonparametric Disturbance Correction and Nonlinear Dual Control

(24098), ETH Zurich, 2017 (phdthesis)

2017

Klenske, E. D. Nonparametric Disturbance Correction and Nonlinear Dual Control (24098), ETH Zurich, 2017 (phdthesis)

DOI [BibTex]

Development and Evaluation of a Portable BCI System for Remote Data Acquisition

Emde, T.

Graduate School of Neural Information Processing, Eberhard Karls Universität Tübingen, Germany, 2017 (mastersthesis)

[BibTex]

Emde, T. Development and Evaluation of a Portable BCI System for Remote Data Acquisition Graduate School of Neural Information Processing, Eberhard Karls Universität Tübingen, Germany, 2017 (mastersthesis)

[BibTex]

Brain-Computer Interfaces for patients with Amyotrophic Lateral Sclerosis

Fomina, T.

Eberhard Karls Universität Tübingen, Germany, 2017 (phdthesis)

[BibTex]

Fomina, T. Brain-Computer Interfaces for patients with Amyotrophic Lateral Sclerosis Eberhard Karls Universität Tübingen, Germany, 2017 (phdthesis)

[BibTex]

Causal models for decision making via integrative inference

Geiger, P.

University of Stuttgart, Germany, 2017 (phdthesis)

[BibTex]

Geiger, P. Causal models for decision making via integrative inference University of Stuttgart, Germany, 2017 (phdthesis)

[BibTex]

Learning Optimal Configurations for Modeling Frowning by Transcranial Electrical Stimulation

Sücker, K.

Graduate School of Neural Information Processing, Eberhard Karls Universität Tübingen, Germany, 2017 (mastersthesis)

[BibTex]

Sücker, K. Learning Optimal Configurations for Modeling Frowning by Transcranial Electrical Stimulation Graduate School of Neural Information Processing, Eberhard Karls Universität Tübingen, Germany, 2017 (mastersthesis)

[BibTex]

2005

Spectral clustering and transductive inference for graph data

Zhou, D.

NIPS Workshop on Kernel Methods and Structured Domains, December 2005 (talk)

PDF Web [BibTex]

2005

Zhou, D. Spectral clustering and transductive inference for graph data NIPS Workshop on Kernel Methods and Structured Domains, December 2005 (talk)

PDF Web [BibTex]

Some thoughts about Gaussian Processes

Chapelle, O.

NIPS Workshop on Open Problems in Gaussian Processes for Machine Learning, December 2005 (talk)

PDF Web [BibTex]

Chapelle, O. Some thoughts about Gaussian Processes NIPS Workshop on Open Problems in Gaussian Processes for Machine Learning, December 2005 (talk)

PDF Web [BibTex]

A taxonomy of semi-supervised learning algorithms

Chapelle, O.

Yahoo!, December 2005 (talk)

PDF [BibTex]

Chapelle, O. A taxonomy of semi-supervised learning algorithms Yahoo!, December 2005 (talk)

PDF [BibTex]

Extension to Kernel Dependency Estimation with Applications to Robotics

BakIr, G.

Biologische Kybernetik, Technische Universität Berlin, Berlin, November 2005 (phdthesis)

Abstract

Kernel Dependency Estimation(KDE) is a novel technique which was designed to learn mappings between sets without making assumptions on the type of the involved input and output data. It learns the mapping in two stages. In a first step, it tries to estimate coordinates of a feature space representation of elements of the set by solving a high dimensional multivariate regression problem in feature space. Following this, it tries to reconstruct the original representation given the estimated coordinates. This thesis introduces various algorithmic extensions to both stages in KDE. One of the contributions of this thesis is to propose a novel linear regression algorithm that explores low-dimensional subspaces during learning. Furthermore various existing strategies for reconstructing patterns from feature maps involved in KDE are discussed and novel pre-image techniques are introduced. In particular, pre-image techniques for data-types that are of discrete nature such as graphs and strings are investigated. KDE is then explored in the context of robot pose imitation where the input is a an image with a human operator and the output is the robot articulated variables. Thus, using KDE, robot pose imitation is formulated as a regression problem.

PDF PDF [BibTex]

BakIr, G. Extension to Kernel Dependency Estimation with Applications to Robotics Biologische Kybernetik, Technische Universität Berlin, Berlin, November 2005 (phdthesis)

PDF PDF [BibTex]

Geometrical aspects of statistical learning theory

Hein, M.

Biologische Kybernetik, Darmstadt, Darmstadt, November 2005 (phdthesis)

PDF [BibTex]

Hein, M. Geometrical aspects of statistical learning theory Biologische Kybernetik, Darmstadt, Darmstadt, November 2005 (phdthesis)

PDF [BibTex]

Implicit Surfaces For Modelling Human Heads

Steinke, F.

Biologische Kybernetik, Eberhard-Karls-Universität, Tübingen, September 2005 (diplomathesis)

[BibTex]

Steinke, F. Implicit Surfaces For Modelling Human Heads Biologische Kybernetik, Eberhard-Karls-Universität, Tübingen, September 2005 (diplomathesis)

[BibTex]

Machine Learning Methods for Brain-Computer Interdaces

Lal, TN.

Biologische Kybernetik, University of Darmstadt, September 2005 (phdthesis)

Web [BibTex]

Lal, TN. Machine Learning Methods for Brain-Computer Interdaces Biologische Kybernetik, University of Darmstadt, September 2005 (phdthesis)

Web [BibTex]

Building Sparse Large Margin Classifiers

Wu, M., Schölkopf, B., BakIr, G.

The 22nd International Conference on Machine Learning (ICML), August 2005 (talk)

PDF [BibTex]

Wu, M., Schölkopf, B., BakIr, G. Building Sparse Large Margin Classifiers The 22nd International Conference on Machine Learning (ICML), August 2005 (talk)

PDF [BibTex]

Learning from Labeled and Unlabeled Data on a Directed Graph

Zhou, D.

The 22nd International Conference on Machine Learning, August 2005 (talk)

Abstract

We propose a general framework for learning from labeled and unlabeled data on a directed graph in which the structure of the graph including the directionality of the edges is considered. The time complexity of the algorithm derived from this framework is nearly linear due to recently developed numerical techniques. In the absence of labeled instances, this framework can be utilized as a spectral clustering method for directed graphs, which generalizes the spectral clustering approach for undirected graphs. We have applied our framework to real-world web classification problems and obtained encouraging results.

PDF [BibTex]

Zhou, D. Learning from Labeled and Unlabeled Data on a Directed Graph The 22nd International Conference on Machine Learning, August 2005 (talk)

PDF [BibTex]

Liver Perfusion using Level Set Methods

Nowozin, S.

Biologische Kybernetik, Shanghai JiaoTong University, Shanghai, China, July 2005 (diplomathesis)

PDF [BibTex]

Nowozin, S. Liver Perfusion using Level Set Methods Biologische Kybernetik, Shanghai JiaoTong University, Shanghai, China, July 2005 (diplomathesis)

PDF [BibTex]

Machine-Learning Approaches to BCI in Tübingen

Bensch, M., Bogdan, M., Hill, N., Lal, T., Rosenstiel, W., Schölkopf, B., Schröder, M.

Brain-Computer Interface Technology, June 2005, Talk given by NJH. (talk)

[BibTex]

Bensch, M., Bogdan, M., Hill, N., Lal, T., Rosenstiel, W., Schölkopf, B., Schröder, M. Machine-Learning Approaches to BCI in Tübingen Brain-Computer Interface Technology, June 2005, Talk given by NJH. (talk)

[BibTex]

Learning Motor Primitives with Reinforcement Learning

Peters, J., Schaal, S.

ROBOTICS Workshop on Modular Foundations for Control and Perception, June 2005 (talk)

Web [BibTex]

Peters, J., Schaal, S. Learning Motor Primitives with Reinforcement Learning ROBOTICS Workshop on Modular Foundations for Control and Perception, June 2005 (talk)

Web [BibTex]

Discriminative Methods for Label Sequence Learning

Altun, Y.

Brown University, Providence, RI, USA, May 2005 (phdthesis)

PDF [BibTex]

Altun, Y. Discriminative Methods for Label Sequence Learning Brown University, Providence, RI, USA, May 2005 (phdthesis)

PDF [BibTex]

Efficient Adaptive Sampling of the Psychometric Function by Maximizing Information Gain

Tanner, TG.

Biologische Kybernetik, Eberhard-Karls University Tübingen, Tübingen, Germany, May 2005 (diplomathesis)

Abstract

A common task in psychophysics is to measure the psychometric function. A psychometric function can be described by its shape and four parameters: offset or threshold, slope or width, false alarm rate or chance level and miss or lapse rate. Depending on the parameters of interest some points on the psychometric function may be more informative than others. Adaptive methods attempt to place trials on the most informative points based on the data collected in previous trials. A new Bayesian adaptive psychometric method placing trials by minimising the expected entropy of the posterior probabilty dis- tribution over a set of possible stimuli is introduced. The method is more flexible, faster and at least as efficient as the established method (Kontsevich and Tyler, 1999). Comparably accurate (2dB) threshold and slope estimates can be obtained after about 30 and 500 trials, respectively. By using a dynamic termination criterion the efficiency can be further improved. The method can be applied to all experimental designs including yes/no designs and allows acquisition of any set of free parameters. By weighting the importance of parameters one can include nuisance parameters and adjust the relative expected errors. Use of nuisance parameters may lead to more accurate estimates than assuming a guessed fixed value. Block designs are supported and do not harm the performance if a sufficient number of trials are performed. The method was evaluated by computer simulations in which the role of parametric assumptions, its robustness, the quality of different point estimates, the effect of dynamic termination criteria and many other settings were investigated.

[BibTex]

Tanner, TG. Efficient Adaptive Sampling of the Psychometric Function by Maximizing Information Gain Biologische Kybernetik, Eberhard-Karls University Tübingen, Tübingen, Germany, May 2005 (diplomathesis)

[BibTex]

Support Vector Classification of Images with Local Features

Blaschko, MB.

Biologische Kybernetik, University of Massachusetts, Amherst, May 2005 (diplomathesis)

[BibTex]

Blaschko, MB. Support Vector Classification of Images with Local Features Biologische Kybernetik, University of Massachusetts, Amherst, May 2005 (diplomathesis)

[BibTex]

Motor Skill Learning for Humanoid Robots

Peters, J.

First Conference Undergraduate Computer Sciences and Informations Sciences (CS/IS), May 2005 (talk)

[BibTex]

Peters, J. Motor Skill Learning for Humanoid Robots First Conference Undergraduate Computer Sciences and Informations Sciences (CS/IS), May 2005 (talk)

[BibTex]

Efficient Pattern Selection for Support Vector Classifiers and its CRM Application

Shin, H.

Biologische Kybernetik, Seoul National University, Seoul, Korea, February 2005 (phdthesis)

PDF [BibTex]

Shin, H. Efficient Pattern Selection for Support Vector Classifiers and its CRM Application Biologische Kybernetik, Seoul National University, Seoul, Korea, February 2005 (phdthesis)

PDF [BibTex]

Kernel Constrained Covariance for Dependence Measurement

Gretton, A., Smola, A., Bousquet, O., Herbrich, R., Belitski, A., Augath, M., Murayama, Y., Schölkopf, B., Logothetis, N.

AISTATS, January 2005 (talk)

Abstract

We discuss reproducing kernel Hilbert space (RKHS)-based measures of statistical dependence, with emphasis on constrained covariance (COCO), a novel criterion to test dependence of random variables. We show that COCO is a test for independence if and only if the associated RKHSs are universal. That said, no independence test exists that can distinguish dependent and independent random variables in all circumstances. Dependent random variables can result in a COCO which is arbitrarily close to zero when the source densities are highly non-smooth. All current kernel-based independence tests share this behaviour. We demonstrate exponential convergence between the population and empirical COCO. Finally, we use COCO as a measure of joint neural activity between voxels in MRI recordings of the macaque monkey, and compare the results to the mutual information and the correlation. We also show the effect of removing breathing artefacts from the MRI recording.

PostScript [BibTex]

Gretton, A., Smola, A., Bousquet, O., Herbrich, R., Belitski, A., Augath, M., Murayama, Y., Schölkopf, B., Logothetis, N. Kernel Constrained Covariance for Dependence Measurement AISTATS, January 2005 (talk)

PostScript [BibTex]

Kernels: Regularization and Optimization

Ong, CS.

Biologische Kybernetik, The Australian National University, Canberra, Australia, 2005 (phdthesis)

PDF GZIP [BibTex]

Ong, CS. Kernels: Regularization and Optimization Biologische Kybernetik, The Australian National University, Canberra, Australia, 2005 (phdthesis)

PDF GZIP [BibTex]

2004

How to learn from very few examples?

Zhou, D.

October 2004 (talk)

PDF [BibTex]

2004

Zhou, D. How to learn from very few examples? October 2004 (talk)

PDF [BibTex]

Discrete vs. Continuous: Two Sides of Machine Learning

Zhou, D.

October 2004 (talk)

PDF [BibTex]

Zhou, D. Discrete vs. Continuous: Two Sides of Machine Learning October 2004 (talk)

PDF [BibTex]

Discrete vs. Continuous: Two Sides of Machine Learning

Zhou, D.

October 2004 (talk)

Abstract

We consider the problem of transductive inference. In many real-world problems, unlabeled data is far easier to obtain than labeled data. Hence transductive inference is very significant in many practical problems. According to Vapnik's point of view, one should predict the function value only on the given points directly rather than a function defined on the whole space, the latter being a more complicated problem. Inspired by this idea, we develop discrete calculus on finite discrete spaces, and then build discrete regularization. A family of transductive algorithms is naturally derived from this regularization framework. We validate the algorithms on both synthetic and real-world data from text/web categorization to bioinformatics problems. A significant by-product of this work is a powerful way of ranking data based on examples including images, documents, proteins and many other kinds of data. This talk is mainly based on the followiing contribution: (1) D. Zhou and B. Sch{\"o}lkopf: Transductive Inference with Graphs, MPI Technical report, August, 2004; (2) D. Zhou, B. Sch{\"o}lkopf and T. Hofmann. Semi-supervised Learning on Directed Graphs. NIPS 2004; (3) D. Zhou, O. Bousquet, T.N. Lal, J. Weston and B. Sch{\"o}lkopf. Learning with Local and Global Consistency. NIPS 2003.

PDF [BibTex]

Zhou, D. Discrete vs. Continuous: Two Sides of Machine Learning October 2004 (talk)

PDF [BibTex]

Independent component analysis and beyond

Harmeling, S.

Biologische Kybernetik, Universität Potsdam, Potsdam, October 2004 (phdthesis)

PDF [BibTex]

Harmeling, S. Independent component analysis and beyond Biologische Kybernetik, Universität Potsdam, Potsdam, October 2004 (phdthesis)

PDF [BibTex]

Grundlagen von Support Vector Maschinen und Anwendungen in der Bildverarbeitung

Eichhorn, J.

September 2004 (talk)

Abstract

Invited talk at the workshop "Numerical, Statistical and Discrete Methods in Image Processing" at the TU M{\"u}nchen (in GERMAN)

PDF [BibTex]

Eichhorn, J. Grundlagen von Support Vector Maschinen und Anwendungen in der Bildverarbeitung September 2004 (talk)

PDF [BibTex]

The benefit of liquid Helium cooling for Cryo-Electron Tomography: A quantitative comparative study

Schweikert, G., Luecken, U., Pfeifer, G., Baumeister, W., Plitzko, J.

The thirteenth European Microscopy Congress, August 2004 (talk)

[BibTex]

Schweikert, G., Luecken, U., Pfeifer, G., Baumeister, W., Plitzko, J. The benefit of liquid Helium cooling for Cryo-Electron Tomography: A quantitative comparative study The thirteenth European Microscopy Congress, August 2004 (talk)

[BibTex]

Riemannian Geometry on Graphs and its Application to Ranking and Classification

Zhou, D.

June 2004 (talk)

Abstract

PDF [BibTex]

Zhou, D. Riemannian Geometry on Graphs and its Application to Ranking and Classification June 2004 (talk)

PDF [BibTex]

Exploration of combining Echo-State Network Learning with Recurrent Neural Network Learning techniques

Erhan, D.

Biologische Kybernetik, International University Bremen, Bremen, Germany, May 2004 (diplomathesis)

PDF [BibTex]

Erhan, D. Exploration of combining Echo-State Network Learning with Recurrent Neural Network Learning techniques Biologische Kybernetik, International University Bremen, Bremen, Germany, May 2004 (diplomathesis)

PDF [BibTex]

Computational Analysis of Gene Expression Data

Zien, A.

(4), Biologische Kybernetik, March 2004 (phdthesis)

[BibTex]

Zien, A. Computational Analysis of Gene Expression Data (4), Biologische Kybernetik, March 2004 (phdthesis)

[BibTex]

Learning from Labeled and Unlabeled Data: Semi-supervised Learning and Ranking

Zhou, D.

January 2004 (talk)

Abstract

We consider the general problem of learning from labeled and unlabeled data, which is often called semi-supervised learning or transductive inference. A principled approach to semi-supervised learning is to design a classifying function which is sufficiently smooth with respect to the intrinsic structure collectively revealed by known labeled and unlabeled points. We present a simple algorithm to obtain such a smooth solution. Our method yields encouraging experimental results on a number of classification problems and demonstrates effective use of unlabeled data.

PDF [BibTex]

Zhou, D. Learning from Labeled and Unlabeled Data: Semi-supervised Learning and Ranking January 2004 (talk)

PDF [BibTex]

Introduction to Category Theory

Bousquet, O.

Internal Seminar, January 2004 (talk)

Abstract

A brief introduction to the general idea behind category theory with some basic definitions and examples. A perspective on higher dimensional categories is given.

PDF [BibTex]

Bousquet, O. Introduction to Category Theory Internal Seminar, January 2004 (talk)

PDF [BibTex]

The p53 Oligomerization Domain: Sequence-Structure Relationships and the Design and Characterization of Altered Oligomeric States

Davison, TS.

University of Toronto, Canada, University of Toronto, Canada, 2004 (phdthesis)

[BibTex]

Davison, TS. The p53 Oligomerization Domain: Sequence-Structure Relationships and the Design and Characterization of Altered Oligomeric States University of Toronto, Canada, University of Toronto, Canada, 2004 (phdthesis)

[BibTex]

Statistical Learning with Similarity and Dissimilarity Functions

von Luxburg, U.

pages: 1-166, Technische Universität Berlin, Germany, Technische Universität Berlin, Germany, 2004 (phdthesis)

PDF PostScript [BibTex]

von Luxburg, U. Statistical Learning with Similarity and Dissimilarity Functions pages: 1-166, Technische Universität Berlin, Germany, Technische Universität Berlin, Germany, 2004 (phdthesis)

PDF PostScript [BibTex]

Classification and Feature Extraction in Man and Machine

Graf, AAB.

Biologische Kybernetik, University of Tübingen, Germany, 2004, online publication (phdthesis)

[BibTex]

Graf, AAB. Classification and Feature Extraction in Man and Machine Biologische Kybernetik, University of Tübingen, Germany, 2004, online publication (phdthesis)

[BibTex]

Advanced Statistical Learning Theory

Bousquet, O.

Machine Learning Summer School, 2004 (talk)

PDF [BibTex]

Bousquet, O. Advanced Statistical Learning Theory Machine Learning Summer School, 2004 (talk)

PDF [BibTex]

2002

Nonlinear Multivariate Analysis with Geodesic Kernels

Kuss, M.

Biologische Kybernetik, Technische Universität Berlin, February 2002 (diplomathesis)

GZIP [BibTex]

2002

Kuss, M. Nonlinear Multivariate Analysis with Geodesic Kernels Biologische Kybernetik, Technische Universität Berlin, February 2002 (diplomathesis)

GZIP [BibTex]

Transductive Learning: Motivation, Models, Algorithms

Bousquet, O.

January 2002 (talk)

PDF [BibTex]

Bousquet, O. Transductive Learning: Motivation, Models, Algorithms January 2002 (talk)

PDF [BibTex]

Concentration Inequalities and Empirical Processes Theory Applied to the Analysis of Learning Algorithms

Bousquet, O.

Biologische Kybernetik, Ecole Polytechnique, 2002 (phdthesis) Accepted

Abstract

New classification algorithms based on the notion of 'margin' (e.g. Support Vector Machines, Boosting) have recently been developed. The goal of this thesis is to better understand how they work, via a study of their theoretical performance. In order to do this, a general framework for real-valued classification is proposed. In this framework, it appears that the natural tools to use are Concentration Inequalities and Empirical Processes Theory. Thanks to an adaptation of these tools, a new measure of the size of a class of functions is introduced, which can be computed from the data. This allows, on the one hand, to better understand the role of eigenvalues of the kernel matrix in Support Vector Machines, and on the other hand, to obtain empirical model selection criteria.

PostScript [BibTex]

Bousquet, O. Concentration Inequalities and Empirical Processes Theory Applied to the Analysis of Learning Algorithms Biologische Kybernetik, Ecole Polytechnique, 2002 (phdthesis) Accepted

PostScript [BibTex]

Support Vector Machines: Induction Principle, Adaptive Tuning and Prior Knowledge

Chapelle, O.

Biologische Kybernetik, 2002 (phdthesis)

Abstract

This thesis presents a theoretical and practical study of Support Vector Machines (SVM) and related learning algorithms. In a first part, we introduce a new induction principle from which SVMs can be derived, but some new algorithms are also presented in this framework. In a second part, after studying how to estimate the generalization error of an SVM, we suggest to choose the kernel parameters of an SVM by minimizing this estimate. Several applications such as feature selection are presented. Finally the third part deals with the incoporation of prior knowledge in a learning algorithm and more specifically, we studied the case of known invariant transormations and the use of unlabeled data.

GZIP [BibTex]

Chapelle, O. Support Vector Machines: Induction Principle, Adaptive Tuning and Prior Knowledge Biologische Kybernetik, 2002 (phdthesis)

GZIP [BibTex]

2001

Variationsverfahren zur Untersuchung von Grundzustandseigenschaften des Ein-Band Hubbard-Modells

Eichhorn, J.

Biologische Kybernetik, Technische Universität Dresden, Dresden/Germany, May 2001 (diplomathesis)

Abstract

Using different modifications of a new variational approach, statical groundstate properties of the one-band Hubbard model such as energy and staggered magnetisation are calculated. By taking into account additional fluctuations, the method ist gradually improved so that a very good description of the energy in one and two dimensions can be achieved. After a detailed discussion of the application in one dimension, extensions for two dimensions are introduced. By use of a modified version of the variational ansatz in particular a description of the quantum phase transition for the magnetisation should be possible.

PostScript [BibTex]