Header logo is ei

372 results (View BibTeX file of all listed publications)

2012

no image
Feature Selection via Dependence Maximization

Song, L., Smola, A., Gretton, A., Bedo, J., Borgwardt, K.

Journal of Machine Learning Research, 13, pages: 1393-1434, May 2012 (article)

Abstract
We introduce a framework of feature selection based on dependence maximization between the selected features and the labels of an estimation problem, using the Hilbert-Schmidt Independence Criterion. The key idea is that good features should be highly dependent on the labels. Our approach leads to a greedy procedure for feature selection. We show that a number of existing feature selectors are special cases of this framework. Experiments on both artificial and real-world data show that our feature selector works well in practice.

PDF [BibTex]

2012

Song, L., Smola, A., Gretton, A., Bedo, J., Borgwardt, K. Feature Selection via Dependence Maximization Journal of Machine Learning Research, 13, pages: 1393-1434, May 2012 (article)

PDF [BibTex]

no image
Accelerating Nearest Neighbor Search on Manycore Systems

Cayton, L.

In Parallel Distributed Processing Symposium (IPDPS), 2012 IEEE 26th International, pages: 402-413, IPDPS, May 2012 (inproceedings)

Abstract
We develop methods for accelerating metric similarity search that are effective on modern hardware. Our algorithms factor into easily parallelizable components, making them simple to deploy and efficient on multicore CPUs and GPUs. Despite the simple structure of our algorithms, their search performance is provably sublinear in the size of the database, with a factor dependent only on its intrinsic dimensionality. We demonstrate that our methods provide substantial speedups on a range of datasets and hardware platforms. In particular, we present results on a 48-core server machine, on graphics hardware, and on a multicore desktop.

Web DOI [BibTex]

Cayton, L. Accelerating Nearest Neighbor Search on Manycore Systems In Parallel Distributed Processing Symposium (IPDPS), 2012 IEEE 26th International, pages: 402-413, IPDPS, May 2012 (inproceedings)

Web DOI [BibTex]

no image
High gamma-power predicts performance in sensorimotor-rhythm brain-computer interfaces

Grosse-Wentrup, M., Schölkopf, B.

Journal of Neural Engineering, 9(4):046001, May 2012 (article)

Abstract
Subjects operating a brain–computer interface (BCI) based on sensorimotor rhythms exhibit large variations in performance over the course of an experimental session. Here, we show that high-frequency γ-oscillations, originating in fronto-parietal networks, predict such variations on a trial-to-trial basis. We interpret this finding as empirical support for an influence of attentional networks on BCI performance via modulation of the sensorimotor rhythm.

Web DOI [BibTex]

no image
ShapePheno: Unsupervised extraction of shape phenotypes from biological image collections

Karaletsos, T., Stegle, O., Dreyer, C., Winn, J., Borgwardt, K.

Bioinformatics, 28(7):1001-1008, April 2012 (article)

Abstract
Motivation: Accurate large-scale phenotyping has recently gained considerable importance in biology. For example, in genome wide association studies technological advances have rendered genotyping cheap, leaving phenotype acquisition as the major bottleneck. Automatic image analysis is one major strategy to phenotype individuals in large numbers. Current approaches for visual phenotyping focus predominantly on summarizing statistics and geometric measures, such as height and width of an individual, or color histograms and patterns. However, more subtle, but biologically informative phenotypes, such as the local deformation of the shape of an individual with respect to the population mean cannot be automatically extracted and quantified by current techniques. Results: We propose a probabilistic machine learning model that allows for the extraction of deformation phenotypes from biological images, making them available as quantitative traits for downstream analysis. Our approach jointly models a collection of images using a learned common template that is mapped onto each image through a deformable smooth transformation. In a case study we analyze the shape deformations of 388 guppy fish (Poecilia reticulata). We find that the flexible shape phenotypes our model extracts are complementary to basic geometric measures. Moreover, these quantitative traits assort the observations into distinct groups and can be mapped to polymorphic genetic loci of the sample set.

Web DOI [BibTex]

Karaletsos, T., Stegle, O., Dreyer, C., Winn, J., Borgwardt, K. ShapePheno: Unsupervised extraction of shape phenotypes from biological image collections Bioinformatics, 28(7):1001-1008, April 2012 (article)

Web DOI [BibTex]

no image
PAC-Bayes-Bernstein Inequality for Martingales and its Application to Multiarmed Bandits

Seldin, Y., Cesa-Bianchi, N., Auer, P., Laviolette, F., Shawe-Taylor, J.

In JMLR Workshop and Conference Proceedings 26, pages: 98-111, JMLR, Cambridge, MA, USA, On-line Trading of Exploration and Exploitation 2, April 2012 (inproceedings)

Abstract
We develop a new tool for data-dependent analysis of the exploration-exploitation trade-off in learning under limited feedback. Our tool is based on two main ingredients. The first ingredient is a new concentration inequality that makes it possible to control the concentration of weighted averages of multiple (possibly uncountably many) simultaneously evolving and interdependent martingales. The second ingredient is an application of this inequality to the exploration-exploitation trade-off via importance weighted sampling. We apply the new tool to the stochastic multiarmed bandit problem, however, the main importance of this paper is the development and understanding of the new tool rather than improvement of existing algorithms for stochastic multiarmed bandits. In the follow-up work we demonstrate that the new tool can improve over state-of-the-art in structurally richer problems, such as stochastic multiarmed bandits with side information (Seldin et al., 2011a).

PDF PDF [BibTex]

Seldin, Y., Cesa-Bianchi, N., Auer, P., Laviolette, F., Shawe-Taylor, J. PAC-Bayes-Bernstein Inequality for Martingales and its Application to Multiarmed Bandits In JMLR Workshop and Conference Proceedings 26, pages: 98-111, JMLR, Cambridge, MA, USA, On-line Trading of Exploration and Exploitation 2, April 2012 (inproceedings)

PDF PDF [BibTex]

no image
Hierarchical Relative Entropy Policy Search

Daniel, C., Neumann, G., Peters, J.

In Fifteenth International Conference on Artificial Intelligence and Statistics, 22, pages: 273-281, JMLR Proceedings, (Editors: Lawrence, N. D. and Girolami, M.), JMLR.org, AISTATS, April 2012 (inproceedings)

Abstract
Many real-world problems are inherently hierarchically structured. The use of this structure in an agent's policy may well be the key to improved scalability and higher performance. However, such hierarchical structures cannot be exploited by current policy search algorithms. We will concentrate on a basic, but highly relevant hierarchy - the `mixed option' policy. Here, a gating network fi rst decides which of the options to execute and, subsequently, the option-policy determines the action. In this paper, we reformulate learning a hierarchical policy as a latent variable estimation problem and subsequently extend the Relative Entropy Policy Search (REPS) to the latent variable case. We show that our Hierarchical REPS can learn versatile solutions while also showing an increased performance in terms of learning speed and quality of the found policy in comparison to the nonhierarchical approach.

PDF Web [BibTex]

Daniel, C., Neumann, G., Peters, J. Hierarchical Relative Entropy Policy Search In Fifteenth International Conference on Artificial Intelligence and Statistics, 22, pages: 273-281, JMLR Proceedings, (Editors: Lawrence, N. D. and Girolami, M.), JMLR.org, AISTATS, April 2012 (inproceedings)

PDF Web [BibTex]

no image
A New Perceptual Bias Reveals Suboptimal Population Decoding of Sensory Responses

Putzeys, T., Bethge, M., Wichmann, F., Wagemans, J., Goris, R.

PLoS Computational Biology, 8(4):1-13, April 2012 (article)

Abstract
Several studies have reported optimal population decoding of sensory responses in two-alternative visual discrimination tasks. Such decoding involves integrating noisy neural responses into a more reliable representation of the likelihood that the stimuli under consideration evoked the observed responses. Importantly, an ideal observer must be able to evaluate likelihood with high precision and only consider the likelihood of the two relevant stimuli involved in the discrimination task. We report a new perceptual bias suggesting that observers read out the likelihood representation with remarkably low precision when discriminating grating spatial frequencies. Using spectrally filtered noise, we induced an asymmetry in the likelihood function of spatial frequency. This manipulation mainly affects the likelihood of spatial frequencies that are irrelevant to the task at hand. Nevertheless, we find a significant shift in perceived grating frequency, indicating that observers evaluate likelihoods of a broad range of irrelevant frequencies and discard prior knowledge of stimulus alternatives when performing two-alternative discrimination.

Web DOI [BibTex]

Putzeys, T., Bethge, M., Wichmann, F., Wagemans, J., Goris, R. A New Perceptual Bias Reveals Suboptimal Population Decoding of Sensory Responses PLoS Computational Biology, 8(4):1-13, April 2012 (article)

Web DOI [BibTex]

no image
Evaluation of a new, large field of view, small animal PET/MR system

Hossain, M., Wehrl, H., Lankes, K., Liu, C., Bezrukov, I., Reischl, G., Pichler, B.

50. Jahrestagung der Deutschen Gesellschaft fuer Nuklearmedizin (NuklearMedizin), April 2012 (talk)

Web [BibTex]

Hossain, M., Wehrl, H., Lankes, K., Liu, C., Bezrukov, I., Reischl, G., Pichler, B. Evaluation of a new, large field of view, small animal PET/MR system 50. Jahrestagung der Deutschen Gesellschaft fuer Nuklearmedizin (NuklearMedizin), April 2012 (talk)

Web [BibTex]

no image
Patterns of cis regulatory variation in diverse human populations

Stranger, BE., Montgomery, SB., Dimas, AS., Parts, L., Stegle, O., Ingle, CE., Sekowska, M., Smith, GD., Evans, D., Gutierrez-Arcelus, M., others

PLoS genetics, 8(4):e1002639, April 2012 (article)

Abstract
he genetic basis of gene expression variation has long been studied with the aim to understand the landscape of regulatory variants, but also more recently to assist in the interpretation and elucidation of disease signals. To date, many studies have looked in specific tissues and population-based samples, but there has been limited assessment of the degree of inter-population variability in regulatory variation. We analyzed genome-wide gene expression in lymphoblastoid cell lines from a total of 726 individuals from 8 global populations from the HapMap3 project and correlated gene expression levels with HapMap3 SNPs located in cis to the genes. We describe the influence of ancestry on gene expression levels within and between these diverse human populations and uncover a non-negligible impact on global patterns of gene expression. We further dissect the specific functional pathways differentiated between populations. We also identify 5,691 expression quantitative trait loci (eQTLs) after controlling for both non-genetic factors and population admixture and observe that half of the cis-eQTLs are replicated in one or more of the populations. We highlight patterns of eQTL-sharing between populations, which are partially determined by population genetic relatedness, and discover significant sharing of eQTL effects between Asians, European-admixed, and African subpopulations. Specifically, we observe that both the effect size and the direction of effect for eQTLs are highly conserved across populations. We observe an increasing proximity of eQTLs toward the transcription start site as sharing of eQTLs among populations increases, highlighting that variants close to TSS have stronger effects and therefore are more likely to be detected across a wider panel of populations. Together these results offer a unique picture and resource of the degree of differentiation among human populations in functional regulatory variation and provide an estimate for the transferability of complex trait variants across populations.

Web DOI [BibTex]

Stranger, BE., Montgomery, SB., Dimas, AS., Parts, L., Stegle, O., Ingle, CE., Sekowska, M., Smith, GD., Evans, D., Gutierrez-Arcelus, M., others Patterns of cis regulatory variation in diverse human populations PLoS genetics, 8(4):e1002639, April 2012 (article)

Web DOI [BibTex]

no image
A Kernel Two-Sample Test

Gretton, A., Borgwardt, K., Rasch, M., Schölkopf, B., Smola, A.

Journal of Machine Learning Research, 13, pages: 723-773, March 2012 (article)

Abstract
We propose a framework for analyzing and comparing distributions, which we use to construct statistical tests to determine if two samples are drawn from different distributions. Our test statistic is the largest difference in expectations over functions in the unit ball of a reproducing kernel Hilbert space (RKHS), and is called the maximum mean discrepancy (MMD). We present two distribution-free tests based on large deviation bounds for the MMD, and a third test based on the asymptotic distribution of this statistic. The MMD can be computed in quadratic time, although efficient linear time approximations are available. Our statistic is an instance of an integral probability metric, and various classical metrics on distributions are obtained when alternative function classes are used in place of an RKHS. We apply our two-sample tests to a variety of problems, including attribute matching for databases using the Hungarian marriage method, where they perform strongly. Excellent performance is also obtained when comparing distributions over graphs, for which these are the first such tests.

PDF Web [BibTex]

Gretton, A., Borgwardt, K., Rasch, M., Schölkopf, B., Smola, A. A Kernel Two-Sample Test Journal of Machine Learning Research, 13, pages: 723-773, March 2012 (article)

PDF Web [BibTex]

no image
Learning Motor Skills: From Algorithms to Robot Experiments

Kober, J.

Technische Universität Darmstadt, Germany, March 2012 (phdthesis)

PDF [BibTex]

Kober, J. Learning Motor Skills: From Algorithms to Robot Experiments Technische Universität Darmstadt, Germany, March 2012 (phdthesis)

PDF [BibTex]

no image
Technical performance evaluation of a human brain PET/MRI system

Kolb, A., Wehrl, H., Hofmann, M., Judenhofer, M., Eriksson, L., Ladebeck, R., Lichy, M., Byars, L., Michel, C., Schlemmer, H., Schmand, M., Claussen, C., Sossi, V., Pichler, B.

European Radiology, 22(8):1776-1788, March 2012 (article)

Web DOI [BibTex]

Kolb, A., Wehrl, H., Hofmann, M., Judenhofer, M., Eriksson, L., Ladebeck, R., Lichy, M., Byars, L., Michel, C., Schlemmer, H., Schmand, M., Claussen, C., Sossi, V., Pichler, B. Technical performance evaluation of a human brain PET/MRI system European Radiology, 22(8):1776-1788, March 2012 (article)

Web DOI [BibTex]

no image
Real-time detection of colored objects in multiple camera streams with off-the-shelf hardware components

Lampert, C., Peters, J.

Journal of Real-Time Image Processing, 7(1):31-41, March 2012 (article)

Abstract
We describe RTblob, a high speed vision system that detects objects in cluttered scenes based on their color and shape at a speed of over 800 frames/s. Because the system is available as open-source software and relies only on off-the-shelf PC hardware components, it can provide the basis for multiple application scenarios. As an illustrative example, we show how RTblob can be used in a robotic table tennis scenario to estimate ball trajectories through 3D space simultaneously from four cameras images at a speed of 200 Hz.

PDF PDF DOI [BibTex]

no image
A short note on parameter approximation for von Mises-Fisher distributions: and a fast implementation of Is(x)

Sra, S.

Computational Statistics, 27(1):177-190, March 2012 (article)

Abstract
In high-dimensional directional statistics one of the most basic probability distributions is the von Mises-Fisher (vMF) distribution. Maximum likelihood estimation for the vMF distribution turns out to be surprisingly hard because of a difficult transcendental equation that needs to be solved for computing the concentration parameter κ. This paper is a followup to the recent paper of Tanabe et al. (Comput Stat 22(1):145–157, 2007), who exploited inequalities about Bessel function ratios to obtain an interval in which the parameter estimate for κ should lie; their observation lends theoretical validity to the heuristic approximation of Banerjee et al. (JMLR 6:1345–1382, 2005). Tanabe et al. (Comput Stat 22(1):145–157, 2007) also presented a fixed-point algorithm for computing improved approximations for κ. However, their approximations require (potentially significant) additional computation, and in this short paper we show that given the same amount of computation as their method, one can achieve more accurate approximations using a truncated Newton method. A more interesting contribution of this paper is a simple algorithm for computing I s (x): the modified Bessel function of the first kind. Surprisingly, our naïve implementation turns out to be several orders of magnitude faster for large arguments common to high-dimensional data, than the standard implementations in well-established software such as Mathematica ©, Maple ©, and Gp/Pari.

PDF PDF DOI [BibTex]

no image
An online brain–computer interface based on shifting attention to concurrent streams of auditory stimuli

Hill, N., Schölkopf, B.

Journal of Neural Engineering, 9(2):026011, February 2012 (article)

Abstract
We report on the development and online testing of an electroencephalogram-based brain–computer interface (BCI) that aims to be usable by completely paralysed users—for whom visual or motor-system-based BCIs may not be suitable, and among whom reports of successful BCI use have so far been very rare. The current approach exploits covert shifts of attention to auditory stimuli in a dichotic-listening stimulus design. To compare the efficacy of event-related potentials (ERPs) and steady-state auditory evoked potentials (SSAEPs), the stimuli were designed such that they elicited both ERPs and SSAEPs simultaneously. Trial-by-trial feedback was provided online, based on subjects' modulation of N1 and P3 ERP components measured during single 5 s stimulation intervals. All 13 healthy subjects were able to use the BCI, with performance in a binary left/right choice task ranging from 75% to 96% correct across subjects (mean 85%). BCI classification was based on the contrast between stimuli in the attended stream and stimuli in the unattended stream, making use of every stimulus, rather than contrasting frequent standard and rare 'oddball' stimuli. SSAEPs were assessed offline: for all subjects, spectral components at the two exactly known modulation frequencies allowed discrimination of pre-stimulus from stimulus intervals, and of left-only stimuli from right-only stimuli when one side of the dichotic stimulus pair was muted. However, attention modulation of SSAEPs was not sufficient for single-trial BCI communication, even when the subject's attention was clearly focused well enough to allow classification of the same trials via ERPs. ERPs clearly provided a superior basis for BCI. The ERP results are a promising step towards the development of a simple-to-use, reliable yes/no communication system for users in the most severely paralysed states, as well as potential attention-monitoring and -training applications outside the context of assistive technology.

PDF DOI [BibTex]

no image
A non-monotonic method for large-scale non-negative least squares

Kim, D., Sra, S., Dhillon, I. S.

Optimization Methods and Software, 28(5):1012-1039, Febuary 2012 (article)

DOI [BibTex]

Kim, D., Sra, S., Dhillon, I. S. A non-monotonic method for large-scale non-negative least squares Optimization Methods and Software, 28(5):1012-1039, Febuary 2012 (article)

DOI [BibTex]

no image
Inferring Networks of Diffusion and Influence

Gomez Rodriguez, M., Leskovec, J., Krause, A.

ACM Transactions on Knowledge Discovery from Data, 5(4:21), February 2012 (article)

Abstract
Information diffusion and virus propagation are fundamental processes taking place in networks. While it is often possible to directly observe when nodes become infected with a virus or publish the information, observing individual transmissions (who infects whom, or who influences whom) is typically very difficult. Furthermore, in many applications, the underlying network over which the diffusions and propagations spread is actually unobserved. We tackle these challenges by developing a method for tracing paths of diffusion and influence through networks and inferring the networks over which contagions propagate. Given the times when nodes adopt pieces of information or become infected, we identify the optimal network that best explains the observed infection times. Since the optimization problem is NP-hard to solve exactly, we develop an efficient approximation algorithm that scales to large datasets and finds provably near-optimal networks. We demonstrate the effectiveness of our approach by tracing information diffusion in a set of 170 million blogs and news articles over a one year period to infer how information flows through the online media space. We find that the diffusion network of news for the top 1,000 media sites and blogs tends to have a core-periphery structure with a small set of core media sites that diffuse information to the rest of the Web. These sites tend to have stable circles of influence with more general news media sites acting as connectors between them.

Web DOI [BibTex]

Gomez Rodriguez, M., Leskovec, J., Krause, A. Inferring Networks of Diffusion and Influence ACM Transactions on Knowledge Discovery from Data, 5(4:21), February 2012 (article)

Web DOI [BibTex]

no image
High Gamma-Power Predicts Performance in Brain-Computer Interfacing

Grosse-Wentrup, M., Schölkopf, B.

(3), Max-Planck-Institut für Intelligente Systeme, Tübingen, February 2012 (techreport)

Abstract
Subjects operating a brain-computer interface (BCI) based on sensorimotor rhythms exhibit large variations in performance over the course of an experimental session. Here, we show that high-frequency gamma-oscillations, originating in fronto-parietal networks, predict such variations on a trial-to-trial basis. We interpret this nding as empirical support for an in uence of attentional networks on BCI-performance via modulation of the sensorimotor rhythm.

PDF [BibTex]

Grosse-Wentrup, M., Schölkopf, B. High Gamma-Power Predicts Performance in Brain-Computer Interfacing (3), Max-Planck-Institut für Intelligente Systeme, Tübingen, February 2012 (techreport)

PDF [BibTex]

no image
Using probabilistic estimation of expression residuals (PEER) to obtain increased power and interpretability of gene expression analyses

Stegle, O., Parts, L., Piipari, M., Winn, J., Durbin, R.

Nature Protocols, 7(3):500–507, February 2012 (article)

Abstract
We present PEER (probabilistic estimation of expression residuals), a software package implementing statistical models that improve the sensitivity and interpretability of genetic associations in population-scale expression data. This approach builds on factor analysis methods that infer broad variance components in the measurements. PEER takes as input transcript profiles and covariates from a set of individuals, and then outputs hidden factors that explain much of the expression variability. Optionally, these factors can be interpreted as pathway or transcription factor activations by providing prior information about which genes are involved in the pathway or targeted by the factor. The inferred factors are used in genetic association analyses. First, they are treated as additional covariates, and are included in the model to increase detection power for mapping expression traits. Second, they are analyzed as phenotypes themselves to understand the causes of global expression variability. PEER extends previous related surrogate variable models and can be implemented within hours on a desktop computer.

PDF DOI [BibTex]

Stegle, O., Parts, L., Piipari, M., Winn, J., Durbin, R. Using probabilistic estimation of expression residuals (PEER) to obtain increased power and interpretability of gene expression analyses Nature Protocols, 7(3):500–507, February 2012 (article)

PDF DOI [BibTex]

no image
Context-aware brain-computer interfaces: exploring the information space of user, technical system and environment

Zander, TO., Jatzev, S.

Journal of Neural Engineering, 9(1):016003, 10, February 2012 (article)

Abstract
Brain–computer interface (BCI) systems are usually applied in highly controlled environments such as research laboratories or clinical setups. However, many BCI-based applications are implemented in more complex environments. For example, patients might want to use a BCI system at home, and users without disabilities could benefit from BCI systems in special working environments. In these contexts, it might be more difficult to reliably infer information about brain activity, because many intervening factors add up and disturb the BCI feature space. One solution for this problem would be adding context awareness to the system. We propose to augment the available information space with additional channels carrying information about the user state, the environment and the technical system. In particular, passive BCI systems seem to be capable of adding highly relevant context information—otherwise covert aspects of user state. In this paper, we present a theoretical framework based on general human–machine system research for adding context awareness to a BCI system. Building on that, we present results from a study on a passive BCI, which allows access to the covert aspect of user state related to the perceived loss of control. This study is a proof of concept and demonstrates that context awareness could beneficially be implemented in and combined with a BCI system or a general human–machine system. The EEG data from this experiment are available for public download at www.phypa.org.

PDF DOI [BibTex]

Zander, TO., Jatzev, S. Context-aware brain-computer interfaces: exploring the information space of user, technical system and environment Journal of Neural Engineering, 9(1):016003, 10, February 2012 (article)

PDF DOI [BibTex]

no image
Expectation-Maximization methods for solving (PO)MDPs and optimal control problems

Toussaint, M., Storkey, A., Harmeling, S.

In Inference and Learning in Dynamic Models, (Editors: Barber, D., Cemgil, A.T. and Chiappa, S.), Cambridge University Press, Cambridge, UK, January 2012 (inbook) In press

PDF [BibTex]

Toussaint, M., Storkey, A., Harmeling, S. Expectation-Maximization methods for solving (PO)MDPs and optimal control problems In Inference and Learning in Dynamic Models, (Editors: Barber, D., Cemgil, A.T. and Chiappa, S.), Cambridge University Press, Cambridge, UK, January 2012 (inbook) In press

PDF [BibTex]

no image
Personalized medicine: from genotypes and molecular phenotypes towards computed therapy

Stegle, O., Roth, FP., Morris, Q., Listgarten, J.

In pages: 323-326, (Editors: Altman, R.B. , A.K. Dunker, L. Hunter, T. Murray, T.E. Klein), World Scientific Publishing, Singapore, Pacific Symposium on Biocomputing (PSB), January 2012 (inproceedings)

Abstract
Joint genotyping and large-scale phenotyping of molecular traits are currently available for a number of important patient study cohorts and will soon become feasible in routine medical practice. These data are one component of several that are setting the stage for the development of personalized medicine, promising to yield better disease classification, enabling more specific treatment, and also allowing for improved preventive medical screening. This conference session explores statistical challenges and new opportunities that arise from application of genome-scale experimentation for personalized genomics and medicine.

Web DOI [BibTex]

Stegle, O., Roth, FP., Morris, Q., Listgarten, J. Personalized medicine: from genotypes and molecular phenotypes towards computed therapy In pages: 323-326, (Editors: Altman, R.B. , A.K. Dunker, L. Hunter, T. Murray, T.E. Klein), World Scientific Publishing, Singapore, Pacific Symposium on Biocomputing (PSB), January 2012 (inproceedings)

Web DOI [BibTex]

no image
Approximate Gaussian Integration using Expectation Propagation

Cunningham, J., Hennig, P., Lacoste-Julien, S.

In pages: 1-11, -, January 2012 (inproceedings) Submitted

Abstract
While Gaussian probability densities are omnipresent in applied mathematics, Gaussian cumulative probabilities are hard to calculate in any but the univariate case. We offer here an empirical study of the utility of Expectation Propagation (EP) as an approximate integration method for this problem. For rectangular integration regions, the approximation is highly accurate. We also extend the derivations to the more general case of polyhedral integration regions. However, we find that in this polyhedral case, EP's answer, though often accurate, can be almost arbitrarily wrong. These unexpected results elucidate an interesting and non-obvious feature of EP not yet studied in detail, both for the problem of Gaussian probabilities and for EP more generally.

Web [BibTex]

Cunningham, J., Hennig, P., Lacoste-Julien, S. Approximate Gaussian Integration using Expectation Propagation In pages: 1-11, -, January 2012 (inproceedings) Submitted

Web [BibTex]

no image
How the initialization affects the stability of the k-means algorithm

Bubeck, S., Meila, M., von Luxburg, U.

ESAIM: Probability and Statistics, 16, pages: 436-452, January 2012 (article)

Web DOI [BibTex]

Bubeck, S., Meila, M., von Luxburg, U. How the initialization affects the stability of the k-means algorithm ESAIM: Probability and Statistics, 16, pages: 436-452, January 2012 (article)

Web DOI [BibTex]

no image
Joint Modelling of Confounding Factors and Prominent Genetic Regulators Provides Increased Accuracy in Genetical Genomics Studies

Fusi, N., Stegle, O., Lawrence, ND.

PLoS Computational Biology, 8(1):1-9, January 2012 (article)

Abstract
Expression quantitative trait loci (eQTL) studies are an integral tool to investigate the genetic component of gene expression variation. A major challenge in the analysis of such studies are hidden confounding factors, such as unobserved covariates or unknown subtle environmental perturbations. These factors can induce a pronounced artifactual correlation structure in the expression profiles, which may create spurious false associations or mask real genetic association signals. Here, we report PANAMA (Probabilistic ANAlysis of genoMic dAta), a novel probabilistic model to account for confounding factors within an eQTL analysis. In contrast to previous methods, PANAMA learns hidden factors jointly with the effect of prominent genetic regulators. As a result, this new model can more accurately distinguish true genetic association signals from confounding variation. We applied our model and compared it to existing methods on different datasets and biological systems. PANAMA consistently performs better than alternative methods, and finds in particular substantially more trans regulators. Importantly, our approach not only identifies a greater number of associations, but also yields hits that are biologically more plausible and can be better reproduced between independent studies. A software implementation of PANAMA is freely available online at http://ml.sheffield.ac.uk/qtl/.

Web DOI [BibTex]

Fusi, N., Stegle, O., Lawrence, ND. Joint Modelling of Confounding Factors and Prominent Genetic Regulators Provides Increased Accuracy in Genetical Genomics Studies PLoS Computational Biology, 8(1):1-9, January 2012 (article)

Web DOI [BibTex]

no image
Simultaneous small animal PET/MR reveals different brain networks during stimulation and rest

Wehrl, H., Hossain, M., Lankes, K., Liu, C., Bezrukov, I., Martirosian, P., Reischl, G., Schick, F., Pichler, B.

World Molecular Imaging Congress (WMIC), 2012 (talk)

[BibTex]

Wehrl, H., Hossain, M., Lankes, K., Liu, C., Bezrukov, I., Martirosian, P., Reischl, G., Schick, F., Pichler, B. Simultaneous small animal PET/MR reveals different brain networks during stimulation and rest World Molecular Imaging Congress (WMIC), 2012 (talk)

[BibTex]

no image
Kernel Topic Models

Hennig, P., Stern, D., Herbrich, R., Graepel, T.

In Fifteenth International Conference on Artificial Intelligence and Statistics, 22, pages: 511-519, JMLR Proceedings, (Editors: Lawrence, N. D. and Girolami, M.), JMLR.org, AISTATS , 2012 (inproceedings)

Abstract
Latent Dirichlet Allocation models discrete data as a mixture of discrete distributions, using Dirichlet beliefs over the mixture weights. We study a variation of this concept, in which the documents' mixture weight beliefs are replaced with squashed Gaussian distributions. This allows documents to be associated with elements of a Hilbert space, admitting kernel topic models (KTM), modelling temporal, spatial, hierarchical, social and other structure between documents. The main challenge is efficient approximate inference on the latent Gaussian. We present an approximate algorithm cast around a Laplace approximation in a transformed basis. The KTM can also be interpreted as a type of Gaussian process latent variable model, or as a topic model conditional on document features, uncovering links between earlier work in these areas.

PDF Web [BibTex]

Hennig, P., Stern, D., Herbrich, R., Graepel, T. Kernel Topic Models In Fifteenth International Conference on Artificial Intelligence and Statistics, 22, pages: 511-519, JMLR Proceedings, (Editors: Lawrence, N. D. and Girolami, M.), JMLR.org, AISTATS , 2012 (inproceedings)

PDF Web [BibTex]

no image
Bayesian flexible fitting of biomolecular structures into EM maps

Habeck, M.

Biophysical journal, 2012 (article) Submitted

[BibTex]

Habeck, M. Bayesian flexible fitting of biomolecular structures into EM maps Biophysical journal, 2012 (article) Submitted

[BibTex]

no image
Structured Apprenticeship Learning

Boularias, A., Kroemer, O., Peters, J.

In European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD), 2012 (inproceedings)

PDF Web [BibTex]

Boularias, A., Kroemer, O., Peters, J. Structured Apprenticeship Learning In European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD), 2012 (inproceedings)

PDF Web [BibTex]

no image
Identifying endogenous rhythmic spatio-temporal patterns in micro-electrode array recordings

Besserve, M., Panagiotaropoulos, T., Crocker, B., Kapoor, V., Tolias, A., Panzeri, S., Logothetis, N.

9th annual Computational and Systems Neuroscience meeting (Cosyne), 2012 (poster)

[BibTex]

Besserve, M., Panagiotaropoulos, T., Crocker, B., Kapoor, V., Tolias, A., Panzeri, S., Logothetis, N. Identifying endogenous rhythmic spatio-temporal patterns in micro-electrode array recordings 9th annual Computational and Systems Neuroscience meeting (Cosyne), 2012 (poster)

[BibTex]

no image
Blind Correction of Optical Aberrations

Schuler, C., Hirsch, M., Harmeling, S., Schölkopf, B.

In Computer Vision - ECCV 2012, LNCS Vol. 7574, pages: 187-200, (Editors: A Fitzgibbon, S Lazebnik, P Perona, Y Sato, and C Schmid), Springer, Berlin, Germany, 12th IEEE European Conference on Computer Vision, ECCV, 2012 (inproceedings)

Abstract
Camera lenses are a critical component of optical imaging systems, and lens imperfections compromise image quality. While traditionally, sophisticated lens design and quality control aim at limiting optical aberrations, recent works [1,2,3] promote the correction of optical flaws by computational means. These approaches rely on elaborate measurement procedures to characterize an optical system, and perform image correction by non-blind deconvolution. In this paper, we present a method that utilizes physically plausible assumptions to estimate non-stationary lens aberrations blindly, and thus can correct images without knowledge of specifics of camera and lens. The blur estimation features a novel preconditioning step that enables fast deconvolution. We obtain results that are competitive with state-of-the-art non-blind approaches.

PDF Web DOI [BibTex]

Schuler, C., Hirsch, M., Harmeling, S., Schölkopf, B. Blind Correction of Optical Aberrations In Computer Vision - ECCV 2012, LNCS Vol. 7574, pages: 187-200, (Editors: A Fitzgibbon, S Lazebnik, P Perona, Y Sato, and C Schmid), Springer, Berlin, Germany, 12th IEEE European Conference on Computer Vision, ECCV, 2012 (inproceedings)

PDF Web DOI [BibTex]

no image
Interactive Domain Adaptation Technique for the Classification of Remote Sensing Images

Persello, C., Dinuzzo, F.

In IEEE International Geoscience and Remote Sensing Symposium , pages: 6872-6875, IEEE, IGARSS, 2012 (inproceedings)

DOI [BibTex]

Persello, C., Dinuzzo, F. Interactive Domain Adaptation Technique for the Classification of Remote Sensing Images In IEEE International Geoscience and Remote Sensing Symposium , pages: 6872-6875, IEEE, IGARSS, 2012 (inproceedings)

DOI [BibTex]

no image
Point Cloud Completion Using Symmetries and Extrusions

Kroemer, O., Ben Amor, H., Ewerton, M., Peters, J.

In IEEE-RAS International Conference on Humanoid Robots , pages: 680-685, IEEE, HUMANOIDS, 2012 (inproceedings)

DOI [BibTex]

Kroemer, O., Ben Amor, H., Ewerton, M., Peters, J. Point Cloud Completion Using Symmetries and Extrusions In IEEE-RAS International Conference on Humanoid Robots , pages: 680-685, IEEE, HUMANOIDS, 2012 (inproceedings)

DOI [BibTex]

no image
Reconstruction using Gaussian mixture models

Joubert, P., Habeck, M.

2012 Gordon Research Conference on Three-Dimensional Electron Microscopy (3DEM), 2012 (poster)

Web [BibTex]

Joubert, P., Habeck, M. Reconstruction using Gaussian mixture models 2012 Gordon Research Conference on Three-Dimensional Electron Microscopy (3DEM), 2012 (poster)

Web [BibTex]

no image
Support Measure Machines for Quasar Target Selection

Muandet, K.

Astro Imaging Workshop, 2012 (talk)

Abstract
In this talk I will discuss the problem of quasar target selection. The objects attributes in astronomy such as fluxes are often subjected to substantial and heterogeneous measurement uncertainties, especially for the medium-redshift between 2.2 and 3.5 quasars which is relatively rare and must be targeted down to g ~ 22 mag. Most of the previous works for quasar target selection includes UV-excess, kernel density estimation, a likelihood approach, and artificial neural network cannot directly deal with the heterogeneous input uncertainties. Recently, extreme deconvolution (XD) has been used to tackle this problem in a well-posed manner. In this work, we present a discriminative approach for quasar target selection that can deal with input uncertainties directly. To do so, we represent each object as a Gaussian distribution whose mean is the object's attribute vector and covariance is the given flux measurement uncertainty. Given a training set of Gaussian distributions, the support measure machines (SMMs) algorithm are trained and used to build the quasar targeting catalog. Preliminary results will also be presented. Joint work with Jo Bovy and Bernhard Sch{\"o}lkopf

Web [BibTex]

no image
Measurement and Calibration of Noise Bias in Weak Lensing Galaxy Shape Estimation

Kacprzak, T., Zuntz, J., Rowe, B., Bridle, S., Refregier, A., Amara, A., Voigt, L., Hirsch, M.

Monthly Notices of the Royal Astronomical Society (MNRAS), 2012 (article)

[BibTex]

Kacprzak, T., Zuntz, J., Rowe, B., Bridle, S., Refregier, A., Amara, A., Voigt, L., Hirsch, M. Measurement and Calibration of Noise Bias in Weak Lensing Galaxy Shape Estimation Monthly Notices of the Royal Astronomical Society (MNRAS), 2012 (article)

[BibTex]

no image
The representer theorem for Hilbert spaces: a necessary and sufficient condition

Dinuzzo, F., Schölkopf, B.

In Advances in Neural Information Processing Systems 25, pages: 189-196, (Editors: P Bartlett, FCN Pereira, CJC. Burges, L Bottou, and KQ Weinberger), Curran Associates Inc., 26th Annual Conference on Neural Information Processing Systems (NIPS), 2012 (inproceedings)

PDF [BibTex]

Dinuzzo, F., Schölkopf, B. The representer theorem for Hilbert spaces: a necessary and sufficient condition In Advances in Neural Information Processing Systems 25, pages: 189-196, (Editors: P Bartlett, FCN Pereira, CJC. Burges, L Bottou, and KQ Weinberger), Curran Associates Inc., 26th Annual Conference on Neural Information Processing Systems (NIPS), 2012 (inproceedings)

PDF [BibTex]

no image
PAC-Bayesian Analysis: A Link Between Inference and Statistical Physics

Seldin, Y.

Workshop on Statistical Physics of Inference and Control Theory, 2012 (talk)

Web [BibTex]

Seldin, Y. PAC-Bayesian Analysis: A Link Between Inference and Statistical Physics Workshop on Statistical Physics of Inference and Control Theory, 2012 (talk)

Web [BibTex]

no image
LMM-Lasso: A Lasso Multi-Marker Mixed Model for Association Mapping with Population Structure Correction

Rakitsch, B., Lippert, C., Stegle, O., Borgwardt, KM.

Bioinformatics, 29(2):206-214, 2012 (article)

Web DOI [BibTex]

Rakitsch, B., Lippert, C., Stegle, O., Borgwardt, KM. LMM-Lasso: A Lasso Multi-Marker Mixed Model for Association Mapping with Population Structure Correction Bioinformatics, 29(2):206-214, 2012 (article)

Web DOI [BibTex]

no image
PET Performance Measurements of a Next Generation Dedicated Small Animal PET/MR Scanner

Liu, C., Hossain, M., Lankes, K., Bezrukov, I., Wehrl, H., Kolb, A., Judenhofer, M., Pichler, B.

Nuclear Science Symposium and Medical Imaging Conference (NSS-MIC), 2012 (talk)

[BibTex]

Liu, C., Hossain, M., Lankes, K., Bezrukov, I., Wehrl, H., Kolb, A., Judenhofer, M., Pichler, B. PET Performance Measurements of a Next Generation Dedicated Small Animal PET/MR Scanner Nuclear Science Symposium and Medical Imaging Conference (NSS-MIC), 2012 (talk)

[BibTex]

no image
Inferential structure determination from NMR data

Habeck, M.

In Bayesian methods in structural bioinformatics, pages: 287-312, (Editors: Hamelryck, T., Mardia, K. V. and Ferkinghoff-Borg, J.), Springer, New York, 2012 (inbook)

[BibTex]

Habeck, M. Inferential structure determination from NMR data In Bayesian methods in structural bioinformatics, pages: 287-312, (Editors: Hamelryck, T., Mardia, K. V. and Ferkinghoff-Borg, J.), Springer, New York, 2012 (inbook)

[BibTex]

no image
Same, same, but different: EEG correlates of n-back and span working memory tasks

Scharinger, C., Cienak, G., Walter, C., Zander, TO., Gerjets, P.

In Proceedings of the 48th Congress of the German Society for Psychology, 2012 (inproceedings)

[BibTex]

Scharinger, C., Cienak, G., Walter, C., Zander, TO., Gerjets, P. Same, same, but different: EEG correlates of n-back and span working memory tasks In Proceedings of the 48th Congress of the German Society for Psychology, 2012 (inproceedings)

[BibTex]

no image
Structure and Dynamics of Diffusion Networks

Gomez Rodriguez, M.

Department of Electrical Engineering, Stanford University, 2012 (phdthesis)

Web [BibTex]

Gomez Rodriguez, M. Structure and Dynamics of Diffusion Networks Department of Electrical Engineering, Stanford University, 2012 (phdthesis)

Web [BibTex]

no image
Learning from Distributions via Support Measure Machines

Muandet, K., Fukumizu, K., Dinuzzo, F., Schölkopf, B.

26th Annual Conference on Neural Information Processing Systems (NIPS), 2012 (poster)

PDF [BibTex]

Muandet, K., Fukumizu, K., Dinuzzo, F., Schölkopf, B. Learning from Distributions via Support Measure Machines 26th Annual Conference on Neural Information Processing Systems (NIPS), 2012 (poster)

PDF [BibTex]

no image
Existential neuroscience: a functional magnetic resonance imaging investigation of neural responses to reminders of one’s mortality

Quirin, M., Loktyushin, A., Arndt, J., Küstermann, E., Lo, Y., Kuhl, J., Eggert, L.

Social Cognitive and Affective Neuroscience, 7(2):193-198, 2012 (article)

Web DOI [BibTex]

Quirin, M., Loktyushin, A., Arndt, J., Küstermann, E., Lo, Y., Kuhl, J., Eggert, L. Existential neuroscience: a functional magnetic resonance imaging investigation of neural responses to reminders of one’s mortality Social Cognitive and Affective Neuroscience, 7(2):193-198, 2012 (article)

Web DOI [BibTex]

no image
Active learning for domain adaptation in the supervised classification of remote sensing images

Persello, C., Bruzzone, L.

IEEE Transactions on Geoscience and Remote Sensing, 50(11):4468-4483, 2012 (article)

DOI [BibTex]

Persello, C., Bruzzone, L. Active learning for domain adaptation in the supervised classification of remote sensing images IEEE Transactions on Geoscience and Remote Sensing, 50(11):4468-4483, 2012 (article)

DOI [BibTex]

no image
Robot Learning

Sigaud, O., Peters, J.

In Encyclopedia of the sciences of learning, (Editors: Seel, N.M.), Springer, Berlin, Germany, 2012 (inbook)

Web [BibTex]

Sigaud, O., Peters, J. Robot Learning In Encyclopedia of the sciences of learning, (Editors: Seel, N.M.), Springer, Berlin, Germany, 2012 (inbook)

Web [BibTex]

no image
Probabilistic Modeling of Human Movements for Intention Inference

Wang, Z., Deisenroth, M., Ben Amor, H., Vogt, D., Schölkopf, B., Peters, J.

In Proceedings of Robotics: Science and Systems VIII, pages: 8, R:SS, 2012 (inproceedings)

Abstract
Inference of human intention may be an essential step towards understanding human actions [21] and is hence important for realizing efficient human-robot interaction. In this paper, we propose the Intention-Driven Dynamics Model (IDDM), a latent variable model for inferring unknown human intentions. We train the model based on observed human behaviors/actions and we introduce an approximate inference algorithm to efficiently infer the human’s intention from an ongoing action. We verify the feasibility of the IDDM in two scenarios, i.e., target inference in robot table tennis and action recognition for interactive humanoid robots. In both tasks, the IDDM achieves substantial improvements over state-of-the-art regression and classification.

PDF link (url) [BibTex]

Wang, Z., Deisenroth, M., Ben Amor, H., Vogt, D., Schölkopf, B., Peters, J. Probabilistic Modeling of Human Movements for Intention Inference In Proceedings of Robotics: Science and Systems VIII, pages: 8, R:SS, 2012 (inproceedings)

PDF link (url) [BibTex]

no image
Solving Nonlinear Continuous State-Action-Observation POMDPs for Mechanical Systems with Gaussian Noise

Deisenroth, M., Peters, J.

In The 10th European Workshop on Reinforcement Learning (EWRL), 2012 (inproceedings)

[BibTex]

Deisenroth, M., Peters, J. Solving Nonlinear Continuous State-Action-Observation POMDPs for Mechanical Systems with Gaussian Noise In The 10th European Workshop on Reinforcement Learning (EWRL), 2012 (inproceedings)

[BibTex]