Fast and Sloppy - Scaling up Linear Models
Prof. Alexander J. Smola (Yahoo! Research)
COMPUTER SYSTEMS SEMINARDATE: 2010-11-24
TIME: 16:00:00 - 17:00:00
LOCATION: CSIT Seminar Room, N101
CONTACT: JavaScript must be enabled to display this email address.
ABSTRACT:
In this talk I present an overview over a range of methods designed to scale up linear models both in terms of model complexity and in terms of their ability to process large amounts of data. The first aspect is addressed by hashing feature vectors for both prediction and matrix factorization. The second aspect can be dealt with by parallelizing stochastic gradient descent optimization procedures. I will present an algorithm suitable for multicore parallelism.
BIO:
I studied physics in Munich at the University of Technology, Munich, at the Universita degli Studi di Pavia and at AT&T Research in Holmdel. During this time I was at the Maximilianeum MAnchen and the Collegio Ghislieri in Pavia. In 1996 I received the Master degree at the University of Technology, Munich and in 1998 the Doctoral Degree in computer science at the University of Technology Berlin. Until 1999 I was a researcher at the IDA Group of the GMD Institute for Software Engineering and Computer Architecture in Berlin (now part of the Fraunhofer Geselschaft). After that, I worked as a Researcher and Group Leader at the Research School for Information Sciences and Engineering of the Australian National University. From 2004 onwards I worked as a Senior Principal Researcher and Program Leader at the Statistical Machine Learning Program at NICTA.
