Cognitive Vision for Cognitive Systems

Fall 2012

Lecturer:

Dr. Barbara Caputo

Email: bcaputo@idiap.ch

TA:

Marco Fornoni

Email: mfornoni@idiap.ch

Class Location and Time:

Wednesday 12:15-15:00, EPFL rooms CO121 / GCA330 / MAB1486

Course Description:

This course will provide the students with a unified view on techniques that enable the construction of vision algorithms for artificial cognitive systems. The course will discuss the specific requirements of vision for artificial intelligent systems and the impact of embodiment on the required visual capabilities, while introducing methods for categorization, attention, adaptive learning and spatial perception.

Exam:

The exam will be oral and it will consists of: (1) doing lab experiences and reporting on them; (2) discussion of the lab experience report; (3) 30m presentation of a chosen paper.

Credits:

Required prior knowledge:

Basic knowledge of machine learning, linear algebra, statistics, signal and image processing.

Syllabus:

Date	Description	Slides	Papers
26/09	Course presentation, basic concepts (1h) Scene recognition: the gist of a scene (2h)	lecture 1	J. M. Wolfe, Current Biology, 1998 A. Oliva, A. Torralba, IJCV 2001 L. Fei Fei, P. Perona, CVPR 2005 S. Lazebnik et al., CVPR 2006 J. Vogel, B. Schiele, IJCV 2007 A. Quattoni, A. Torralba, CVPR 2009
03/10	Scene recognition (continued) Scene recognition: the robot's perspective	lecture 2	D. Filliat, ICRA 2007 A. Pronobis and B. Caputo, IJR 2009 J. Wu, et al., IROS 2009 A. Pronobis et al., RAS 2010 J. Xiao et al., CVPR 2010 A. Pronobis et al., IMAVIS 2010 A. Pronobis et al., IJR 2010 F. Orabona et al., PR 2010
10/10	Lab. Experience 1: Scene recognition	experience 1	code
17/10	Object recognition	lecture 3	J. Vogel and B. Schiele, CIVR 2004 S. Savarese et al., CVPR 2006 J.C. Niebles and L. Fei-Fei, CVPR 2007 E. Sudderth et al., NIPS 2005 S. Lazebnik et al., PAMI 2004 T. Serre et al., CVPR 2005 M. Vidal-Naquet and S. Ullman, ICCV 2003 S. Agarwal and D. Roth, ECCV 2002 P. N. Belhumeur et al., PAMI 1997 M. A. Turk and A. P. Pentland, CVPR 1991 H. Schneiderman and T. Kanade, IJCV 2002 D. Hoiem et al., CVPR 2007 G. Carneiro and D. Lowe, ECCV 2006 A. C. Berg et al., CVPR 2005 G. Bouchard and B. Triggs, CVPR 2005 J. Winn and J. Shotton, CVPR 2006 M. Weber et al., ECCV 2000 R. Fergus et al., CVPR 2003 D. Crandall et al, CVPR 2005 B. Leibe and B. Schiele, BMVC 2003 K. Mikolajczyk et al., CVPR 2006 A. Thomas et al., CVPR 2006 S. Mahamud et al., CVPR 2001 P. Moreels and P. Perona, IJCV 2007 V. Ferrari et al., ECCV 2004 D. G. Lowe, ICCV 1999 M.E. Nilsback and B. Caputo, CVPR 2004 A. Torralba et al., PAMI 2007 B. W. Mel, NECO 1997 P. Gehler and S. Nowozin, ICCV 2009 M. Varma and D. Ray, ICCV 2007 T. Tommasi et al., PRL 2008 B. Caputo and G. Dorko, NIPS 2002
24/10	Object detection	lecture 4	T. Serre et al., 2004 E. Bart and S. Ullman, CVPRW 2004 E. Bart and S. Ullman, CVPR 2005 M. Everingham et al., BMVC 2006 E. Borenstein and S. Ullman, ECCV 2002 N. Dalal and B. Triggs, CVPR 2005 Vittorio Ferrari et al., ECCV 2004 F. Fleuret and D. Geman, IJCV 2001 A. Rabinovich et al., ICCV 2007 A. Opelt et al., IJCV 2008 S. Kumar and M. Hebert, ICCV 2005 B. Leibe et al., SLCV 2004 R. Caruana, ML 1997 P Carbonetto et al., ECCV 2004 M. Fink and P. Perona, NIPS 2003 A. Torralba et al., PAMI 2007 S. Thrun, NIPS 2008 P. Viola and M. Jones, IJCV 2004
31/10	Object recognition: the robot vision perspective	lecture 5	C. Koch and S. Ullman, Hum Neurobiol 1985 C. Choi and H. I. Christensen, IROS 2009 Anthony Chemero, EP 2003 S. Frintrop, CAHB, 2011 J. G. Greeno, 1994 Arjan Gijsberts et al., IROS 2010 L. Itti et al., PAMI 1998 V. Navalpakkam and L. Itti, VISRES 2005 A. Pronobis, PhD Thesis 2011 E. Sahin et al., ADB 2007 Thomas A. Stoffregen, EP 2003 C. Castellini et al., AMD 2011
07/11	Lab. Experience 2, room MAB1486	experience 2	requirements.txt code data
14/11	Object recognition and detection, the robot vision way: affordances and attention
21/11	Object recognition, the robot vision way: the semantic robot vision challenge	lecture 6	P. E. Rybski and A. Efros, SRVC 2007
28/11	Transfer learning	lecture 7	T. Tommasi et al., CVPR 2012 L. Jie et al., ICCV 2011 L. Fei-Fei et al., PAMI 2006 C. Lampert et al., CVPR 2009 T. Tommasi et al, IEEE-TRO 2012 T. Tommasi et al., BMVC 2009
05/12	Domain adaptation	lecture 8	R. Gopalan et al., ICCV 2011 E. Bart et al., CVPR 2008 A. Torralba et al., CVPR 2004 A. Quattoni et al., CVPR 2008 B. Kulis et al., CVPR 2011 A. Torralba and A. Efros, CVPR 2011 F. Nater et al., ICCV 2011 workshop Z. Kira, PhD Thesis 2010 K. Saenko et al., ECCV 2010 T. Tommasi et al., ACCV 2012
12/12	Transfer learning, the robotics perspective Presentation of spotlight papers	lecture 9	K. Lai et al., ICRA 2012 A. Khosla et al., ECCV 2012 M. Guillaumin and V. Ferrari, CVPR 2012 B. Browatzki et al., ICRA 2012 D. Pangercic et al., IROS 2012 Marianna Madry et al., IROS 2012 A. Khosla et al., NIPS 2012 J. Xiao et al., CVPR 2012 A. Parkash1 and D. Parikh, ECCV 2012 A. Pronobis and P. Jensfelt, ICRA 2012 K. Rematas et al., ACCV 2012 B. Gong et al., CVPR 2012 J. Tang et al., ICRA 2012 M. Tenorth et al., ICRA 2012 B. Yao et al., CVPR 2012 M. Fornoni and B. Caputo, BMVC 2012
18/12	Lab. Experience 3	experience 3	code data
19/12	Presentation of optional laboratory experiences	optional experience 1 optional experience 2 optional experience 3