Egocentric Dataset of the University of Barcelona – Segmentation (EDUB-Seg) is a dataset for egocentric event segmentation acquired by the Narrative Clip, which takes a picture every 30 seconds. Our Narrative dataset, named Egocentric Dataset of the University of Barcelona – Segmentation, contains a total of 18,735 images captured by 7 different users during overall 20 days. To ensure diversity, all users were wearing the camera in different contexts: while attending a conference, on holiday, during the weekend, and during the week.
The ground truth (GT) segmentations provided are included in the folder GT. In each column a segmentation performed by a different annotator is included. Each row represents a segment in the day set, and is indicated by the initial frame and the final frame separated by a blank space. The following criteria was used to generate the annotations:
An event is a semantically perceptual unit that can be inferred by visual features, without any prior knowledge of what the camera wearer is actually doing.
If you use this dataset or any of the provided GT segmentations for any purpose, please, do not forget to cite the following papers:
[1] Talavera E, Dimiccoli M, Bolaños M, Aghaei M, Radeva P. “R-clustering for egocentric video segmentation.” In Iberian Conference on Pattern Recognition and Image Analysis 2015 Jun 17 (pp. 327-336). Springer International Publishing.
[2] Dimiccoli M, Bolaños M, Talavera E, Aghaei M, Nikolov SG, Radeva P. “SR-Clustering: Semantic Regularized Clustering for Egocentric Photo Streams Segmentation.” In Computer Vision and Image Understanding Journal (CVIU). arXiv preprint arXiv:1512.07143. 2015 Dec 22.
If you have any doubt or proposal, please, do not hesitate to contact any of the first two authors:
Mariella Dimiccoli
mariella.dimiccoli@ub.edu
Marc Bolaños
marc.bolanos@ub.edu
International Workshop on Social Signal Processing and Beyond
**********************************************************************
http://www.ub.edu/cvub/SSPandBE/index.html
September 11, 2017, Catania, Italy
in association with ICIAP 2017 (http://www.iciap2017.com/)
Given the increasing quantities of personal data being gathered by individuals, the concept of a digital library of rich multimedia and sensory content for every individual is becoming a reality and fast becoming a mainstream topic for multimedia research. This is often referred to as lifelogging and there are significant challenges to be addressed in the area, concerning the gathering, enriching, searching and accessing of lifelog data.
In recent years, deep learning has achieved remarkable results in fields such as: computer vision, speech recognition and natural language processing. This DL revolution is slowly reaching the challenging problems of the medical domain, opening the doors for personalized medicine. Medical domain is characterized by high variability of data including text, imaging, and genomic data. In this talk, we will present recent advances in two domains of medical data: imaging and genomics.
First, we will introduce a simple, yet powerful pipeline for medical image segmentation that combines Fully Convolutional Networks (FCNs) with Fully Convolutional Residual Networks (FC-ResNets). We propose and examine a design that takes particular advantage of recent advances in the understanding of both Convolutional Neural Networks as well as ResNets. Our approach focuses upon the importance of a trainable pre-processing when using FC-ResNets and we show that a low-capacity FCN model can serve as a pre-processor to normalize medical input data. We show that using this pipeline, we exhibit state-of-the-art performance on the challenging Electron Microscopy benchmark, when compared to other 2D methods. We improve segmentation results on CT images of liver lesions, when contrasting with standard FCN methods. Moreover, when applying our 2D pipeline on a challenging 3D MRI prostate segmentation challenge we reach results that are competitive even when compared to 3D methods. The obtained results illustrate the strong potential and versatility of the pipeline by achieving highly accurate results on multi-modality images from different anatomical regions and organs.
Second, we will introduce a novel deep learning architecture to address the challenges posed by genomic data, where the number of input features can be orders of magnitude larger than the number of training examples, making it difficult to avoid overfitting, even when using the known regularization techniques. Improving the ability of deep learning to handle such datasets could have an important impact in medical research, more specifically in precision medicine, where high-dimensional data regarding a particular patient is used to make predictions of interest. We propose a novel neural network parameterization, that we call Diet Networks, which considerably reduces the number of free parameters in the model. The Diet Networks parametrization is based on the idea that we can first learn or provide an embedding for each input feature and then learn how to map a feature's representation to the parameters linking the value of the feature to each of the hidden units of the classifier network. We experiment on a population stratification task of interest to medical studies and show that the proposed approach can significantly reduce both the number of parameters and the error rate of the classifier. This work was accepted at ICLR 2017.
Open Postdoctoral fellowship/s in the Dept. de Matemàtiques i Informàtica at Universitat de Barcelona.
The Dept. de Matemàtiques i Informàtica (Mathematics and Computer Science) is looking for and willing to support excellent postdoctoral researchers in the fields of Machine Learning, Computer Vision and Human-Computer Interaction who are interested in applying for a Beatriu de Pinós (BP) 2016 fellowship so as to conduct a two-year postdoc at Universitat de Barcelona.
The purpose of the Beatriu de Pinós programme is to award 60 individuals grants for the hiring and incorporation of postdoctoral research staff into the Catalan science and technology system. These grants are designed for the incorporation of young researchers (who obtained their PhD between 2007 and 2014 and have not resided or worked in Spain for more than 12 months in the three years prior to date of submission of the application), so that they can improve their professional prospects and obtain an independent research position. Candidates must carry out a research and training project for the entire period of the grant, one that will allow them to progress in the development of their professional careers. Please check the website of the BP programme* for further information about this fellowship.
Some of the specific projects, we are working, include:
+ Machine Learning: Deep Learning for time series analysis, Supervised Online Learning Algorithms, Bayesian statistics and deep learning.
+ Computer Vision: Visual Lifelogging and Egocentric Vision, Neuroimage processing, Computer Vision for Food Analysis, Deep learning and Image Aesthetics, Ultrasound image analysis.
+ Human-Computer Interaction: ageing / older people, interfaces for people with mild dementia or with aphasia, universal design of STEM documents
Deadline: 0112/2016.
For further information about this postdoctoral opportunity please feel free to contact us:
Petia Radeva (petia.ivanova@ub.edu or radevap@gmail.com),
www.ub.edu/cvub,
www.cvc.uab.es/people/petia
Petia Radeva has been invited speaker to the workshop “Humanitarian and social science: from the university to the enterprise” 17 of November, 2016, Faculty of Filology, University of Barcelona.
Best paper award at CIAPR'2016 to our paper: "Deep Learning Features for Wireless Capsule Endoscopy Analysis",
by Santi Segui, Michal Drozdzal, Guillem Pascual, Carolina Malagelada, Fernando Azpiroz, Petia
Radeva and Jordi Vitrià, Lima Perú, 2016.
Petia Radeva received the International CIARP Award "Aurora Pons Porrata" in recognition of an outstanding technical contribution to the field of pattern recognition, data mining and related areas, 2016.
We got the Mention prize (II place) in the DKV competence with our App for Automatic Food Recognition for Healthy Habits Promotion! Congratulations, team!!!
The journal Medical Physics chose figures of our work on Stent analysis to use as a cover on their journal. http://www.medphys.org
Petia Radeva gave a plenary talk "Can Deep Learning and Egocentric Vision for Visual Lifelogging help us eat better?" at the CCIA'2016, organized by Xavier Binefa, UPF, Barcelona, Spain.
The prestigous GRADIANT award was assifned to Beatriz Remeseiro for the best PhD thesis applied to the ICT sector 2016.
3 abstracts accepted at the NIPS Workshop WiML'16. Congratulations, Mariella, Maya and Beatriz!
On 8 of February, 2016 
Michal Drozdzal is one of the 5 researchers who received the Pioneer Award for her doctoral thesis "Sequential image analysis for computer-aided endoscopi wireless". This is the second edition of the competition promoted by CERCA. This year a total of nineteen researchers (10 males and 9 females) participated from thirteen centres nearby. By areas, there have been 3 science projects; 7 of medical sciences and health; 3 of 6 engineering and life sciences. The jury appreciated the advanced technology that solves problems linked to the endoscopy with a significant population component and a business link which enables a good transfer of knowledge generated.
Re-memory: Cognitive Training based on autobiograohic records to exercise memory
Exposition “+HUMANS”, 17 December 2015, CCB, Barcelona Spain
The majority of patients with mild cognitive impairment develop dementia and Alzheimer's disease. Re-memory, a project financed by the Foudation “La Marató de TV3”, study a new entrenament cognitiu based on the concept of lifelogging to exrcise memory. Re-memory works in the following way: the patient carries a camera that capture automatically images from all locations visited, events in which the wearer participates, the activities that he/she participated and persons he/she interacted with. Inspired in the use of wearable cameras for first cases of amnesia, els membres of the Re-memory project create a cogntive program for training based on the autobiographic reexperimenting to positively impact the cognition and improve the memory and function of peoplewith mild cognitive impairment.
Our work on using Deep Learning techniques for endoluminal image analysis was presented as example at NVIDIA’s GPU Technical Conference (http://www.gputechconf.com/).