Italy

Images, videos, audio signals, sensor data, can be easily collected in huge quantity by different devices and processed in order to emulate the human capability of elaborating a variety of different stimuli. Are multimodal signals useful to understand and anticipate human actions if acquired from the user viewpoint? This paper proposes to build an embedding space where inputs of different nature, but semantically correlated, are projected in a new representation space and properly exploited to anticipate the future user activity. 
To this purpose, we built a new multimodal dataset comprising video, audio, tri-axial acceleration, angular velocity, tri-axial magnetic field, pressure and temperature.
To benchmark the proposed multimodal anticipation challenge, we consider classic classifiers on top of deep learning methods used to build the embedding space representing multimodal signals.
The achieved results show that the exploitation of different modalities is useful to improve the anticipation of the future activity.

ICPR 2020

Anticipating Activity from Multimodal Signals

action anticipation

multimodal dataset

multimodal learning

Truth and Responsibility
“Truth and Responsibility” is a call to reimagine anthropology to meet the demands of the present moment. The imperative to bear witness, take action, and be held accountable to the truths we write and circulate invites us to reflect on our responsibility in reckoning with disciplinary histories, harms, and possibilities. To whom are we giving evidence and toward what ends? For whom are we writing? To whom are we accountable, and in what ways? We are thrilled to announce the theme of the 2021 AAA Annual Meeting to be held in Baltimore, MD: Truth and Responsibility.

Many consider anthropology to be a holistic social science dedicated to cross-cultural understanding as a way to reduce bigotry and more fully comprehend “what it means to be human.” Others push against this readily circulated origin story, arguing that “human” remains a highly contested, political category—evident as the presumed set of rights and protections associated with the “human” continue to be stripped away violently in the communities in which some of us live and work. Which violent histories and epistemologies must anthropologists take responsibility for in telling truth(s) about the discipline’s development? How do the dual histories of settler colonialism and slavery continue to influence anthropological thought and practices? In these political times, how can anthropologists throughout the globe work to secure a capacious, progressive vision of the human? How might movements for anti-racism, decoloniality, queer liberation, and healing such as #BlackLivesMatter, #ProtectMaunaKea, and #MeToo push a future anthropology out of the ashes of the anthropological past? Finally, what are the limits and possibilities of the anthropological imagination?

Across subfields, we find truths in patterns of human behavior, language, evolution, and cultural worlds. Industry-positioned anthropologists do this by extending the boundaries of the discipline not as an administrative solution to job shortages but as a source of intervention and knowledge production. Increasingly, anthropologists who make use of the scientific method question how status and identity help to decide which facts come to represent truth. How might quantitative researchers use our methods to identify patterned truths, and what responsibility do we hold in challenging conventional wisdom about these patterns? What responsibility do we have to both our colleagues and larger publics, to push toward increased transparency and ethical grounding in our data collection, analysis, and presentation?

Pedagogy is a key medium for the communication of anthropological truths. Which (and whose) truths are foregrounded in our curricula? What are the possibilities for a liberatory pedagogy in a precarious, “post-truth” era? Conferences, museums, organizing spaces, and classrooms are sites where pedagogy and various forms of communication can help us interrogate the performativity of truth. How might anthropologists conceive of truth performances? Might visual, aural, and choreographic performances during AAA sessions offer anthropologists alternative genres for truth-telling and truth-making that provoke discussions about responsibility?

In accordance with the urgency of the year’s theme, the questions posed in this call for papers do not have easy answers. The hope is that those who submit proposals will take up these questions and engage in collective thinking and imagining about the truths we hold, the truths we challenge, and the responsibilities we bear in co-creating a free and more equitable world. All panel proposals should have a statement about how the panel has incorporated the goals of equity, diversity, and inclusion, and/or analysis of power.

Executive Session proposals have already been selected and speak directly to the theme “Truth and Responsibility.” To practice the critical reflexivity this call for papers invites, we asked that Executive Session submissions explicitly address the diversity of session participants, such as organizational/institutional affiliation, career stage, race, ethnicity, disability, sexuality, class, religion, national identity, and gender. Proposals for Executive Sessions that demonstrated a commitment to equity and inclusion and/or a clear analysis of power (i.e. anti-imperialist, anti-white supremacist, decolonial, anti-ableist, feminist, anti-transphobic, anti-xenophobic, etc) were given priority. We are excited to be in conversation with residents of the Baltimore region and look forward to the discussions, performances, and actions generated by the dynamic group of anthropologists attending the 2021 AAA Annual Meeting.

AAA Annual Meeting 2021

“Truth and Responsibility” is a call to reimagine anthropology to meet the demands of the present moment. The imperative to bear witness, take action, and be held accountable to the truths we write and circulate invites us to reflect on our responsibility in reckoning with disciplinary histories, harms, and possibilities. To whom are we giving evidence and toward what ends? For whom are we writing? To whom are we accountable, and in what ways? We are thrilled to announce the theme of the 2021 AAA Annual Meeting to be held in Baltimore, MD: Truth and Responsibility.

poster

ICPR 2020 is the premier international conference on Pattern Recognition, gathering leading researchers from around the world to present their latest achievements in Pattern Analysis and Recognition, applied Artificial Intelligence and Machine Learning. The topic of the year is " Putting Artificial intelligence to work on Patterns". 
For the first time, ICPR has employed a two-round review process similar to journal submissions, with new papers allowed to be submitted in either the first or second round and papers submitted in the first round and not accepted allowed to be revised and re-submitted for second round review. 

In this edition of the **ICPR 2020** Conference, there are 1407 Oral/Poster presentations organized in five Tracks: 
- Artificial Intelligence, Machine Learning for Pattern Analysis; 
- Biometrics, Human Analysis and Behavior Understanding; Computer Vision, Robotics and Intelligent Systems; 
- Document and Media Analysis; and 
- Image and Signal Processing. 

The **ICPR 2020** Main Conference program also includes 7 Keynotes from prominent world-renowned scientists, 8 Tutorials, 28 Demos, 8 Challenges, 2 Panels, as well as an Industry/Sponsor Exhibition. In addition, 41 Workshops on a range of important current and emerging research topics complete the ICPR 2020 program. 


Recent advances in sensing technologies require the design and development of pattern recognition models capable of processing spatiotemporal data efficiently. In this study, we propose a spatially and temporally aware tensor-based neural network for human pose classifiaction using three-dimensional skeleton data. Our model employs three novel components. First, an input layer capable of constructing highly discriminative spatiotemporal features. Second, a tensor fusion operation that produces compact yet rich representations of the data, and third, a tensor-based neural network that processes data representations in their original tensor form. Our model is end-to-end trainable and characterized by a small number of trainable parameters making it suitable for problems where the annotated data is limited. Experimental evaluation of the proposed model indicates that it can achieve state-of-the-art performance.


Space-Time Domain Tensor Neural Networks: An Application on Human Pose Classification

Many ML security, many paper study individual attacks, like for example evasion. In this presentation, we show why studying a single attack might be misleading in terms of robustness.

Killing four Birds with one Gaussian Process:
The relation between different Test-time attacks

In this work we introduce E-DNAS, a differentiable architecture search method, which improves the efficiency of NAS (Neural Architecture Search) methods in designing light-weight networks for the task of image classification. Concretely, E-DNAS computes, in a differentiable manner, the optimal size of a number of meta-kernels that capture patterns of the input data at different resolutions. We also leverage on the additive property of convolution operations to merge several kernels with different compatible sizes into a single one, reducing thus the number of operations and the time required to estimate the optimal configuration. We evaluate our approach on several datasets to perform classification. We report results in terms of the SoC (System on Chips) metric, typically used in the Texas Instruments TDA2x families for autonomous driving applications. The results show that our approach allows designing low latency architectures significantly faster than state-of-the-art

E-DNAS: Differentiable Neural Architecture Search for Embedded Systems

While in high demand for the development of deep learning approaches, extensive datasets of annotated unmanned aerial vehicle (UAV) imagery are still scarce today. Manual annotation, however, is time-consuming and, thus, has limited the potential for creating large-scale datasets. We tackle this challenge by presenting a procedure for the automatic creation of simulated UAV image sequences in urban areas and pixel-level annotations from publicly available data sources. We synthesize photo-realistic UAV imagery from GOOGLE EARTH STUDIO and derive annotations from an open CityGML model that not only provides geometric but also semantic information.

Derivation of Geometrically and Semantically
Annotated UAV Datasets at Large Scales from 3D
City Models

In recent years, multi-view multi-task clustering has received much attention. 
There are several real-life problems that involve both multi-view as well as multi-task clustering, i.e., the tasks are closely related, and each task can be analyzed using multiple views. Traditional multi-task multi-view clustering algorithms utilize single-objective optimization based approaches and cannot apply too-many regularization terms. However, these problems are inherently some multi-objective optimization problems because conflict may be between different views within a given task and also between different tasks, necessitating a trade-off. Based on these observations, in this paper, we have proposed a novel multi-task multi-view multi-objective optimization (MTMV-MO) based clustering algorithm which simultaneously optimizes three objectives, i.e., within-view task relation, within-task view relation and the quality of the clusters obtained. The proposed methodology (MTMV-MO) is evaluated on four different datasets and the results are compared with five state-of-the-art algorithms in terms of Adjusted Rand Index (ARI) and Classification Accuracy (%CoA). MTMV-MO illustrates an improvement of 1.5-2% in terms of ARI and 4-5% in terms of %CoA compared to the state-of-the-art algorithms.

Multi-task Multi-view Clustering using Multi-objective Optimization

The clustering of unlabeled raw images is a daunting task, which has recently been approached with some success by deep learning methods. Here we propose an unsupervised clustering framework, which learns a deep neural network in an end-to-end fashion, providing direct cluster assignments of images without additional processing. Multi-Modal Deep Clustering (MMDC), trains a deep network to align its image embeddings with target points sampled from a Gaussian Mixture Model distribution. The cluster assignments are then determined by mixture component association of image embeddings. Simultaneously, the same deep network is trained to solve an additional self-supervised task of predicting image rotations. This pushes the network to learn more meaningful image representations that facilitate a better clustering. Experimental results show that MMDC achieves or exceeds state-of-the-art performance on six challenging benchmarks. On natural image datasets we improve on previous results with significant margins of up to 20% absolute accuracy points, yielding an accuracy of 82% on CIFAR-10, 45% on CIFAR-100 and 69% on STL-10.

Multi-Modal Deep Clustering: Unsupervised Partitioning of Images

I present my work on Temporal Collaborative Filtering with applications on Recommender Systems. For this method, I employ a combination of GNNs and RNNs solving the sparsity problem in the process. Improvement in performance is observed over graph, non-graph, temporal and non-temporal state-of-the-art CF methods.

Temporal Collaborative Filtering with Graph Convolutional Neural Networks

As the specialty of hyperspectral image (HSI), it consists of 2D spatial and 1D spectral information. In the field of deep learning, HSI classification is an appealing research topic. Many existing methods process the HSI in spatial or spectral domain separately, which cannot fully extract the representative features, and the most used 3D convolutional neural network (3D-CNN) will suffer from mixing up complex spectral information. In this paper, we propose a spatial-spectral unified method by
using recurrent neural networks (RNN) and multi-scanning direction strategy to construct spatial-spectral information sequences for learning the spatial dependencies among the central pixel and neighboring pixels.

Multi-Scanning Based Recurrent Neural Network for Hyperspectral Image Classification


This paper studies the problem of Person Re-Identification (ReID)
for large-scale applications. Recent research efforts have been devoted
to building complicated part models, which introduce considerably
high computational cost and memory consumption, inhibiting its practicability
in large-scale applications. This paper aims to develop a novel learning
strategy to find efficient feature embeddings while maintaining the
balance of accuracy and model complexity. More specifically, we find
by enhancing the classical triplet loss together with cross-entropy
loss, our method can explore the hard examples and build a discriminant
feature embedding yet compact enough for large-scale applications.
Our method is carried out progressively using Bayesian optimization,
and we call it the Progressive Learning Algorithm (PLA). Extensive
experiments on three large-scale datasets show that our PLA is comparable
or better than the state-of-the-arts. Especially, on the challenging
Market-1501 dataset, we achieve Rank-1=94.7%/mAP=89.4% while saving
at least 30\% parameters than strong part models.

Prior Knowledge about Attributes Learning a More Effective Potential Space for Zero-Shot Recognition

Accurate extrinsic calibration of wide baseline multi-camera systems enables better understanding of 3D scenes for many applications and is of great practical importance. Classical Structure-from-Motion calibration methods require special calibration equipment so that accurate point correspondences can be detected between different views. In addition, an operator with some training is usually needed to ensure that data is collected in a way that leads to good calibration accuracy. This limits the ease of adoption of such technologies. Recently, methods have been proposed to use human pose estimation models to establish point correspondences, thus removing the need for any special equipment. The challenge with this approach is that human pose estimation algorithms typically produce much less accurate feature points compared to classical patch-based methods. Another problem is that ambient human motion might not be optimal for calibration. We build upon prior works and introduce several novel ideas to improve the accuracy of human-pose-based extrinsic calibration. Our first contribution is a robust reprojection loss based on a better understanding of the sources of pose estimation error. Our second contribution is a 3D human pose likelihood model learned from motion capture data. We demonstrate significant improvements in calibration accuracy by evaluating our method on four publicly available datasets.

Premium content

Downloads

Next from ICPR 2020

Space-Time Domain Tensor Neural Networks: An Application on Human Pose Classification

Similar lecture

Anticipating Others, Anticipating for Others, Anticipating with Others