United States

JAUST (Japan US Search Tool) is a web and mobile cognitive search solution built for the US Forces Japan that enables users to quickly search and retrieve documents in historical digital archives. Physical archives (in paper or PDF format) were digitized and text was extracted using optical character recognition (OCR) and computer vision techniques. AI models (natural language processing, large language models, graph theory) are used to extract signatures, analyze, and tag documents before ingestion into an elasticsearch database. A lucene search engine is queried using a custom REST API to display results in a Graphical User Interface (web application) built with Angular. JAUST includes free text search and filtering capability (dates, locations, memo numbers) that retrieves the documents in order of relevance, highlights search terms, and displays original PDFs. JAUST is hosted in an AWS govcloud environment and includes continuous integration/deployment.

NAML 2021

JAUST: Japan US Search Tool

graph theory

optical character recognition

natural language processing

Naval Information Warfare Center Pacific is partnering with AFCEA San Diego chapter to host the workshop.

The NAML workshop is an opportunity for researchers from Navy research and development centers and our partner organizations to exchange technical ideas and to come together as a team.

The goals of NAML are:

* To spread awareness of current machine learning research relevant to Naval applications

* To connect machine learning researchers with experts in military requirements

* To build and strengthen collaborations within the defense research community

**Watch this video to hear about the AFCEA purpose.**

<iframe width=1280 height=706 frameborder="0" scrolling="no" src="https://screencast-o-matic.com/player/creleVVcvRh?v=6&ff=1&title=0&controls=1" allowfullscreen="true"></iframe>

poster

The detection and classification of passive sonar acoustics is a challenging problem faced by surface, sub surface, and naval air assets. The potential benefit of machine learning systems to assist in this task is appealing. However, little work has been conducted to develop and test machine learning models for this type of data or task. This research presents a custom Convolutional Neural Network (CNN) model designed specifically for underwater acoustic classification. This model is compared to several common CNN architectures on two datasets of hydrophone recordings of passing ships. These datasets are some of the largest datasets of ship recordings used for training CNNs to date, composed of over 4000 hours of recordings and over 400 hundred unique ships. The custom CNN shows marked improvement in performance over standard models in both multi-class and multi-label classification tasks. To the best of our knowledge, this research is the first demonstration of multi label classification on underwater soundscapes. This research demonstrates the capability of machine learning models to enhance human and unmanned systems operating in the undersea domain. This research has direct applications to both current and future Navy platforms.

Automatic detection and classification of passive sonar using Convolutional Neural Networks

Social media platforms, due to the prevalence, have become staging grounds for social warfare as antagonistic agents use social media to deceive large segments of population. Of specific concern are the coordinated campaigns orchestrated using groups of accounts to propagate false narratives. It has been observed that the coordinated campaigns by groups of social media users usually have common underlying emotions. As part of this research, we have used state-of-the-art deep learning Transformer models to extract fine grained emotions from users’ social media posts which we subsequently use to perform community detection to identify coordinated campaigns. We developed and tested our proposed methodology on a set of real-world Reddit posts. Our approach shows promise in using such a methodology to detect groups of similar users based on the emotion expressed in their social media posts. The details of our approach are described next. To start the analysis, we collected a set of Reddit public posts on a topic. Next, we used sophisticated emotion extraction to enrich the text of user social media posts. Our post emotion classification annotates social media posts and users with 27 fine-grained emotions such as optimistic, prideful, relieved, and gracious. This model can achieve state-of-the-art performance, because it uses the robust Transformer architecture that is initialized with a language learning task. Through successive layers of contextualization, the model can adapt to any natural language task. The model is first trained on a missing word task where a word in a sentence is masked and the model must predict the missing word. By doing this task on 11,000 books and the entirety of Wikipedia, the model has a strong, task-independent knowledge of the English language. Once the difficult part of teaching the model English is complete, we fine-tune the model to our task to produce a robust emotion tagging model. Once the posts are enriched and tagged with their emotion details, we use our community detection module to form communities around the extracted emotions based on social media behavior. To do this, we developed an embedding-based approach where users and emotions are translated into vector space embeddings and we use advanced mathematical operations to connect users to emotions. This allows us to identify group members in ways that go beyond plain keyword match. We extended out work to further identify influential users within a community. The process of detecting influential users is performed through a PageRank-like algorithm where connections between posts and users are leveraged to identify the key posts and users in a community. Initial experiments have shown promising results. Our emotion detector can accurately extract emotion information from posts and users. Our community detection algorithm can identify key subcommunities in a set of posts. Our influential users/post detection scores correlate strongly with Reddit social media indicators of influence.

Social Media Community Detection based on User Emotion

Bayesian optimization is a well-developed machine learning algorithm for black box optimization. In Bayesian optimization a predictive model, here a Gaussian process regression, is implemented to predict the black box function and the uncertainty of the predictive model is evaluated as predicted variance, then an acquisition function defined by the surrogate predictive model decides where to sample next. In this study we applied this technique to known ferromagnetic thin film materials such as ferromagnetic (Fe100−y Gay)1−xBx (x=0–21 & y=9–17) and (Fe100−y Gay)1−xCx (x=1–26 and y=2–18) to demonstrate optimization of structure-property relationships, specifically the dopant concentration or stoichiometry effect on magnetostriction and ferromagnetic resonance linewidth. Our results demonstrated that Bayesian optimization and regression analysis can be implemented to optimize structure-property relationships in FeGaB and FeGaC thin films. We have shown that using Bayesian optimization methods to guide experiments, the number of samples required to statistically determine the maximum or minimum was reduced by 50% compared with traditional methods. Our results suggest that Bayesian optimization can be used to save time and resources to optimize ferromagnetic films. This method is transferrable to other ferromagnetic material structure-property relationships, hence provides an accessible implementation of machine learning to magnetic materials optimization.

Application of Bayesian Optimization to Ferroic Materials Development

The objective of this work is to use machine learning to approach near real-time computation of optical propagation for high-energy lasers (HELs) under a variety of configurations and operational environments. We trained a Predictive RNN on synthetic time-series data in order to predict future states of the optical field as generated by time evolving Kolmogorov style turbulence.

Machine Learning in Optical Propagation toward Real-Time Predictive Capabilities for Navy Relevant Applications

Continuous investments in platforms capable of taking multispectral images of precipitation from space have led to consistent improvements in the accuracy of satellite-derived passive microwave (PMW) large-scale precipitation products. However, these platforms currently demonstrate a limited ability to relate observed radiometric signatures to precipitation type (convective and stratiform) and associated precipitation rate variability. Hence, PMW precipitation retrievals are prone to large systematic errors at instantaneous scales. Current research has demonstrated that deep learning neural network models (DNNs) can retrieve the convective type in precipitating systems from PMW observations with greater
accuracy than conventional methods. This study builds upon previous research in this area by presenting a Bayesian deep learning approach to extracting the information content from PMW observation vectors to classify precipitation types. A Bayesian convolutional neural network model (BCNN) is developed to retrieve the convective type in precipitating systems from PMW observations and output
the uncertainty in its predictions. A 12-month period of Global Precipitation Measurement Mission Microwave Imager (GMI) observations is used as a data corpus for model development and verification. The proposed BCNN model is shown to accurately predict precipitation types for 92% of total
precipitation volume, while outputting increased model uncertainty in regions of ambiguous or unknown data. Additionally, BCNN predictive accuracy is shown to improve when the predictions are screened via entropy filtering. Based on comparisons against currently used convective schemes and traditional DNN performance, it is concluded that the BCNN approach has the potential to address regime-specific PMW satellite precipitation biases affecting GPM operations.

Quantifying Uncertainty in Multispectral Satellite Image Classification using Bayesian Deep Learning

Deep Convolutional Neural Networks (CNN) are proven to be effective in a variety of classification and regression tasks including underwater soundscape classification. Underwater soundscape classification provides the potential for increased automation and performance for shipboard and autonomous UUV contact detection systems. Although CNN’s are a powerful technology, they have been shown to be vulnerable to adversarial attacks across different input domains. Adversarial attacks function by creating a change to the input that is imperceptible to a human observer but causes the classifier to incorrectly classify the input example. This type of attack is possible on underwater soundscape classification systems. A common approach to audio classification is to transform source audio into spectrogram images to use for classification. A digital attack that intercepts the spectrogram images prior to being input to the classifier is a possible vector of attack. Several established image-based adversarial example generation methods are tested for this purpose. Five methods successfully fooled the target classifier 31% of the time with an epsilon value of 0.005 and over 80% of the time when the epsilon value was increased to 0.01. A more reliable method of attack is to provide the adversarial example as audio input to the system. Such an attack is more desirable than a digital image-based attack for two reasons. An audio-based attack does not make any assumptions on the inner-workings of the classification system (i.e., using spectrogram images as features) and have more potential to be deployed in a physical space. Generating adversarial audio is generally more difficult than adversarial images. This is because humans are especially sensitive to small disturbances in audio that could be caused by delays due to generation time or artifacts from the generation process. This work aims to overcome these obstacles by using a training method that is similar to the training methods used by Generative Adversarial Networks (GAN). Various GAN architectures have been used to create realistic source audio. The training method differs from those used in training GANs by only training the generator network, not both the generator and discriminator. Instead, the target classifier is used in as a static discriminator. Use of the target network as a discriminator makes this a black box attack on the network. Additionally, proposed usage of perceptual evaluation metrics in the loss function, the quality of the generated audio perturbation is increased and the probability of detection by a human observer is reduced. A generative approach decreases the time to create a single adversarial example compared to other audio generation techniques, which rely on an iterative optimization approach. Improved generation speeds further decrease the likelihood of detection by a human observer and increases the potential for the attack to be deployed in a physical space.

Adversarial Attacks on Underwater Soundscape Classifiers

Publiciy available program acquisition, contracting and award data commonly include many variables per observation. In some cases, the number of variables is greater than the number of observations. This poster summarizes a method to efficiently select multivariate regression predictor variables using the R VSURF random forest package to identify important varaibles prior to applying traditional fitting methods.

Modeling Defense Acqusitions: simplifying regression predictor selection with random forests

Machine learning algorithms embedded in deep level NN (Neural Networks) require large amounts of data that are often unavailable in many existing radar receivers. The proposed NN approach provides a condensed form for training, testing, and processing radar data. The test setup uses synthetically generated pulses from a time of arrival generator. It then derives a rate of time interval change between pulses. These slopes are used for NN training and testing. A total of 20 synthetic signals were used with an 80/20 split for training and testing. The results provide a perspective on the performance with actual emitters, demonstrating an ability to distinguish the Pulse Repetition Interval (PRI) type between single Electromagnetic (EM) wave generators. Synthetic results also show an ability to differentiate between single EM wave generators and multiple EM wave generators. Future work will expand to distinguish between PRI types from multiple generators received simultaneously.

Peak to Peak NN: Condensing Electromagnetic Wave Characteristics for Neural Networks

The US Submarine Navy relies on SONAR for detection and classification of contacts to support navigation and other mission related tasks. The field of deep learning (DL) could be useful in this problem space given that it is the current state of the art approach for image and speech recognition. Supervised learning however is a data hungry process and many Navy problems have limited labeled data. An underwater acoustic classification problem that is likely to have enough labeled samples to investigate the application of DL is recognizing marine mammals from individual clicks. The objective of this project is to apply DL to underwater acoustic transient classification and determine how much training data is required for a DL classifier to compete with an existing baseline approach. This is a collaborative effort between the Naval Undersea Warfare Center (NUWC) Division, Newport, RI (NUWCDIVNPT) and the Naval Surface Warfare Center Carderock Division (NSWCCD). The NUWC research team was able to use a one dimensional convolutional neural network (1D CNN) to ingest raw time-series data previously isolated by a power law detector and achieve classification accuracy as high as 93.7% with minimal optimization of hyper-parameters. As expected, classification accuracy increased as more training data were used. Further analysis into the performance of the network raises concerns on generalization because classification accuracy is not consistent across class or by recording location of sample data. Findings from fiscal year 2020’s efforts highlight the importance of scrutinizing classifiers that show overall good performance, especially in deep learning applications where intractability prevents intuitive awareness of knee cases.

deepBioNet: Acoustic Transient Classifier

Passive identification of underwater sound sources is critical for a variety of applications including surveys of marine mammals and maritime domain awareness. Currently, the Navy can collect large sets of underwater acoustic signals. The cost and challenge lies in correctly labeling the data, which is time consuming and requires subject matter experts. The advent of machine learning makes the labeling process ripe for automation into a semi-supervised workflow. We begin with a labeled set of recordings released by the Scripps Institution of Oceanography (DCLDE 2015 and 2018) from hydrophones placed offshore in Southern California and US East Coast. In DCLDE 2015, five species were identified by experts across three sites with seven hydrophones, providing substantial variability in context and acoustic content. The DCLCE 2018 data is similar, though with nine different species identified across a variety of East Coast sites. Here the intersection of these two data sets is the presence of the Risso’s Dolphin, allowing us to test a classifier for this class on both different backgrounds and with different groups of dolphins that generated the vocalizations. Given the variety of approaches that currently exist for classification, we explore the effect on labeling performance of three fundamentally different models: transfer learning with AlexNet (image processing and classification), an SVM with precomputed acoustic features, and Temporal Convolutional Networks (TCN) with processed and raw timeseries data. Specifically, we explore generalization of these methods (robustness to different backgrounds or placement contexts) when trained in one environment and tested in another. Additionally we studied background suppression strategies and the effect of the sample distribution used to train the model. We found that generalization of the TCN and SVM model was dependent on mitigating the background and providing the correct blend of labeled training data. AlexNet transfer learning performance was found to be consistent despite changes in class balancing and the three background treatments tested.

Next from NAML 2021

Automatic detection and classification of passive sonar using Convolutional Neural Networks

Similar lecture

Automated Knowledge Graphs