Russian Federation

A novel approach to automated learning of syntactic rules governing natural languages is proposed, based on using probabilities assigned to sentences (and potentially longer word sequences) by trans-former neural network language models to guide symbolic learning processes like clustering and rule induction. This method exploits the learned linguistic knowledge in transformers, without any reference to their inner representations; hence, the technique is readily adaptable to the continuous appearance of more powerful language models.

AGI-20

Guiding Symbolic Natural Language Grammar Induction via Transformer-Based Sequence Probabilities

grammar induction

unsupervised learning

transformers

## Welcome to 2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics!
This year, the conference is in Mexico City. NAACL was actually already planned for Mexico City in 2021, but due to the pandemic the entire conference was moved online. This year, finally, we get to go! So it is my sincere pleasure to welcome you to Mexico City, whether in person or virtually. Having the conference in Mexico City is a good opportunity to emphasize that NAACL is our flagship conference for ACL members not only in North America but also in Central and South America, even though NAACL has been bearing “North” in its name. At this year’s conference, we have a theme to match, with a theme track on the Languages of Latin America to showcase the linguistic diversity of the region.
 
The opportunity to present at NAACL should not depend on a researcher’s travel budget, or their family status. This is why it is so important to make virtual participation at NAACL as good an experience as possible – but we want to also provide a good experience for in-person participants. As a community, we are still working out the best way to do that. This year at NAACL, we are trying out a big virtual poster session ahead of the conference, with the hope that this will make make for a lively and interactive experience. At the same time, we are reducing virtual oral presentations, which seem to be particularly tricky to make to work well. A big thanks to the NAACL program chairs and to Luciana Benotti for all their ideas and work to improve the virtual experience. And participants, virtual as well as in-person: Please let us know what worked for you and what didn’t, so we can continue to improve hybrid conferences. 
 
I have been lucky to work with many amazing people. Without their insight, dedication and patience, and without the many hours of work they put in, NAACL would not have been possible. A huge thank you to the program chairs Helena Gomez, Kevin Duh, and Steve Bethard – you are the best! 
 
Finally, I would like to thank all authors, invited speakers and panelists, area chairs and reviewers, the volunteers organizing and chairing sessions, and all attendees, in-person and virtual. Thank you for helping us make NAACL 2024 come to life. 
 
Welcome and hope you all enjoy the conference! 
Katrin Erk 
The University of Texas at Austin 
NAACL-2024 General Chair 
*You can read the full Welcome message in the [Conference Handbook (downloadable)](https://drive.google.com/file/d/1H1NvW0VASQjkSCYgw3mr-3l4yYDSxz6B/view?usp=sharing)*

To access the event page you need to register [**here.**](http://acl.swoogo.com/naacl2024) 
Your access to the event page is limited based on your registration type. If you registered for workshops only, you will gain access to full workshops content on the day of the workshops program.

Please register!

NAACL 2024

2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics

technical paper

The AGI conference series is the only major conference series devoted wholly and specifically to the creation of AI systems possessing general intelligence at the human level and ultimately beyond. By gathering together active researchers in the field, for presentation of results and discussion of ideas, we accelerate our progress toward our common goal.

Underline hosted the two main days of AGI 2020 on Wednesday June 24th and Thursday June 25th. Both days were **live-streamed** and you can read the full program bellow. All presentations are available for a **asynchronous viewing**. All presenters are grouped into panels. You can also hear guest talks by **Ben Goertzel** (SingularityNET), **Valery Tarasov** (Semenov Institute of Chemical Physics), **Tatiana Shavrina** (Sberbank) and **Joscha Bach** (MIT Media Lab). 

The AGI conference series is the only major conference series devoted wholly and specifically to the creation of AI systems possessing general intelligence at the human level and ultimately beyond. By gathering together active researchers in the field, for presentation of results and discussion of ideas, we accelerate our progress toward our common goal.

"The complex socio-technological debate underlying safety critical and ethically relevant issues pertaining to AI development and deployment extends across heterogeneous research subfields and involves in part conflicting positions. In this context, it seems expedient to generate a minimalistic joint transdisciplinary basis disambiguating the references to specific subtypes of AI properties and risks for an error-correction in the transmission of ideas. In this paper, we introduce a high-level trans-disciplinary system clustering of ethical distinction between antithetical
clusters of Type I and Type II systems which extends a cybersecurity oriented AI safety taxonomy with considerations from psychology. Moreover, we review relevant Type I AI risks, reflect upon possible epistemological origins of hypothetical Type II AI from a cognitive sciences perspective and discuss the related human moral perception. Strikingly, our nuanced transdisciplinary analysis yields the figurative formulation of the so-called AI safety paradox identifying AI control and value alignment as conjugate requirements in AI safety. Against this backdrop, we craft
versatile multidisciplinary recommendations with ethical dimensions tailored to Type II AI safety. Overall, we suggest proactive and importantly corrective instead of prohibitive methods as common basis for both Type I and Type II AI safety."

Error-Correction for AI Safety

The videogame platform Teleport created earlier allows us to study anonymous social interactions among actors of various nature: human and virtual actor, ensuring their indistinguishability, which implies believable behavior of a virtual actor. The present study found a connection between the human player behavior in the Teleport game and her psychological portrait constructed using the sixteen-factor Catell personality test for empathy. Assuming that this connection is extendable to perception of virtual actor behavior, the game sessions data was analyzed to infer behavioral characteristics of virtual actors. Based on this data analysis, we constructed psychological characteristics of models of a virtual actor (a bot). Partner and emotional characteristics of bots were defined, and their psychological portrait was constructed based on the registered bot behavior. Personal characteristics such as courage, sociability, calmness, balance, and loyalty were attributed to bots and compared to analogous characteristics of human players.

Psychological Portrait of a Virtual Agent in the Teleport Game Paradigm

"No fundamental new ideas have appeared in AI for decades because of a deadlocked discussion between the technologists and their philosophical critics. Both sides claim possession of the one (dogmatic) truth: Technologists are committed to writing code, while critics insist that AI bears no resemblance to how humans cope in the world. The book charts a middle course between the critics and practitioners of AI, remaining committed to writing code while maintaining a fixed gaze on the human condition. This is done by reviving a technique long-shunned in cognitive science: Introspection. Introspection was rejected as a scientific method since 1913, but technology is committed to “what works” rather than to science’s “best explanation”. Introspection is shown to be both a legitimate and a promising source of ideas for AI. The book details the development process of AI based on introspection, from the initial introspective descriptions to working code.
This book is unique in that it starts with philosophical (and historical) discussions, and ends with examples of working novel algorithms. The book was originally a PhD thesis. It was edited for book form with two new chapters added."

Report on “AI and Human Thought and Emotion”

Central scholars in AI have argued for extending the search for new AI technology beyond the tried-and-tested biologically and mathematically-inspired algorithms. Following in their footsteps, areas in the humanities are introduced as possible inspirations for novel human-like AI. Topics discussed include play-acting, literature as the field researching both imagination and metaphors, linguistics, music, and hermeneutics. In our ambition to reach general intelligence, we cannot afford to ignore these avenues of research.

AGI Needs the Humaities

Social virtual actors need to interact with users emotionally, convincing them in their ability to understand human minds. For this to happen, an artificial general emotional intelligence is needed, capable of believable behavior in real-life situations. Summarizing recent work of the authors, the present work extends the general state-of-the-art framework of emotional AGI, using the emotional Biologically Inspired Cognitive Architecture (eBICA) as a basis. In addition to appraisals, other kinds of fluents are added to the model, including somatic markers, feelings, emotional biases, moods, etc. Their integration is achieved based on semantic maps and moral schemas. It is anticipated that the proposed new level of artificial general socially emotional intelligence will complement the next-generation AGI, helping it to merge into our society on equal with its human members.

Toward a General Believable Model of Human-Analogous Intelligent Socially Emotional Behavior

The DeepWalk algorithm is used to assign embedding vec- tors to nodes in the Atomspace weighted, labeled hypergraph that is used to represent knowledge in the OpenCog AGI system, in the con- text of an application to probabilistic inference regarding the causes of longevity based on data from biological ontologies and genomic analyses. It is shown that vector difference operations between embedding vectors are, in appropriate conditions, approximately alignable with “intensional difference” operations between the hypergraph nodes corresponding to the embedding vectors. This relationship hints at a broader functorial mapping between uncertain intensional logic and vector arithmetic, and opens the door for using embedding vector algebra to guide intensional inference control.

Embedding Vector Differences Can Be Aligned With Uncertain Intensional Logic Differences

What kind of programming language would be most appropriate to serve the needs of integrative, multi-paradigm, multi-software-system approaches to AGI? This question is broached via exploring the more particular question of how to create a more scalable and usable version of the ”Atomese” programming language that forms a key component of the OpenCog AGI design (an ”Atomese 2.0”) .

What Kind of Programming Language Best Suits Integrative AGI?

A novel computational model (CoDD) utilizing combinatory logic to create higher-order decision trees is presented. A theoretical analysis of general intelligence in terms of the formal theory of pattern recognition and pattern formation is outlined, and shown to take especially natural form in the case where patterns are expressed in CoDD language. Relationships between logical entropy and algorithmic information, and Shannon entropy and runtime complexity, are shown to be elucidated by this approach. Extension to the quantum computing case is also briefly discussed.

Combinatorial Decision Dags: A Natural Computational Model for General Intelligence

While several tools exist for training and evaluating narrow machine learning (ML) algorithms, their design generally does not follow a particular or explicit evaluation methodology or theory. Inversely so for more general learners, where many evaluation methodologies and frameworks have been suggested, but few specific tools exist. In this paper we introduce a new framework for broad evaluation of artificial intelligence (AI) learners, and a new tool that builds on this methodology. The platform, called SAGE (Simulator for Autonomy \& Generality Evaluation), works for training and evaluation of a broad range of systems and allows detailed comparison between narrow and general ML and AI. It provides a variety of tuning and task construction options, allowing isolation of single parameters across complexity dimensions. SAGE is aimed at helping AI researchers map out and compare strengths and weaknesses of divergent approaches. Our hope is that it can help deepen understanding of the various tasks we want AI systems to do and the relationship between their composition, complexity, and difficulty for various AI systems, as well as contribute to building a clearer research road map for the field. This paper provides an overview of the framework and presents results of an early use case.

SAGE: Task-Environment Platform for Evaluating a Broad Range of AI Learners

We introduce the open-ended, modular, self-improving Omega AI unification architecture which is a refinement of Solomonoff's Alpha architecture, as considered from first principles. The architecture embodies several crucial principles of general intelligence including diversity of representations, diversity of data types, integrated memory, modularity, and higher-order cognition. We retain the basic design of a fundamental algorithmic substrate called an ``AI kernel'' for problem solving and basic cognitive functions like memory, and a larger, modular architecture that re-uses the kernel in many ways. Omega includes eight representation languages, which are briefly introduced. We review the broad software architecture, higher-order cognition, self-improvement, modular neural architectures, and intelligent agents.

Downloads

Next from AGI-20

Error-Correction for AI Safety

Similar lecture

Re-evaluating the Need for Visual Signals in Unsupervised Grammar Induction

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from AGI-20

Error-Correction for AI Safety

Similar lecture

Re-evaluating the Need for Visual Signals in Unsupervised Grammar Induction

Downloads