Category Archives: Natural Language Processing

Extracting Decision Models from Text

KU Leuven scientists published the paper “Extracting Decision Model and Notation models from text using deep learning techniques“. It is the first attempt to use deep learning to extract DMN models from text. They classify sentences describing logic or dependencies, … Continue reading

Posted in Decision Modeling, Discoveries, DMN, Natural Language Processing | Leave a comment

On the Paradox of Learning to Reason from Data

Cornell University published this article on May-2022: “Logical reasoning is needed in a wide range of NLP tasks. Can a BERT model be trained end-to-end to solve logical reasoning problems presented in natural language? We attempt to answer this question … Continue reading

Posted in Artificial Intelligence, Machine Learning, Natural Language Processing | Leave a comment

Again about AI understanding

On Dec-2021 Melanie Mitchell published “What Does It Mean for AI to Understand“: “Remember IBM’s Watson, the AI Jeopardy! champion? A 2010 promotion proclaimed, “Watson understands natural language with all its ambiguity and complexity.” However, as we saw when Watson subsequently failed spectacularly in … Continue reading

Posted in Artificial Intelligence, Human-Machine Interaction, Knowledge Representation, Natural Language Processing | Leave a comment

Semantic Rules & Machine Learning

Dr. Walid Saba discusses the limitations of the data-driven, statistical and machine learning (ML) approaches that are the currently dominant paradigm in the use of natural language processing (NLP) in text analytics. Using very simple examples, he argues that these … Continue reading

Posted in Knowledge Representation, Logic and AI, Machine Learning, Natural Language Processing | Leave a comment

Why a YouTube Chat About Chess Got Flagged for Hate Speech

This WIRED article talks about shortcomings in AI programs designed to automatically detect hate speech, abuse, and misinformation online. When WIRED fed some of statements gathered by the CMU researchers into two hate-speech classifiers, the statement “White’s attack on black is … Continue reading

Posted in Artificial Intelligence, Machine Learning, Natural Language Processing | Leave a comment

Recent Advances in Google Translate

Google Translate was introduced in 2016 and it enabled great improvements to the quality of translation for over 100 languages since then. In this post Google Research describes how recent advances in machine learning drive improvements to automated translation. Link

Posted in Artificial Intelligence, Languages, Machine Learning, Natural Language Processing | Leave a comment

GPT-3, the latest evolution in language technology – What is the big deal?

Over the summer 2020, the latest language model from OpenAI, called GPT-3, created a lot of buzz around the internet. Both within the AI community and outside people shared links to numerous examples on what GPT-3 could do, ranging from … Continue reading

Posted in Artificial Intelligence, Human-Machine Interaction, Knowledge Representation, Languages, Natural Language Processing | Leave a comment

Giving GPT-3 a Turing Test

GPT-3 is a general language model, trained on a large amount of uncategorized text from the internet. It isn’t specific to a conversational format, and it isn’t trained to answer any specific type of question. The only thing it does … Continue reading

Posted in Artificial Intelligence, Natural Language Processing | Leave a comment

Climbing Towards Natural Language Understanding

This paper “Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data” won the “Best Theme Award” at the ACL2020 AI conference.  “… in contrast to some current hype, meaning cannot be learned from form alone. This … Continue reading

Posted in Natural Language Processing | Leave a comment

The latest NLP revolution

Read an interview with Noam Shazeer who helped spark the latest NLP revolution. “He developed the multi-headed self-attention mechanism described in “Attention Is All You Need,” the 2017 paper that introduced the transformer network. That architecture became the foundation of … Continue reading

Posted in Natural Language Processing | Leave a comment