Category Archives: Natural Language Processing

Again about AI understanding

Posted on January 17, 2022 by decisionmanagementcommunity

On Dec-2021 Melanie Mitchell published “What Does It Mean for AI to Understand“: “Remember IBM’s Watson, the AI Jeopardy! champion? A 2010 promotion proclaimed, “Watson understands natural language with all its ambiguity and complexity.” However, as we saw when Watson subsequently failed spectacularly in … Continue reading →

Posted in Artificial Intelligence, Human-Machine Interaction, Knowledge Representation, Natural Language Processing | Leave a comment

Semantic Rules & Machine Learning

Posted on November 25, 2021 by decisionmanagementcommunity

Dr. Walid Saba discusses the limitations of the data-driven, statistical and machine learning (ML) approaches that are the currently dominant paradigm in the use of natural language processing (NLP) in text analytics. Using very simple examples, he argues that these … Continue reading →

Posted in Knowledge Representation, Logic and AI, Machine Learning, Natural Language Processing | Leave a comment

Why a YouTube Chat About Chess Got Flagged for Hate Speech

Posted on March 4, 2021 by decisionmanagementcommunity

This WIRED article talks about shortcomings in AI programs designed to automatically detect hate speech, abuse, and misinformation online. When WIRED fed some of statements gathered by the CMU researchers into two hate-speech classifiers, the statement “White’s attack on black is … Continue reading →

Posted in Artificial Intelligence, Machine Learning, Natural Language Processing | Leave a comment

Recent Advances in Google Translate

Posted on December 20, 2020 by decisionmanagementcommunity

Google Translate was introduced in 2016 and it enabled great improvements to the quality of translation for over 100 languages since then. In this post Google Research describes how recent advances in machine learning drive improvements to automated translation. Link

Posted in Artificial Intelligence, Languages, Machine Learning, Natural Language Processing | Leave a comment

GPT-3, the latest evolution in language technology – What is the big deal?

Posted on September 28, 2020 by decisionmanagementcommunity

Over the summer 2020, the latest language model from OpenAI, called GPT-3, created a lot of buzz around the internet. Both within the AI community and outside people shared links to numerous examples on what GPT-3 could do, ranging from … Continue reading →

Posted in Artificial Intelligence, Human-Machine Interaction, Knowledge Representation, Languages, Natural Language Processing | Leave a comment

Giving GPT-3 a Turing Test

Posted on July 22, 2020 by decisionmanagementcommunity

GPT-3 is a general language model, trained on a large amount of uncategorized text from the internet. It isn’t specific to a conversational format, and it isn’t trained to answer any specific type of question. The only thing it does … Continue reading →

Posted in Artificial Intelligence, Natural Language Processing | Leave a comment

Climbing Towards Natural Language Understanding

Posted on July 12, 2020 by decisionmanagementcommunity

This paper “Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data” won the “Best Theme Award” at the ACL2020 AI conference.  “… in contrast to some current hype, meaning cannot be learned from form alone. This … Continue reading →

Posted in Natural Language Processing | Leave a comment

The latest NLP revolution

Posted on June 17, 2020 by decisionmanagementcommunity

Read an interview with Noam Shazeer who helped spark the latest NLP revolution. “He developed the multi-headed self-attention mechanism described in “Attention Is All You Need,” the 2017 paper that introduced the transformer network. That architecture became the foundation of … Continue reading →

Posted in Natural Language Processing | Leave a comment

Extracting Data from Templatic Documents

Posted on June 12, 2020 by decisionmanagementcommunity

In this article Google researches describe a novel approach using representation learning for tackling the problem of extracting structured information from templatic documents, such as receipts, bills, or insurance quotes. They “propose an extraction system that uses knowledge of the … Continue reading →

Posted in Human-Machine Interaction, Machine Learning, Natural Language Processing | Leave a comment

More Efficient NLP Model Pre-training

Posted on March 10, 2020 by decisionmanagementcommunity

“Recent advances in language pre-training have led to substantial gains in the field of natural language processing, with state-of-the-art models such as BERT, RoBERTa, XLNet, ALBERT, and T5, among many others. These methods, though they differ in design, share the same idea of leveraging … Continue reading →

Posted in Natural Language Processing | Leave a comment