A new machine learning model hallucinates an image of what a sentence looks like in a language.
According to a recentresearch paper, the technique then uses visualization and other clues to aid with translation.
Its part of a growing movement to use AI to understand language.
Oscar Wong / Getty Images
“Understanding context is difficult because it is like dealing with unstructured data.
This is where natural language processing (NLP) is useful.
NLP is a branch of AI that addresses the differences in how we communicate using machine reading comprehension.
It looks at the meaning.”
These systems are increasing the power of chatbots that are currently only trained and capable of specific conversations…
The team claims their method improves the accuracy of machine translation over text-only translation.
One transformer generates a visual hallucination, and the other performs multimodal translation using outputs from the first transformer.
AI Understanding
Considerable research is focused on advancing NLP, Cudney pointed out.
Google and Meta are also working to develop conversational AI with their systemcalled LAMDA.
