Change language

NLP vs NLU vs NLG

NLP vs NLU vs NLG

natural language processing natural language understanding and natural language generation n l p n l u n l g whats the difference allow me to demonstrate now look what i just did there is well by writing a story i performed an example of natural language generation and if youre now peering at the screen reading it or even just and trying to understand and make sense of what im saying right now youre participating in natural language understanding and together you and i are both performing subsets of the overall collective of natural language processing so n l u and n l g theyre both subsets of n l p but were missing one quite important point here the natural language processing stuff that were interested in today is performed by computers not humans so when we use these terms what do we really mean and how can these models be put to work well nlp enables computers to understand human language in both written and verbal forms using deep learning techniques to complete tasks typical examples for that are things like language translation or conducting a conversation in a chat bot now it does this through the identification of named entities which is a process called named entity recognition and identification of word patterns using methods like tokenization stemming and lemmatization and ive covered some of this in a previous video about nlp so we wont go over that in detail here lets focus instead on these two things natural language understanding and natural language generation so natural language understanding uses syntactic and semantic analysis of text and speech to determine the mean ing of a sentence unlike structured computer code our unstructured messy human language has all sorts of nuances that nlu needs to account for so lets take a look at a couple of examples im going to cover some sentences here so like alice is swimming against the current this is a sentence that we could feed into an nlu algorithm and ask it to really make sense of it another example the current version of the file is in the cloud so thats two sentence examples lets take a closer look at trying to make some sense of these so weve got the word current here in this first sentence the word current is a noun and thats preceded by a verb the verb here is swimming together that provides additional context to the reader allowing us to conclude that we are referring to the flow of water in the ocean when we talk about current in this situation in the second example heres the word current and this time its an adjective and the noun it describes is version so that denotes that weve got multiple iterations of a report and here current is implying that we have the most up-to-date status of the file so two completely different mean ings for current and understanding the relationships between words and phrases is what nlu is really all about and enables us to derive the intended mean ing of a sentence now while nlu is all about improving a computers reading comprehension nlg or natural language generation focuses on enabling computers to write its the process of producing a human language text response based on some data input nlg applications need to consider language rules based on morphology lexicons syntax and semantics to make choices on how to phrase responses appropriately now nlg typically consists of three stages so if we look at nlg the first stage is text planning and text planning formulates the orders and the content in a logical manner similarly we have sentence planning and sentence planning considers things like punctuation and text flow and breaks out the content into paragraphs and sentences and then the third stage is called realization and realization ensures were playing correctly by the rules of grammar that for example we know that the past tense of the verb run is actually ran and not runned yeah thats thats not right so nlg is enabled by a variety of machine learning models to perform this stuff and that includes things like hidden markov chains recurrent neural networks and transformers look natural language processing and its subsets nlu and nlg have numerous practical applications from healthcare diagnosis to online customer service oh and another way you can use these is in hey lightboard videos in fact i asked an nlg algorithm to write me a sentence to conclude this talk and it said natural language processing is amazing and has many practical applications like me thanks nlp algorithm if you have any questions please drop us a line below and if you want to see more videos like this in the future please like and subscribe thanks for watching

Shop

Learn programming in R: courses

$

Best Python online courses for 2022

$

Best laptop for Fortnite

$

Best laptop for Excel

$

Best laptop for Solidworks

$

Best laptop for Roblox

$

Best computer for crypto mining

$

Best laptop for Sims 4

$

Latest questions

NUMPYNUMPY

Common xlabel/ylabel for matplotlib subplots

12 answers

NUMPYNUMPY

How to specify multiple return types using type-hints

12 answers

NUMPYNUMPY

Why do I get "Pickle - EOFError: Ran out of input" reading an empty file?

12 answers

NUMPYNUMPY

Flake8: Ignore specific warning for entire file

12 answers

NUMPYNUMPY

glob exclude pattern

12 answers

NUMPYNUMPY

How to avoid HTTP error 429 (Too Many Requests) python

12 answers

NUMPYNUMPY

Python CSV error: line contains NULL byte

12 answers

NUMPYNUMPY

csv.Error: iterator should return strings, not bytes

12 answers

News


Wiki

Python | How to copy data from one Excel sheet to another

Common xlabel/ylabel for matplotlib subplots

Check if one list is a subset of another in Python

sin

How to specify multiple return types using type-hints

exp

Printing words vertically in Python

exp

Python Extract words from a given string

Cyclic redundancy check in Python

Finding mean, median, mode in Python without libraries

cos

Python add suffix / add prefix to strings in a list

Why do I get "Pickle - EOFError: Ran out of input" reading an empty file?

Python - Move item to the end of the list

Python - Print list vertically