Search...

Sunday, November 16, 2014

Natural Language Processing in AI? Natural Language Processing (NLP) & its 7 stages? About Computer Language and Natural Language?

A natural language is just like a human language which we use for communication like English, Hindi, Gujarati, Bengali, Arabic ....etc. The one of the main aim of AI is to build a machine that can understand commands written or spoken in natural Language. It is not a easy task to teach a person or a computer, a natural language. The problem is Syntax ( rules governing the way in which the words are arranged) & understanding context


Natural Language (NL) v/s. Computer Language (CL): 

1) NL are those which we use for communication like English, Gujarati etc. 

2) NL are expressive(expression) and easy to use. 

3) CL are those which we use for controlling the operations of computer like C, C++, JAVA etc. 

4) CL are easy to understand for programmers but not expressive. 


Applications of NLP:  Voice recognition, Machine translation, Information visualization, Grammar checking System etc. 


Generic AI System Architecture: 


Logical Steps in NLP: 

  1. Phonetics & Phonology 
  2. Morphological Analysis 
  3. Syntactic Analysis 
  4. Lexical Analysis 
  5. Semantic Analysis 
  6. Discourse Integration 
  7. Pragmatic Analysis

  1) Phonetics & Phonology:  

Phonetics: 

  • Pronunciation of different speakers. 
  • Deals with physical building blocks of language sound system. 
  • Pace of Speech. 
Ex:  I ate eight cake, different 'k' sounds in 'kite', 'coat', That band is banned.

If we speak in foreign English ( I 8 8 cake) similarly k (Hindi क for kite & coat).

Phonology:   

  • Processing of a speech. 
  • Organization of speech sound with in language.
Ex:  Bank (finance) v/s. Bank (River), 

In hindi, aa-jayenge (will come) or aaj-ayenge (will come today). 


2) Morphological Analysis: 

  • Morphology is the structure of words. 
  • Various form of basic word. 
  • Make more words from less. 
Ex: dog-dogs, run-ran, bus-buses etc. 


3) Syntactic Analysis: 

  • It is concerned with the construction of sentences. 
  • Indicates how the words are related to each other.
  • Syntax tree is assigned by a grammar and a lexicon.














Explanation: 

  • a sentence is construct from noun phrase (NP)  & verb phrase (VP). 
  • Noun Phrase construct from article (art) and noun (n) .
  • verb phrase are from verb (v) and noun phrase. 

4) Lexical Analysis: 

  • Obtaining the properties of word. 
Ex: 'dog' then you can easily bring an image of dog & its properties like 4 leg, carnivore and animate. This properties is also matches with another animals like Lion. 

5) Semantic Analysis: 

  • Concerned with the meaning of language. 
  • The first step in any semantic processing is to look up the individual word in the dictionary and extract their meaning. 
Ex: 

  • The sentence "you have a colorless green ideas...." would rejected as  semantically because colorless & green makes no sense. 
  • 'Bhalo' in Bengali means 'Good' and 'Bhalo' in Gujarati means 'Spear'. 
6) Discourse Integration: The meaning of Individual sentence is depend on previous sentence. 

Ex: Bill had a red balloon. 

       John wanted it. 


7) Pragmatic Analysis: 

  • Understanding the text & dialogues. 

  • It derives Knowledge from external commonsense information. 
Ex:  Do you know what time it is? 

It does not mean the speaker asking you the time!!!

We should understand what to do?


6 comments: