FREE Live Master Session: Code Your AI Companion for Kids

    Register for Free →
    Subject 417 • Unit 6 • 8 Marks Theory + 7 Practical Hours

    Unit 6: Natural Language Processing (NLP)Text Normalisation, Stemming, Bag of Words & TF-IDF

    The complete, high-scoring study guide for CBSE Class 10 AI Unit 6. Master human language ambiguities, the 5 stages of NLP, Script-bots vs Smart-bots, Text Normalisation pipelines, Stemming vs Lemmatization, Bag of Words vectorization, step-by-step TF-IDF math on the official handbook corpus, and official MCQs with verified answer keys.

    Practice MCQs
    Board Exam Practice • 12 Questions

    Official Handbook MCQs & Answer Key

    Click any option to instantly see if you're correct with a detailed explanation.

    1

    What does NLP stand for in Artificial Intelligence?

    2

    Which of the following describes 'Lexical Ambiguity'?

    3

    Which stage of NLP involves analyzing the grammatical arrangement of words to check if a sentence follows valid structural rules?

    4

    What is the core distinction between a 'Script-bot' and a 'Smart-bot'?

    5

    What is 'Tokenisation' in the Text Normalisation pipeline?

    6

    Which of the following is a classic example of a 'Stop Word' in English NLP pipelines?

    7

    What is the key difference between Stemming and Lemmatization?

    8

    In the Bag of Words (BoW) algorithm, what primary information is completely discarded?

    9

    In the TF-IDF algorithm, what does 'IDF' measure?

    10

    If a word appears in EVERY single document in a corpus of 100 documents, what will its standard Inverse Document Frequency (IDF) be equal to?

    11

    Which stage of NLP requires real-world knowledge, social context, and speaker intent to decipher non-literal meanings like irony or sarcasm?

    12

    What metric is extracted during Sentiment Analysis to determine whether a product review is positive, negative, or neutral?

    Fast Revision Summary

    Unit 6 Quick Recall Cheat Sheet

    5 Stages of NLP: Lexical → Syntactic → Semantic → Discourse → Pragmatic.
    Script vs Smart Bot: Script-bots follow rigid rules/keywords. Smart-bots use NLP, ML, and intent parsing.
    Stemming vs Lemmatization: Stemming strips affixes heuristically (e.g. ‘caring’ → ‘car’). Lemmatization uses dictionaries to find true lemma (‘caring’ → ‘care’).
    Bag of Words: Vocabulary + word count vectors. Completely discards word order and grammar.
    TF-IDF: TF × IDF. Downweights ubiquitous words; elevates rare, informative words.
    Stop Words: Common functional words (‘the’, ‘is’) stripped to compress vocabulary space.
    Clear Your Doubts

    Frequently Asked Questions (FAQ)

    Highest Board Weightage • 8 Marks

    Master Natural Language Processing with Expert 1:1 Tutors

    Get 1-on-1 personalized guidance from certified AI educators. Master TF-IDF calculations, NLTK text processing in Python, chatbot design, and board examination numerical problems with complete scoring frameworks.