Skip to content

Latest commit

 

History

History
55 lines (44 loc) · 3.06 KB

Readme.md

File metadata and controls

55 lines (44 loc) · 3.06 KB
Raw

🌐 Lexicon-NLP-Lab

NLP Python License: MIT

Welcome to the Lexicon! This repository contains a comprehensive collection of Jupyter notebooks and datasets focused on various Natural Language Processing (NLP) tasks.

📂 Repository Structure

🔍 Data Preprocessing

  • 1_Regex_for_information_extraction.ipynb - Regular expressions for information extraction.
  • 2_Spacy_vs_Nltk.ipynb - Comparison between Spacy and NLTK for tokenization.
  • 3_Spacy_Tokenize.ipynb - Tokenization techniques using Spacy.
  • 4_Spacy_Pipelines.ipynb - Pipelines in Spacy: Stemming and Lemmatization.
  • 5_Stemming_Lemmatization.ipynb - Stemming and lemmatization methods.
  • 5_Stemming_Lemmatization_2.ipynb - Continuation of stemming, lemmatization, and POS tagging.
  • 6_Parts_of_Speech_2.ipynb - POS tagging, Bag of Words, and NER with Spacy.
  • 6_Parts_of_Speech_in_Spacy.ipynb - Detailed POS tagging with Spacy.

🏷️ Named Entity Recognition (NER)

  • 7_NER.ipynb - Named entity recognition with Spacy.
  • 7_NER_2.ipynb - Additional NER tasks and implementations.

🗃️ Bag of Words and N-Grams

  • 8_Bag_of_Words_2_SentimentAnalysis.ipynb - Sentiment analysis using Bag of Words.
  • 8_Bag_of_Words_SpamClassifier.ipynb - Spam classification with Bag of Words.
  • 9_Stop_Words.ipynb - Handling stop words in text preprocessing.
  • 9_Stop_Words_2.ipynb - Further exploration of stop words, Bag of Words, and N-grams.
  • 10_Bag_of_N_Grams_2_Fake_News_Prediction.ipynb - Fake news prediction using N-grams.
  • 10_Bag_of_N_Grams_News_Classification.ipynb - News classification with N-grams.

🔤 TF-IDF (Term Frequency-Inverse Document Frequency)

  • 11_TF_IDF_2_EmotionDetection.ipynb - Emotion detection using TF-IDF.
  • 11_TF_IDF_TextClassification_Ecommerce_Goods.ipynb - E-commerce goods classification using TF-IDF.

💡 Word Embeddings and Vectors

  • 12_Overview_Spacy_Word_Vectors.ipynb - Overview of word vectors using Spacy and Gensim.
  • 13_Spacy_Word_Embeddings_News_Category_Classification.ipynb - News category classification using Spacy word embeddings.
  • 14_Nlp_Word_Vectors_Gensim_Overview.ipynb - Overview of word vectors using Gensim.
  • 15_Gensim_w2v_Google_Fake_News_Detection.ipynb - Fake news detection with Gensim.

🚀 FastText Classifier

  • 16_Fasttext_Indian_Food_Receipe_Classification.ipynb - Classification of Indian food recipes using FastText.
  • 17_Fasttext_Ecommerce_Classification.ipynb - E-commerce classification using FastText.

🔧 Miscellaneous

  • cosine_similarity.ipynb - Computing cosine similarity between text vectors.

📊 Datasets

  • Cleaned_Indian_Food_Dataset.csv - Dataset for Indian food recipes classification.
  • Fake_Real_Data.csv - Dataset containing fake and real news.
  • news_story.txt - Text file with a sample news story.
  • spam.csv - Spam dataset for classification tasks.
  • students.txt - Additional text file for experimentation.