NLP Guide

1. Introduction
2. Preprocessing
3. Text Statistics
4. Text Comparsion
5. Conda Guide

1. Introduction

This is a series of file collection to assist in nlp preprocssing

2. Preprocessing

ngram.py : Function to compute n-gram & n-term
cleaning.py : Function to clean a typical text file
constants_colors.py : Constant for color conversion and color names
constants_regex.py : Constants for helpful regex

3. Text Statistics

4. Text Comaprsion

10. Conda helpful Guide

Conda Cheat sheet

Export conda enviroment to yml file

conda env export > <environment-name>.yml

Export python requrement.txt environment

conda list -e > requirements.txt

Create a new conda enviroment

conda env create -f <environment-name>.yml

Update an existing enviroment

conda env update -f <environment-name>.yml