Skip to content

giga-tech/sample-code-bkit

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 

Repository files navigation

Text Processing and Tokenization with BKit

This project provides a Python script that processes text data from a CSV file. It applies various text transformations including tokenization, lemmatization, named entity recognition (NER), part-of-speech (POS) tagging, and digit cleaning. The processed data is saved to a new CSV file.

Requirements

pip install pandas bkit[all] 

Usage

python main.py input_csv output_csv

Arguments:

input_csv: Path to the input CSV file containing the text column (text).
output_csv: Path to the output CSV file where the processed data will be saved.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages