Skip to content

Files

Latest commit

3005318 · Feb 12, 2021

History

History

segmentation

Setup

python setup.py install or pip install .

Usage

  • From python scripts

    >>> from segmentation import segmenter
    >>> input_text = '''
        কাজী মুহম্মদ ওয়াজেদের একমাত্র পুত্র ছিলেন এ. কে. ফজলুক হক। A. K. Fazlul Huq (Sher-E-Bangla) was born into a middle class Bengali Muslim family in Bakerganj, Barisal, Bangladesh in 1873. 
    '''
    >>> segmenter.segment_text(input_text)
    ['কাজী মুহম্মদ ওয়াজেদের একমাত্র পুত্র ছিলেন এ. কে. ফজলুক হক।',
    'A. K. Fazlul Huq (Sher-E-Bangla) was born into a middle class Bengali Muslim family in Bakerganj, Barisal, Bangladesh in 1873.']

    If you don't want a linebreak to be an explicit new line marker, use the following

    >>> segmenter.segment_text(input_text, mode='multi') 
    • Note: the above snippets run with most of the default options, for more advanced options, refer to the terminal script.
  • From terminal

    segmenter --help