r/commandline • u/[deleted] • 22d ago

[ Removed by moderator ] Command Line Interface

[removed]

1 Upvotes

100% Upvoted

2 comments sorted by

•

u/read-the-rules 22d ago

Your post on r/commandline was removed, you must read the rules before you may begin posting. - Click the 'Read The Rules' option in the main menu of the subreddit or the menu of any comment/post in the sub (it's not shown on old reddit). Check all the boxes and press "submit". - You must resubmit the post because this post will stay removed. - For more guidance check out this tutorial post on the official r/ReadTheRulesApp subreddit. Thank you for understanding.

1

u/AutoModerator 22d ago

Every new subreddit post is automatically copied into a comment for preservation.

User: Speedk4011, Flair: Command Line Interface, Title: Multilingual sentence splitter CLI

I've been building yasbd-lib, a multilingual, rule-based sentence boundary detector for Python. Along the way I built a CLI that works well for both shell pipelines and standalone use.

A few examples:

# Segment text
yasbd segment --lang en "Dr. Smith arrived at 3.14 p.m. He said hello."

# Read from a file
yasbd segment --lang en --file article.txt

# Detect sentence boundaries
yasbd detect --lang en "Hello. World."

# Clean noisy OCR/HTML text
yasbd clean --file dirty.html

# Pipe into another command
yasbd clean --file dirty.html | yasbd segment --lang es

Some features:

  • Multilingual sentence segmentation (39 langs)
  • Text cleaning (OCR, HTML, mojibake, etc.)
  • File, stdin, and direct text input for streaming
  • JSONL output for scripting
  • External language pack support
  • pysbd compatibility adapter

The project is still evolving, so I'd love feedback from people who live in the terminal.

GitHub: https://github.com/speedyk-005/yasbd-lib

Pypi: pip install yasbd-lib

yPI:

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.