markdown-processing

A Python tool for splitting large Markdown files into smaller sections based on a specified token limit. This is particularly useful for processing large Markdown files with GPT models, as it allows the models to handle the data in manageable chunks.

A Python tool for validating and standardizing markdown document structure before LLM processing. Configurable field validation, auto-correction, and YAML-based rules for document preprocessing.

A Python tool for combining text documents into consolidated files for Large Language Model processing. Creates organized document stacks with configurable sorting and formatting options.