semtools

semtools *command* [*options*] [*args*]

semtools is a Rust CLI for document-centric workflows: parse converts PDFs and office documents (default backend: LlamaParse API), search performs local semantic keyword search with embeddings, ask runs an LLM agent with search/read tools over a corpus, and workspace caches embeddings for large collections under ~/.semtools/workspaces/.Install via npm i -g @llamaindex/semtools or cargo install semtools. Designed for Unix pipelines (stdin/stdout and xargs).

parse [*OPTIONS*] *FILES*...

Parse documents. -b, --backend selects parser (default llama-parse). -c config path. -v verbose.

Semantic search. -n, --n-lines context lines (default 3). --top-k result count. -m, --max-distance distance threshold. -i ignore case. -j JSON output. Files optional if using stdin.

Question-answering agent over files or stdin. Requires an LLM API key (OpenAI-compatible; see config).

Manage embedding workspaces. use prints shell export instructions for SEMTOOLS_WORKSPACE.

parse needs a LlamaIndex Cloud API key by default. ask needs an LLM provider key. search/workspace are local but use embedding models (download/runtime cost). Do not send confidential documents to third-party parse/LLM APIs without review.

rg(1), pdftotext(1), jq(1)

Source code