Binary tool for generating embeddings from console

[tazarov]

Examples:

cat text.txt | llama-embedder > raw.txt

cat text.txt | llama-embedder --format jsonl > plain_jsonl.jsonl

cat text.txt | llama-embedder --format langchain > langchain.jsonl

cat text.txt | llama-embedder --format llamaindex > llama_index.jsonl

cat text.txt | llama-embedder --format chroma > chroma.jsonl

Note: This can be built on top of the golang binding for better tooling support and simpler implementation than plain cpp.