Back to Devoured - May 28, 2026
DEVOURED
LiteParse v2.0

LiteParse v2.0

AI LlamaIndex
LlamaIndex's LiteParse v2.0, a standalone open-source PDF parsing tool, has been rewritten in Rust for up to 100x faster processing and now supports Rust, JS/TS, Python, and WASM for browser and edge environments.
What: LiteParse v2.0, developed by LlamaIndex, is an open-source PDF parsing tool offering high-quality spatial text parsing with bounding boxes, screenshot generation, and multi-language support. The rewrite in Rust significantly improves performance, making it up to 100x faster, and adds native support for Rust, JavaScript/TypeScript, Python, and WASM.
Why it matters: This move towards highly optimized, local-first data processing tools written in Rust and supporting WASM demonstrates a growing trend to improve performance, reduce cloud dependencies, and enable client-side AI capabilities within the RAG ecosystem.
Takeaway: If you need fast, local PDF parsing for RAG applications, consider integrating LiteParse v2.0 into your Rust, Python, or JavaScript projects, or exploring its WASM capabilities for browser-based use.
Decoder
  • RAG (Retrieval-Augmented Generation): An AI framework that retrieves facts from an external knowledge base to ground large language models (LLMs) on accurate and up-to-date information.
  • WASM (WebAssembly): A binary instruction format for a stack-based virtual machine, designed as a portable compilation target for programming languages, enabling deployment on the web for client and server applications.
Original article

LiteParse v2.0 is out now, and it is blazing fast + runs everywhere!

We rewrote everything from scratch in Rust, and now:

  • up to 100x faster parsing
  • install natively in Rust, JS/TS, and Python
  • a custom WASM package enables browser and edge runtime usage

pip install liteparse

npm i @llamaindex/liteparse

npm i @llamaindex/liteparse-wasm

cargo install liteparse

Blog: llamaindex.ai/blog/liteparse-v2-0-runs-everywhere?utm_medium=socials&utm_source=twitter&utm_campaign=2026-may-

Repo: github.com/run-llama/liteparse

We recently added 3 finetuning projects 🔥

  • Finetuning embeddings
  • @OpenAI finetuning gpt-3.5-turbo to distill GPT-4
  • Finetuning Llama 2 for text-to-SQL

We now have a brand-new guide ✨showing how to include all these components when building RAG:

gpt-index.readthedocs.io/en/latest/end_to_end_tutorials/finetuning.html

Finetuning embeddings: github.com/run-llama/finetune-embedding

Finetuning gpt-3.5-turbo:

colab.research.google.com/drive/1vWeJBXdFEObuihO7Z8ui2CAYkdHQORqo?usp=sharing

We now have the most comprehensive cookbook on building LLMs with Knowledge Graphs (credits @wey_gu).

  • Key query techniques: text2cypher, graph RAG
  • Automated KG construction
  • vector db RAG vs. KG RAG

Check out the full 1.5 hour tutorial:

The full Colab notebook is here:

There was so much content beyond the live webinar that we recorded a part 2 🔥

We stitched it together in the video.colab.research.google.com/drive/1tLjOg2ZQuIClfuWrAC2LdiZHCov8oUbs?usp=sharing

To reiterate, there’s a ton of content in here - it basically qualifies as a mini-course 🧑‍🏫

First, we learn the concepts through helpful visual explanations and links.

Learn both about KGs and the traditional RAG stack.

Introducing “One-click Observability” 🔭

With one line of code, you can now seamlessly integrate @llama_index with rich observability/eval tools offered by our partners (@weights_biases, @arizeai, @truera_ai).

Easily debug/eval your LLM app for prod 💪 https://t.co/tia41IgsT6gpt-index.readthedocs.io/en/latest/end_to_end_tutorials/one_click_observability.html

[1] @weights_biases Prompts lets users log/trace/inspect the LlamaIndex execution flow during index construction/querying.

You automatically get traces, and can also choose to version/load indices.

https://t.co/iGDkmxybzggpt-index.readthedocs.io/en/latest/end_to_end_tutorials/one_click_observability.html

[2] OpenInference (@arize_ai) is a standard for capturing/storing AI model inferences.

It allows you to experiment/visualize LLM apps using observability tools like @arize_phoenix.

Check out the notebook here! https://t.co/aT9PAP3jGhgpt-index.readthedocs.io/en/latest/examples/callbacks/OpenInferenceCallback.html

Tip for better RAG systems💡: don’t just store raw text chunks, augment them with structured data.

  • Enables metadata filtering
  • Helps bias embeddings

Here’s a guide on how to use the @huggingface span-marker to extract entities for this exact purpose📕: https://t.co/Gwwoeu3i9Hgpt-index.readthedocs.io/en/latest/examples/metadata_extraction/EntityExtractionClimate.html

In this example, we parse the 2023 IPPC Climate Report.

After text parsing to break the document into chunks, we use the span-marker extractor to extract relevant entities.

These entities can be used as metadata filters (in a vector db) or to help enhance the context embeddings.

In this guide, we do the latter. Adding/embedding the right metadata directly improves the generated answer (left), vs. without (right)

Explore all 61 articles in today's digest

Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi