unstructured
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats fo
What is unstructured?
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
Overview of unstructured
What it is
The unstructured library is an open-source ETL (Extract, Transform, Load) tool for converting complex documents such as PDFs, HTML, Word documents, and images into clean, structured formats suitable for language models. It provides pre-processing components for ingesting and transforming unstructured data into structured outputs.
Key features
- Supports multiple document types including PDF, HTML, Word, and images
- Provides modular functions and connectors for data ingestion and pre-processing
- Can partition documents into structured elements (e.g., text, tables)
- Offers integration with Docker for containerized usage
- Includes extras for processing specific document types via pip install
Use cases
- Streamlining data processing workflows for large language models (LLMs)
- Converting unstructured documents (e.g., emails, PDFs, HTML pages) into structured formats for further analysis
- Ingesting and pre-processing data from various sources before feeding into LLMs or other tools
Getting started
To use the library via Docker:docker pull downloads.unstructured.io/unstructured-io/unstructured:latestTo install the Python SDK:pip install unstructuredFor full document type support:pip install unstructured[all-docs]For local development with uv:curl -LsSf https://astral.sh/uv/install.sh | shThen:make install
License and pricing
The library is licensed under Apache-2.0. As stated in the README: “The open-source library is, and will stay, completely free.” The repository metadata indicates a pricing type of open source.
Based on the project's public README and repository metadata.