L

LlamaIndex Tech Stack

Agentic document processing platform with OCR and workflow automation

Technology, Information and Internet San Francisco, California 11–50 employees Public Company

LlamaIndex operates a high-volume open-source SDK (25M+ monthly downloads) paired with a commercial agentic document platform. The tech stack reflects a mature, distributed system: Kubernetes + Terraform + Temporal for orchestration, PostgreSQL + vLLM + ONNX for data and model serving, and observability via Prometheus + Grafana + New Relic. Active scaling work on ingestion, APIs, and cloud resource optimization—alongside hiring deceleration and candidate experience friction—suggests the company is hitting growth boundaries before fully staffing the engineering and go-to-market functions needed to capture demand.

Tech Stack 29 technologies

Core StackPython Node.js Kubernetes Terraform PostgreSQL Temporal GitHub Next.js Docker TypeScript RAG Helm Prometheus Grafana New Relic ArgoCD Discord Ruff mypy Pydantic vLLM TensorRT ONNX shadcn/ui React Query CDKTF Flux LinkedIn Recruiter

What LlamaIndex Is Building

◆Challenges

Scaling ingestion and ai systems
Scaling core infrastructure
Optimizing cloud resource utilization
Improving release processes
Scaling hiring velocity
Improving candidate experience
Meeting hiring targets

▲Active Projects

Scaling core apis
Scaling ingestion and ai systems
Product launches
Partner enablement
Llamaparse
Llamaextract
Rag applications
Saas platform development
Open-source framework contributions
Customer poc and production solutions

Hiring Activity

Decelerating8 roles · 2 in 30d

Department

Engineering

5

HR

1

Marketing

1

Seniority

Mid

4

Senior

3

Company intelligence

Find more companies like LlamaIndex by tech stack, pain points and active projects

Get started free

About LlamaIndex

LlamaIndex builds document processing infrastructure for AI agents, combining agentic OCR capabilities with a workflow builder for extracting and acting on complex document data. The platform serves AI-native startups and Fortune 50 enterprises at scale. The company operates a dual-model distribution: a widely-adopted open-source SDK (LlamaIndex framework) and a commercial SaaS platform (LlamaParse, LlamaExtract) for production workloads. Core operations focus on scaling ingestion pipelines, maintaining reliability at high throughput, and expanding partner enablement programs. The team is small and engineering-heavy, based in San Francisco.

HeadquartersSan Francisco, California

Company Size11–50 employees

Hiring MarketsUnited States

Frequently Asked Questions

What tech stack does LlamaIndex use?

Python, Node.js, Kubernetes, Terraform, PostgreSQL, Temporal, and vLLM form the core. Observability runs on Prometheus, Grafana, and New Relic. Frontend uses Next.js, React, and TypeScript.