Development

Prerequisites

Python Setup

Java Setup

Building the Rust Code

Building the Python Package

Spark Setup

Running Spark Tests

Running Ibis Tests

Analyzing Test Logs

Running Spark Tests in GitHub Actions

Working with the Spark Patch

Documentation

Release Process

Using the Rust Debugger in RustRover

Reducing Build Time

Local PySpark Session

Cross-compilation

Object Store Testing

MCP Server Testing

Standalone Binary

Running Benchmarks

On this page

This guide is up-to-date with the main branch.

Building the Project

Pager