ExArrow.IPC.File (ex_arrow v0.4.0)

IPC file format reader: random access to schema, batch count, and batches by index.

Use from_file/1 or from_binary/1 to open, then schema/1, batch_count/1, and get_batch/2 for random access. Data remains in native memory until you use ExArrow.RecordBatch / ExArrow.Schema accessors.

Summary

t()

Returns the number of record batches in the file.

Opens an IPC file format from in-memory binary (e.g. for tests). Random access as with from_file.

from_file(path)

Opens an IPC file (file format) from a path. Enables random access to batches.

Returns the record batch at the given 0-based index as an ExArrow.RecordBatch handle.

schema(file)

Returns the schema of the IPC file as an ExArrow.Schema handle. Returns {:error, message} if the file handle is invalid (e.g. poisoned lock).

@opaque t()

@spec batch_count(t()) :: non_neg_integer()

Returns the number of record batches in the file.

@spec from_binary(binary()) :: {:ok, t()} | {:error, String.t()}

Opens an IPC file format from in-memory binary (e.g. for tests). Random access as with from_file.

@spec from_file(Path.t()) :: {:ok, t()} | {:error, String.t()}

Opens an IPC file (file format) from a path. Enables random access to batches.

@spec get_batch(t(), non_neg_integer()) ::
  {:ok, ExArrow.RecordBatch.t()} | {:error, String.t()}

Returns the record batch at the given 0-based index as an ExArrow.RecordBatch handle.

@spec schema(t()) :: {:ok, ExArrow.Schema.t()} | {:error, String.t()}

Returns the schema of the IPC file as an ExArrow.Schema handle. Returns {:error, message} if the file handle is invalid (e.g. poisoned lock).