Struct FileRangeIndex 

pub struct FileRangeIndex { /* private fields */ }

Index of existing file ranges for a pipeline.

In migration mode, this is loaded at startup to track target file ranges. Progress is tracked separately via a watermark file.

Implementations

impl FileRangeIndex

pub fn new() -> Self

Create a new empty index.

pub fn insert(&mut self, entry: FileRangeEntry)

Insert a file range entry.

pub fn len(&self) -> usize

Get the number of file ranges.

pub fn is_empty(&self) -> bool

Check if the index is empty.

pub fn find_containing(&self, checkpoint: u64) -> Option<&FileRangeEntry>

Find the file range that contains the given checkpoint.

pub fn find_next_boundary(&self, checkpoint: u64) -> Option<&FileRangeEntry>

Find the next file boundary at or after the given checkpoint.

pub fn snap_to_boundary(&self, checkpoint: u64) -> Option<u64>

Snap a start checkpoint to file boundaries for migration.

• If checkpoint is inside a file → returns file start
• If checkpoint is in a gap → returns next file start
• If no files at or after checkpoint → returns None (error case)

pub fn snap_end_to_boundary(&self, checkpoint: u64) -> Option<u64>

Snap an end checkpoint to file boundaries for migration.

Returns the last checkpoint (inclusive) that should be processed to complete the file containing the given checkpoint:

• If checkpoint is inside a file → returns file’s last checkpoint (end - 1)
• If checkpoint is in a gap → returns previous file’s last checkpoint (end - 1)
• If no files at or before checkpoint → returns None (error case)

pub fn first_checkpoint(&self) -> Option<u64>

Get the first checkpoint across all ranges.

pub fn last_checkpoint_exclusive(&self) -> Option<u64>

Get the last checkpoint across all ranges (exclusive).

pub async fn load_from_store( store: &Arc<dyn ObjectStore>, pipeline: &str, min_epoch: Option<u64>, ) -> Result<Self>

Load file range index from object store.

This lists all files in the pipeline directory to build the index of target ranges for migration. Progress is tracked via a separate watermark file.

If min_epoch is provided, only epochs >= min_epoch are scanned, which reduces startup time when resuming a migration.

Trait Implementations

impl Clone for FileRangeIndex

fn clone(&self) -> FileRangeIndex

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for FileRangeIndex

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for FileRangeIndex

fn default() -> FileRangeIndex

Returns the “default value” for a type.