Module util

Structs§

copy_file
copy_files
copy_recursively
delete_files
delete_recursively
exists
find_all_dirs_with_epoch_prefix: This function will find all child directories in the input store which are of the form “epoch_num” and return a map of epoch number to the directory path
find_all_files_with_epoch_prefix: This function will find all child directories in the input store which are of the form “epoch_num” and return a map of epoch number to the directory path
find_missing_epochs_dirs: This function will find missing epoch directories in the input store and return a list of such epoch numbers. If the highest epoch directory in the store is epoch_N then it is expected that the store will have all epoch directories from epoch_0 to epoch_N. Additionally, any epoch directory should have the passed in marker file present or else that epoch number is already considered as missing
get
get_path
list_all_epochs
path_to_filesystem
put
run_manifest_update_loop
write_snapshot_manifest