pub struct StreamingParquetCacheWriter {
planner: StreamShapePlanner,
mesh_w: ArrowWriter<Vec<u8>>,
vert_w: ArrowWriter<Vec<u8>>,
idx_w: ArrowWriter<Vec<u8>>,
mesh_count: usize,
}Expand description
Incremental whole-model cache writer for the streaming endpoint: each
batch’s columns are appended as one Parquet row group per table, so no
MeshData has to be retained past the batch that produced it (previously
the endpoint kept a FULL second copy of the model’s meshes just to
re-serialize them at Complete). The mesh-table vertex_start/index_start
columns carry GLOBAL offsets (whole-model), matching what the one-shot
serialize_to_parquet emits for the cached fast-path replay.
Fields§
§planner: StreamShapePlannerWhole-stream offsets for Self::append’s unshared batches. A
cross-batch stream plans with its own planner and hands the result to
Self::append_planned, so this one is then never advanced.
mesh_w: ArrowWriter<Vec<u8>>§vert_w: ArrowWriter<Vec<u8>>§idx_w: ArrowWriter<Vec<u8>>§mesh_count: usizeImplementations§
Source§impl StreamingParquetCacheWriter
impl StreamingParquetCacheWriter
pub fn new(layout: ParquetLayout) -> Result<Self, ParquetError>
Sourcepub fn append(&mut self, meshes: &[MeshData]) -> Result<(), ParquetError>
pub fn append(&mut self, meshes: &[MeshData]) -> Result<(), ParquetError>
Append one batch, every mesh with its own geometry, as one row group per table at whole-stream offsets. The meshes can be dropped by the caller afterwards.
Sourcepub fn append_planned(
&mut self,
batch: &PlannedBatch,
) -> Result<(), ParquetError>
pub fn append_planned( &mut self, batch: &PlannedBatch, ) -> Result<(), ParquetError>
Append a batch some other StreamShapePlanner already planned (the
cross-batch stream, #5407), as one row group per table. The caller’s
planner owns the offsets; the tables are written exactly as planned, so
the cached blob and the client’s batch agree on every range.
Sourcepub fn mesh_count(&self) -> usize
pub fn mesh_count(&self) -> usize
Total meshes appended so far.
Sourcepub fn finish_combined(self) -> Result<Bytes, ParquetError>
pub fn finish_combined(self) -> Result<Bytes, ParquetError>
Close all three writers and assemble the OUTER combined
[geo_len][geo_bytes][data_model_len=0] blob the parquet-stream route
caches, in one allocation. Equivalent to wrapping finish()’s output
with the route’s [geo_len]...[dm_len=0] framing, but without
copying the inner geometry blob a second time to do it.
Auto Trait Implementations§
impl Freeze for StreamingParquetCacheWriter
impl !RefUnwindSafe for StreamingParquetCacheWriter
impl Send for StreamingParquetCacheWriter
impl !Sync for StreamingParquetCacheWriter
impl Unpin for StreamingParquetCacheWriter
impl !UnwindSafe for StreamingParquetCacheWriter
Blanket Implementations§
§impl<U> As for U
impl<U> As for U
§fn as_<T>(self) -> Twhere
T: CastFrom<U>,
fn as_<T>(self) -> Twhere
T: CastFrom<U>,
self to type T. The semantics of numeric casting with the as operator are followed, so <T as As>::as_::<U> can be used in the same way as T as U for numeric conversions. Read moreSource§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> Pointable for T
impl<T> Pointable for T
§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
self from the equivalent element of its
superset. Read more§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
self is actually part of its subset T (and can be converted to it).§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
self.to_subset but without any property checks. Always succeeds.§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
self to the equivalent element of its superset.