viva_tensor/axis
Axis - Named axis types for semantic tensor dimensions
Gives meaning to tensor dimensions: Batch, Seq, Feature, etc.
Types
Named axis - gives semantic meaning to a dimension
pub type Axis {
Batch
Seq
Feature
Height
Width
Channel
Input
Output
Head
Embed
Named(String)
Anon
}
Constructors
-
BatchBatch dimension (samples in mini-batch)
-
SeqSequence/time dimension (for RNNs, transformers)
-
FeatureFeature/channel dimension
-
HeightSpatial height
-
WidthSpatial width
-
ChannelChannel dimension (for images)
-
InputInput dimension (for weight matrices)
-
OutputOutput dimension (for weight matrices)
-
HeadHead dimension (for multi-head attention)
-
EmbedEmbedding dimension
-
Named(String)Custom named axis
-
AnonAnonymous axis (unnamed, referenced by position)