View Source GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryContentBasedVideoMetadata (google_api_content_warehouse v0.4.0)
Next Tag: 52
Attributes
-
aresClassificationRequestTimestamp(type:DateTime.t, default:nil) - Timestamp of the last successful Ares classification request. -
videoPreviewBytes(type:list(GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryVideoPreviewsVideoPreview.t), default:nil) - video_preview_bytes is only exported as virtual dataset by IE VideoUnderstanding and should not be persisted. It will be used by downstream IE functions to push for serving. -
loudnessData(type:GoogleApi.ContentWarehouse.V1.Model.VideoStorageLoudnessData.t, default:nil) - When Transcode itag 140 is requested, MediaAnalyzer (as the part of Viper graph) generates audio info including loudness_data, which is then published to Streamer. For Audio news client, we extract this loudness data from Streamer to this field. -
cloudSpeechSignals(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaCloudSpeechSignals.t, default:nil) - Transcript generated from Cloud Speech API -
featureSetData(type:GoogleApi.ContentWarehouse.V1.Model.DrishtiFeatureSetData.t, default:nil) - Video Understanding Golden features. (go/amarna-video-signals#golden-signals) Note: Golden6 features (names matching "video_") are DEPRECATED. Please migrate to Golden7 ("VideoFeatures."). For more context, see go/golden7/migrating-from-golden6 and go/amarna-golden-feature-tracker. Signals popluated in Raffia cdoc.doc_videos are configured in cs/symbol:AMARNA_EXPORTED_GOLDEN7_FEATURES. -
videoPornScoreV4(type:number(), default:nil) - The video porn confidence score extracted from WhisperV4 featureSet: "VideoFeatures.whisper_v4_labels", with CR2 label: "/tns/porn". -
transcriptAsr(type:GoogleApi.ContentWarehouse.V1.Model.PseudoVideoData.t, default:nil) - Speech related metadata The transcript_asr field is generated from the YT caption's SPEECH_RECOGNIZER asset. -
lmsPreviewFramePerdocs(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFramePerdocs.t, default:nil) - LMS preview frame perdocs. Timestamps of the frame perdocs are from the original video, not from the preview. -
signalsBlob(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlob.t, default:nil) - Amarna signals blob that contains large-size signals like VCA frame-level signals. -
s3LanguageIdentification(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryS3LangIdSignals.t, default:nil) - -
frameLevelStarburstEmbeddings(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFrameLevelStarburstEmbeddings.t, default:nil) - Frame-level Starburst embeddings. They are IE only signals for short videos initially and will be supported for all videos later. (go/frame-level-sbv5-on-ie) -
golden7SoapboxTracksBlobInfo(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlobInfo.t, default:nil) - Information on frame-level people feature blob. (go/vpf-frame-features) -
videoStreamInfo(type:GoogleApi.ContentWarehouse.V1.Model.VideoPipelineViperVSIColumnData.t, default:nil) - Deprecated, please use media_info. -
thumbnailerData(type:GoogleApi.ContentWarehouse.V1.Model.VideoPipelineViperThumbnailerColumnData.t, default:nil) - -
transcodeMetadata(type:list(GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryApiItagSpecificMetadata.t), default:nil) - Metadata about each transcode requested. -
truncationInfo(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFileTruncationInfo.t, default:nil) - Data about whether or not the video was truncated. -
speechProperties(type:GoogleApi.ContentWarehouse.V1.Model.IndexingSpeechSpeechPropertiesProto.t, default:nil) - -
mediaInfo(type:GoogleApi.ContentWarehouse.V1.Model.VideoMediaInfo.t, default:nil) - Information about the media file, such as duration, resolution, and detail about each audio/video stream. Note that it contains no PII. -
venomId(type:String.t, default:nil) - The video id in the venom pipeline for STAMP purposes. DEPRECATED: Use transcode_metadata or venom_processing_info instead, which includes the ID and contains information for all clients. -
s3Asr(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaCloudSpeechSignals.t, default:nil) - Trnascript generated through AMARNA_CLOUD_SPEECH asset in Venom. Note that AMARNA_CLOUD_SPEECH uses S3 as the speech engine backend, similar to YT caption's SPEECH_RECOGNIZER asset. However, they may use different S3 models. -
venomProcessingInfo(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryVenomProcessingInfo.t, default:nil) - Information about the video's status in Venom, including IDs and processing times. -
safesearchVideoContentSignals(type:GoogleApi.ContentWarehouse.V1.Model.SafesearchVideoContentSignals.t, default:nil) - Contains SafeSearch video classification outputs which are vertical_name/float pairs. -
videoPornScore(type:number(), default:nil) - The video porn confidence score extracted from Whisper featureSet: "video_labels:whisper_v3", with CR2 label: "/cr2/1". -
thumbnailQualityScore(type:GoogleApi.ContentWarehouse.V1.Model.VideoThumbnailsThumbnailScore.t, default:nil) - Thumbnail quality score predict how visual pleasing a thumbnail is, based on the model trained with deep neural networks.(go/thumb_features_dd) Note the signal currently only available for Youtube videos. -
languageIdentification(type:GoogleApi.ContentWarehouse.V1.Model.VideoTimedtextS4ALIResults.t, default:nil) - -
representativeFrameData(type:GoogleApi.ContentWarehouse.V1.Model.ImageData.t, default:nil) - -
videoDurationSec(type:float(), default:nil) - Set from the video header if truncated, or is the verified length if completely crawled. -
inlinePlayback(type:GoogleApi.ContentWarehouse.V1.Model.VideoCrawlVideoInlinePlaybackMetadata.t, default:nil) - Metadata related to Inline playback on the Interest Feed. This field is filled by Hamilton. -
signalsBlobInfo(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlobInfo.t, default:nil) - Information for the amarna signals blob. -
audioOnly(type:boolean(), default:nil) - Both audio- and audio-video-files are treated as videos during indexing (whether they share a container format, like .mp4, or not, like .mp3). This bool indicates that there's no video track, just an audio track. -
golden7SoapboxSummary(type:GoogleApi.ContentWarehouse.V1.Model.DrishtiFeatureSetData.t, default:nil) - Golden7 video-level people features. (go/ypf-video-features) -
videoAnchorSet(type:GoogleApi.ContentWarehouse.V1.Model.VideoContentSearchVideoAnchorSets.t, default:nil) - Video anchor sets hold set of anchors with multiple anchor types and sequence of VideoAnchor which contains metadata about the anchor, such as thumbnail, perdoc data. -
amarnaDocid(type:String.t, default:nil) - A hash of the video bytes used as a key to Amarna's video_metadata table. -
multiThumbnailsFramePerdocs(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFramePerdocs.t, default:nil) - multi_thumbnails_frame_perdocs contains perdocs(go/vss-signals#perdoc) for all frame thumbnails generated by multiple frames per minutes. See more details in go/multiple-thumbnails-per-minutes. -
videoPreviews(type:list(GoogleApi.ContentWarehouse.V1.Model.ImageBaseVideoPreviewMetadata.t), default:nil) - video_previews contain the preview metadata but no bytes. It exits for IE and non-IE cases. -
legosAnnotationData(type:GoogleApi.ContentWarehouse.V1.Model.VideoLegosLegosAnnotationsSets.t, default:nil) - Legos results -
youtubeProcessingFilter(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryYoutubeProcessingFilter.t, default:nil) - Contains lists of reasons why YT videos were filtered from specific processing. -
unwantedContent(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryUnwantedContent.t, default:nil) - If set, video has been deleted using the deletion service (MediaDeletionService). -
searchDocid(type:String.t, default:nil) - 64 bit docid used for retrieving video previews. -
videoTranscriptAnnotations(type:GoogleApi.ContentWarehouse.V1.Model.QualityWebanswersVideoTranscriptAnnotations.t, default:nil) - VideoTranscriptAnnotations holds sentence segmented text and timing information to be used for VideoAnswers (go/video-answers). Note that only punctuated_transcript, timing_info, and lang field are filled, and other fields will be filled in the later stage.
Summary
Functions
Unwrap a decoded JSON object into its complex fields.
Types
@type t() :: %GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryContentBasedVideoMetadata{ amarnaDocid: String.t() | nil, aresClassificationRequestTimestamp: DateTime.t() | nil, audioOnly: boolean() | nil, cloudSpeechSignals: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaCloudSpeechSignals.t() | nil, featureSetData: GoogleApi.ContentWarehouse.V1.Model.DrishtiFeatureSetData.t() | nil, frameLevelStarburstEmbeddings: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFrameLevelStarburstEmbeddings.t() | nil, golden7SoapboxSummary: GoogleApi.ContentWarehouse.V1.Model.DrishtiFeatureSetData.t() | nil, golden7SoapboxTracksBlobInfo: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlobInfo.t() | nil, inlinePlayback: GoogleApi.ContentWarehouse.V1.Model.VideoCrawlVideoInlinePlaybackMetadata.t() | nil, languageIdentification: GoogleApi.ContentWarehouse.V1.Model.VideoTimedtextS4ALIResults.t() | nil, legosAnnotationData: GoogleApi.ContentWarehouse.V1.Model.VideoLegosLegosAnnotationsSets.t() | nil, lmsPreviewFramePerdocs: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFramePerdocs.t() | nil, loudnessData: GoogleApi.ContentWarehouse.V1.Model.VideoStorageLoudnessData.t() | nil, mediaInfo: GoogleApi.ContentWarehouse.V1.Model.VideoMediaInfo.t() | nil, multiThumbnailsFramePerdocs: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFramePerdocs.t() | nil, representativeFrameData: GoogleApi.ContentWarehouse.V1.Model.ImageData.t() | nil, s3Asr: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaCloudSpeechSignals.t() | nil, s3LanguageIdentification: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryS3LangIdSignals.t() | nil, safesearchVideoContentSignals: GoogleApi.ContentWarehouse.V1.Model.SafesearchVideoContentSignals.t() | nil, searchDocid: String.t() | nil, signalsBlob: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlob.t() | nil, signalsBlobInfo: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlobInfo.t() | nil, speechProperties: GoogleApi.ContentWarehouse.V1.Model.IndexingSpeechSpeechPropertiesProto.t() | nil, thumbnailQualityScore: GoogleApi.ContentWarehouse.V1.Model.VideoThumbnailsThumbnailScore.t() | nil, thumbnailerData: GoogleApi.ContentWarehouse.V1.Model.VideoPipelineViperThumbnailerColumnData.t() | nil, transcodeMetadata: [ GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryApiItagSpecificMetadata.t() ] | nil, transcriptAsr: GoogleApi.ContentWarehouse.V1.Model.PseudoVideoData.t() | nil, truncationInfo: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFileTruncationInfo.t() | nil, unwantedContent: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryUnwantedContent.t() | nil, venomId: String.t() | nil, venomProcessingInfo: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryVenomProcessingInfo.t() | nil, videoAnchorSet: GoogleApi.ContentWarehouse.V1.Model.VideoContentSearchVideoAnchorSets.t() | nil, videoDurationSec: float() | nil, videoPornScore: number() | nil, videoPornScoreV4: number() | nil, videoPreviewBytes: [ GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryVideoPreviewsVideoPreview.t() ] | nil, videoPreviews: [GoogleApi.ContentWarehouse.V1.Model.ImageBaseVideoPreviewMetadata.t()] | nil, videoStreamInfo: GoogleApi.ContentWarehouse.V1.Model.VideoPipelineViperVSIColumnData.t() | nil, videoTranscriptAnnotations: GoogleApi.ContentWarehouse.V1.Model.QualityWebanswersVideoTranscriptAnnotations.t() | nil, youtubeProcessingFilter: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryYoutubeProcessingFilter.t() | nil }
Functions
Unwrap a decoded JSON object into its complex fields.