Protocol record used for collecting together all information about a document. Please consult go/dj-explorer for two basic questions about CompositeDoc: - Where should I look up certain information (e.g: pagerank, language)? - What does each field in CompositeDoc mean and who should I contact if I have questions? To add a new field into CompositeDoc, or change existing field's size significantly, please file a ticket at go/dj-new-field, fill in necessary information and get approved by docjoin-access@ team. Next id: 193

Attributes

• localizedvariations (type: GoogleApi.ContentWarehouse.V1.Model.CompositeDocLocalizedVariations.t, default: nil) -
• localizedAlternateName (type: list(GoogleApi.ContentWarehouse.V1.Model.IndexingConverterLocalizedAlternateName.t), default: nil) - Localized alternate names are similar to alternate names, except that it is associated with a language different from its canonical. This is the subset of webmaster-provided localized alternate names being in the dup cluster of this document. Used during serving for swapping in the URL based on regional and language preferences of the user.
• forwardingdup (type: list(GoogleApi.ContentWarehouse.V1.Model.CompositeDocForwardingDup.t), default: nil) -
• perDocData (type: GoogleApi.ContentWarehouse.V1.Model.PerDocData.t, default: nil) -
• accessRequirements (type: GoogleApi.ContentWarehouse.V1.Model.IndexingPrivacyAccessAccessRequirements.t, default: nil) - Contains necessary information to enforce row level Docjoin access control.
• properties (type: GoogleApi.ContentWarehouse.V1.Model.DocProperties.t, default: nil) -
• badSslCertificate (type: GoogleApi.ContentWarehouse.V1.Model.IndexingBadSSLCertificate.t, default: nil) - This field is present iff the page has a bad SSL certificate itself or in its redirect chain.
• extradup (type: list(GoogleApi.ContentWarehouse.V1.Model.CompositeDocExtraDup.t), default: nil) -
• subindexid (type: list(String.t), default: nil) -
• ptoken (type: GoogleApi.ContentWarehouse.V1.Model.PtokenPToken.t, default: nil) - Contains information necessary to perform policy decision on the usage of the data assosiated with this cdoc.
• richcontentData (type: GoogleApi.ContentWarehouse.V1.Model.IndexingConverterRichContentData.t, default: nil) - If present, indicates that some content was inserted, deleted, or replaced in the document's content (in CompositeDoc::doc::Content::Representation), and stores information about what was inserted, deleted, or replaced.
• scaledIndyRank (type: integer(), default: nil) - to copy to per-doc
• cseId (type: list(GoogleApi.ContentWarehouse.V1.Model.QualityProseCSEUrlInfo.t), default: nil) -
• indexingIntermediate (type: String.t, default: nil) - Serialized indexing intermediate data.
• docVideos (type: list(GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryVideoProperties.t), default: nil) - Info about videos embedded in the document.
• indexinginfo (type: GoogleApi.ContentWarehouse.V1.Model.CompositeDocIndexingInfo.t, default: nil) -
• localinfo (type: GoogleApi.ContentWarehouse.V1.Model.LocalWWWInfo.t, default: nil) -
• storageRowTimestampMicros (type: String.t, default: nil) - Row timestamp in CDoc storage.
• partialUpdateInfo (type: GoogleApi.ContentWarehouse.V1.Model.CompositeDocPartialUpdateInfo.t, default: nil) - Only present in partial cdocs.
• additionalchecksums (type: GoogleApi.ContentWarehouse.V1.Model.CompositeDocAdditionalChecksums.t, default: nil) -
• anchors (type: GoogleApi.ContentWarehouse.V1.Model.Anchors.t, default: nil) - Mark as non-personal since no personal fields will be populated in anchors.link_additional_info and anchors.additional_info. For more details of Search personal data, see go/dma52-search-cdoc-fields.
• registrationinfo (type: GoogleApi.ContentWarehouse.V1.Model.RegistrationInfo.t, default: nil) - Information about the most recent creation and expiration of this domain. It's extracted from domainedge signal.
• docAttachments (type: GoogleApi.ContentWarehouse.V1.Model.Proto2BridgeMessageSet.t, default: nil) - A generic container to hold document annotations and signals. For a full list of extensions live today, see go/wde.
• docinfoPassthroughAttachments (type: GoogleApi.ContentWarehouse.V1.Model.Proto2BridgeMessageSet.t, default: nil) - This message set is used for data pushed into the index using the signals framework that is never to be used in Mustang or TG Continuum scoring/snippeting code. Any protocol buffer stored in this message set is automatically returned in a docinfo response - it ends up in the "info" message set in the WWWSnippetResponse, so it can be used in post-doc twiddlers and for display in GWS with no code changes in Mustang or Teragoogle.
• docImages (type: list(GoogleApi.ContentWarehouse.V1.Model.ImageData.t), default: nil) - Info about "selected" images associated with the document for which we (already) have ImageData. For each image URL, some fixed number of documents are selected as web referrers for the image URL, and within those selected documents, we say the image is "selected". Within the remaining documents, we say the image is "rejected". Note that this distinction is slightly different from selected for indexing. Only images within doc_images where is_indexed_by_imagesearch is true will be selected for indexing. You can find the rejected images at composite_doc.doc_attachments().get(). You can find images that are selected, but for which we have no ImageData (yet) at composite_doc.image_indexing_info().selected_not_indexed_image_link()
• includedcontent (type: list(GoogleApi.ContentWarehouse.V1.Model.CompositeDocIncludedContent.t), default: nil) -
• porninfo (type: GoogleApi.ContentWarehouse.V1.Model.ClassifierPornDocumentData.t, default: nil) - Porn related data used for image and web search porn classification as well as for diagnostics purposes.
• urldate (type: String.t, default: nil) - Date in the url extracted by quality/snippets/urldate/date-in-url.cc This is given as midnight GMT on the date in question.
• embeddedContentInfo (type: GoogleApi.ContentWarehouse.V1.Model.IndexingEmbeddedContentEmbeddedContentInfo.t, default: nil) - Data produced by the embedded-content system. This is a thin message, containing only embedded_links_info data for the embedder and JavaScript/CSS embedded links (the embedded-content bigtable also contains snapshots, compressed document trees and all embedded link types). Provided using the index signal API.
• richsnippet (type: GoogleApi.ContentWarehouse.V1.Model.RichsnippetsPageMap.t, default: nil) - rich snippet extracted from the content of a document.
• qualitysignals (type: GoogleApi.ContentWarehouse.V1.Model.CompositeDocQualitySignals.t, default: nil) -
• anchorStats (type: GoogleApi.ContentWarehouse.V1.Model.IndexingDocjoinerAnchorStatistics.t, default: nil) - Mark as non-personal since it's an aggregation of anchors. For more details of Search personal data, see go/dma52-search-cdoc-fields.
• alternatename (type: list(GoogleApi.ContentWarehouse.V1.Model.CompositeDocAlternateName.t), default: nil) -
• dataVersion (type: GoogleApi.ContentWarehouse.V1.Model.IndexingDocjoinerDataVersion.t, default: nil) - Contains the tracking version of various data fields in CompositeDoc.
• syntacticDate (type: GoogleApi.ContentWarehouse.V1.Model.QualityTimebasedSyntacticDate.t, default: nil) -
• url (type: String.t, default: nil) - WARNING!!! "url" field in CompositeDoc is optional, and is usually missing: e.g., Docjoin CompositeDoc's don't have CompositeDoc::url. has_url() checking is often useful. So don't rely on CompositeDoc::url unless you're sure otherwise. Usually you want to use CompositeDoc::doc::url instead.
• ContentChecksum96 (type: String.t, default: nil) - Visible content checksum as computed by repository::parsehandler::checksum::Checksum96bitsParseHandler. The value is a Fprint96 in "key format" (i.e., by Fprint96::AsKey()).
• liveexperimentinfo (type: GoogleApi.ContentWarehouse.V1.Model.CompositeDocLiveExperimentInfo.t, default: nil) -
• labelData (type: GoogleApi.ContentWarehouse.V1.Model.QualityLabelsGoogleLabelData.t, default: nil) - This field associates a document to particular labels and assigns confidence values to them.
• sitemap (type: GoogleApi.ContentWarehouse.V1.Model.Sitemap.t, default: nil) - Sitelinks: a collection of interesting links a user might be interested in, given they are interested in this document. WARNING: this is different from the crawler Sitemaps (see SitemapsSignals in the attachments).
• robotsinfolist (type: GoogleApi.ContentWarehouse.V1.Model.CompositeDocRobotsInfoList.t, default: nil) -
• doc (type: GoogleApi.ContentWarehouse.V1.Model.GDocumentBase.t, default: nil) -
• csePagerankCutoff (type: integer(), default: nil) - URL should only be selected for CSE Index if it's pagerank is higher than cse_pagerank_cutoff.