View Source OffBroadway.Elasticsearch.ScrollStrategy (OffBroadwayElasticsearch v0.1.0)
Implementation of OffBroadway.Elasticsearch.Strategy that uses the "Scroll"
feature of Elasticsearch. This strategy is best suited for a single producer,
fetching less than 10,000 results per request. For concurrent searching, see
OffBroadway.Elasticsearch.SliceStrategy and for searching with demand
greater than 10,000 see OffBroadway.Elasticsearch.SearchAfterStrategy
Example
defmodule MyBroadway do
use Broadway
def start_link(_opts) do
Broadway.start_link(__MODULE__,
...
producer: [
module: {
OffBroadway.Elasticsearch.Producer,
[
host: "http://localhost:9200",
index: "my-index",
strategy: :scroll, # <- Select the 'scroll' strategy
search: search() # <- Provide a search query
]
},
concurrency: 1 # <- A single process to manage 'scrolling'
],
...
)
end
endSee Elasticsearch docs: Scroll Search
Summary
Types
@type broadway_state() :: OffBroadway.Elasticsearch.broadway_state()
@type document() :: OffBroadway.Elasticsearch.document()