SpiderMan.Storage.JsonLines (spider_man v0.6.4)

View Source

Save items to JsonLines(*.jsonl) file by Storage

Usage

settings = [
  ...
  item_processor_options: [
    storage: [SpiderMan.Storage.JsonLines | {SpiderMan.Storage.JsonLines, file_name}]
  ]
]

If didn't set file_name for this Storage, the default is ./data/[Spider]_[Second].jsonl, for example: ./data/spider_name_1707293252.jsonl.