View Source SpiderMan.Storage.JsonLines (spider_man v0.6.3)
Save items to JsonLines(*.jsonl) file by Storage
Usage
settings = [
...
item_processor_options: [
storage: [SpiderMan.Storage.JsonLines | {SpiderMan.Storage.JsonLines, file_name}]
]
]
If didn't set file_name
for this Storage, the default is ./data/[Spider]_[Second].jsonl
,
for example: ./data/spider_name_1707293252.jsonl
.