Anyone want a fun dataset to play with? I've published a link database from my search engine here: https://downloads.marginalia.nu/

3 years ago · 👍 kevinsan, haze, staticvoid

Links

Actions

3 Replies

I've put it on IPFS: QmWfyrQXfkP9KxgQbzTpD1SN1NFBHNnXMRRyj5TxsiL4bZ · 3 years ago

@haze: Yeah it's production data from search.marginalia.nu; I do my own crawling and everything. · 3 years ago

Ohhh nice! Something I can play with!!

I'm curious, how was this data collected? You built your down crawler? · 3 years ago