feat: add public_hash_list table definition#324
Conversation
Signed-off-by: Max Ostapenko <1611259+max-ostapenko@users.noreply.github.com>
|
@tomayac how about public BQ table instead of Spreadsheet? You can download it like this: bq query --format=csv \
"SELECT * FROM \`httparchive.performance.public_hash_list\`" > data/http-archive-hashes.csv |
|
Thanks a lot! I just checked, and it looks like |
|
@tomayac agree that CSV in a public repo is much more accessible. My idea is to replace the Spreadsheet with this table, in order to simplify the CSV-download-script into a one-liner. There will be a publicly available CSV in a repo, and anybody interested can look into a table and raw crawl for details. |
|
Why not just save to our CDN like the JSON files we create? |
This sounds like a great idea, as long as the URL is predictable. |
Hash list saved monthly into a public BQ table.
Query source: https://github.com/tomayac/public-hash-list/blob/main/queries/http-archive.sql