Skip to content

feat: add public_hash_list table definition#324

Open
max-ostapenko wants to merge 1 commit into
mainfrom
curious-gibbon
Open

feat: add public_hash_list table definition#324
max-ostapenko wants to merge 1 commit into
mainfrom
curious-gibbon

Conversation

@max-ostapenko

@max-ostapenko max-ostapenko commented Jul 6, 2026

Copy link
Copy Markdown
Contributor

Signed-off-by: Max Ostapenko <1611259+max-ostapenko@users.noreply.github.com>
@max-ostapenko

Copy link
Copy Markdown
Contributor Author

@tomayac how about public BQ table instead of Spreadsheet?

You can download it like this:

bq query --format=csv \
  "SELECT * FROM \`httparchive.performance.public_hash_list\`" > data/http-archive-hashes.csv

@tomayac

tomayac commented Jul 7, 2026

Copy link
Copy Markdown
Member

Thanks a lot! I just checked, and it looks like bq requires a Google Cloud project and being authenticated to gcloud. It's all doable, but reduces the reproducibility of the data. Would it be much more work for you to provide the CSV directly on GitHub, so it could be downloaded anonymously? Or else, the Google Spreadsheet export would also be a viable option. If either of those would be viable options, I'd prefer this over bq. What do you think?

@max-ostapenko

Copy link
Copy Markdown
Contributor Author

@tomayac agree that CSV in a public repo is much more accessible.
But committing a table data to Github is a very specific scenario and takes more effort.

My idea is to replace the Spreadsheet with this table, in order to simplify the CSV-download-script into a one-liner.

There will be a publicly available CSV in a repo, and anybody interested can look into a table and raw crawl for details.

@tunetheweb

Copy link
Copy Markdown
Member

Why not just save to our CDN like the JSON files we create?

@tomayac

tomayac commented Jul 8, 2026

Copy link
Copy Markdown
Member

Why not just save to our CDN like the JSON files we create?

This sounds like a great idea, as long as the URL is predictable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants