Introducing the second installment in our Whirlwind Tour series, covering crawl structure, index access, and content extraction, giving developers a practical foundation for building Java-based data workflows.
We are pleased to announce the Java edition of the Whirlwind Tour of Common Crawl's Datasets, another brief tutorial on interacting with our datasets programmatically, this time using Java.
This is the second Whirlwind Tour in the series following the Python edition released in June 2025.
Like the Python Whirlwind Tour, we start from the basics: what the crawl data looks like and how it is stored. We then demonstrate how to use the two versions of our index to extract content using Java-based tools such as JWARC and DuckDB. By the end of the tour, users will have the foundation they need to start using Common Crawl's data in their own Java projects.
The Java Whirlwind Tour is available through our GitHub repository. We welcome feedback and suggestions. You can get in contact with us via our contact form, on our Discord server, or by raising an issue in the repository.
Watch this space for a Rust version of the tour!
| # | Наименование новости | Тональность | Информативность | Дата публикации |
|---|---|---|---|---|
| 1 | Announcing the First Stable Release of CC-Downloader | 0 | 12.78 | 10-08-2026 |
| 2 | CC-Citations: A Visualization of Research Papers Referencing Common Crawl | 0 | 8.3 | 11-02-2026 |
| 3 | You can now build directly on Common Crawl from the browser | 0 | 6.69 | 06-05-2026 |
| 4 | April 2026 Crawl Archive Now Available in a Hugging Face Storage Bucket | 0 | 7.81 | 20-05-2026 |
| 5 | Common Crawl Joins Project Tapestry | 0 | 7.23 | 27-07-2026 |
| 6 | June 2026 Crawl Archive Now Available | 0 | 15.98 | 22-06-2026 |
| 7 | Announcing a Change to Common Crawl Dataset Size Reporting | 0 | 8.33 | 01-04-2026 |
| 8 | django-hawkeye - BM25 full-text search using PostgreSQL | 0 | 52.86 | 09-02-2026 |
| 9 | Semmle | 0 | 7.51 | 15-12-2017 |
| 10 | durable-workflow 2.0.0rc31 | 0 | 26.67 | 14-08-2026 |