GitHub - commoncrawl/web-languages: Crowd-sourced lists of urls to help Common Crawl crawl under-resourced languages. See https://github.com/commoncrawl/web-languages-code/ for the code

Name		Name	Last commit message	Last commit date
Latest commit History 302 Commits
constructed		constructed
extinct		extinct
historical		historical
living		living
special		special
README.md		README.md

Repository files navigation

Crowd-sourced lists of urls to help Common Crawl crawl under-resourced languages. See https://github.com/commoncrawl/web-languages-code/ for the code

commoncrawl.org/