htext pby-v3: public-domain Hebrew text lines from Project Ben-Yehuda (HeOCR)
Authors/Creators
Description
Public-domain Hebrew literature from Project Ben-Yehuda, cut into lines, plain and pointed (niqqud), in two variants: public domain in Israel, and public domain in both Israel and the US. Part of htext, HeOCR's public-domain Hebrew text for training Hebrew OCR.
Derived from the GitHub release pby-v3, not byte-identical to it: lines of eval-reserved units removed (reservations v7, sha256 91fd1ea5099d9b1cc3cd5cbaf22ab93158c8357dda03d266e17b1ef44c3caf34), and lines sharing text with HeOCR's evaluation sets removed, as were whole units with long shared runs; HeOCR's evaluation ran its own independent check on every lines file and found 0 overlap. The per-file counts are in the Hugging Face card.
Licence: CC0-1.0. Credit: Project Ben-Yehuda volunteers (https://benyehuda.org). Text quality: transcription.
- GitHub release: https://github.com/HeOCR/htext/releases/tag/pby-v3
- Hugging Face (the same files): https://huggingface.co/datasets/HeOCR/htext-pby/tree/pby-v3
- Documentation: https://github.com/HeOCR/htext/blob/main/docs/pby_corpus.md
- htext: https://heocr.org/htext
Files
card_corpus_card.json
Files
(1.3 GB)
| Name | Size | |
|---|---|---|
|
md5:44a513d58d2b441c0fb979345d20a71e
|
27.1 kB | Preview Download |
|
md5:46382e5d4fe8364a561f52f2d9b20d5c
|
11.6 kB | Preview Download |
|
md5:d243e1320d65f5d7c06ba55b6d2317c7
|
4.4 MB | Preview Download |
|
md5:8e684bd557e84812e860cc7f935707ed
|
1.2 MB | Download |
|
md5:93e3c6c6d947db70b77b206ec6b0f364
|
821 Bytes | Download |
|
md5:746c0cf4c37a68afc2c686b9e76ba8e3
|
67.3 MB | Download |
|
md5:9250ddc674feee1d9c2e032c0699cb2e
|
481.9 MB | Download |
|
md5:1e43ffa0df521fa663ea071b647ad1e2
|
750.2 kB | Download |
|
md5:335cbad8030eec6a1f2ac8114b9c4239
|
14.9 MB | Download |
|
md5:100a483f7799090eff0649490c010337
|
118.6 MB | Preview Download |
|
md5:82998ba97033fddaaaea2a53024d67d5
|
544.7 MB | Preview Download |
|
md5:5d09882e08a11817e3ae84a2eb0f269e
|
1.3 MB | Preview Download |
|
md5:c2090099cc0a375969ab2ae1d3a43625
|
17.2 MB | Preview Download |
|
md5:b286985c9495426828abfe4cc64a067d
|
2.1 kB | Preview Download |
|
md5:e910fd03f33bd03acaf10ed1af00c5b6
|
1.2 kB | Download |
Additional details
Related works
- Is derived from
- Dataset: https://github.com/HeOCR/htext/releases/tag/pby-v3 (URL)
- Dataset: https://github.com/projectbenyehuda/public_domain_dump/tree/5e4277fead7b565f32cc4b352abd3565023a77d8 (URL)
- Is documented by
- Other: https://github.com/HeOCR/htext/blob/main/docs/pby_corpus.md (URL)
- Is identical to
- Dataset: https://huggingface.co/datasets/HeOCR/htext-pby/tree/pby-v3 (URL)