# htext pby-v3: public-domain Hebrew text lines from Project Ben-Yehuda (HeOCR)

Public-domain Hebrew literature from Project Ben-Yehuda, cut into lines, plain and pointed (niqqud), in two variants: public domain in Israel, and public domain in both Israel and the US. Part of htext, HeOCR's public-domain Hebrew text for training Hebrew OCR.

- Version: `pby-v3`.
- Derived from the GitHub release pby-v3, not byte-identical to it: lines of eval-reserved units removed (reservations v7, sha256 91fd1ea5099d9b1cc3cd5cbaf22ab93158c8357dda03d266e17b1ef44c3caf34), and lines sharing text with HeOCR's evaluation sets removed, as were whole units with long shared runs; HeOCR's evaluation ran its own independent check on every lines file and found 0 overlap. The per-file counts are in the Hugging Face card.
- Licence: CC0-1.0 (htext-cc0).
- Credit: Project Ben-Yehuda volunteers (https://benyehuda.org).
- Text quality: transcription.
- `card_*` files are the GitHub release's own corpus card, rights index and checksums.

| File | Size |
| --- | ---: |
| `SHA256SUMS` | 1,246 bytes |
| `card_CORPUS_CARD.md` | 11,646 bytes |
| `card_SHA256SUMS` | 821 bytes |
| `card_corpus_card.json` | 27,089 bytes |
| `card_pby_excluded_works.v1.json` | 4,445,260 bytes |
| `card_pby_rights_index.v1.jsonl.gz` | 1,238,633 bytes |
| `pby_line_index_il_niqqud.v1.jsonl.gz` | 67,330,323 bytes |
| `pby_line_index_il_plain.v1.jsonl.gz` | 481,898,118 bytes |
| `pby_line_index_il_us_niqqud.v1.jsonl.gz` | 750,199 bytes |
| `pby_line_index_il_us_plain.v1.jsonl.gz` | 14,944,307 bytes |
| `pby_lines_il_niqqud_v3.txt` | 118,582,069 bytes |
| `pby_lines_il_plain_v3.txt` | 544,741,724 bytes |
| `pby_lines_il_us_niqqud_v3.txt` | 1,314,802 bytes |
| `pby_lines_il_us_plain_v3.txt` | 17,249,017 bytes |

- GitHub release: https://github.com/HeOCR/htext/releases/tag/pby-v3
- Hugging Face (the same files): https://huggingface.co/datasets/HeOCR/htext-pby/tree/pby-v3
- Documentation: https://github.com/HeOCR/htext/blob/main/docs/pby_corpus.md
- htext: https://heocr.org/htext

The rights fields are the project's reading of the law, not legal advice.
