Skip to content
@bitextor

Bitextor Team

Translation memories generator

Pinned Loading

  1. bitextor bitextor Public

    Bitextor generates translation memories from multilingual websites

    Python 299 42

  2. bicleaner bicleaner Public

    Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.

    Python 160 23

  3. bifixer bifixer Public

    Tool to fix bitexts and tag near-duplicates for removal

    Python 34 3

  4. biroamer biroamer Public

    Utility that will help you to ROAM (Random Omit Anonymize and Mix) your parallel corpus.

    Python 11 2

  5. pdf-extract pdf-extract Public

    PDF parser and converter to HTML

    Java 90 13

  6. warc2text warc2text Public

    Extracts plain text, language identification and more metadata from WARC records

    C++ 23 6

Repositories

Showing 10 of 29 repositories
  • bicleaner-hardrules Public

    Pre-filtering step for bicleaner

    bitextor/bicleaner-hardrules’s past year of commit activity
    Python 5 GPL-3.0 3 1 0 Updated Nov 4, 2025
  • monocleaner Public
    bitextor/monocleaner’s past year of commit activity
    Python 7 GPL-3.0 1 1 0 Updated Nov 3, 2025
  • warc2text Public

    Extracts plain text, language identification and more metadata from WARC records

    bitextor/warc2text’s past year of commit activity
    C++ 23 MIT 6 8 3 Updated Oct 1, 2025
  • bifixer Public

    Tool to fix bitexts and tag near-duplicates for removal

    bitextor/bifixer’s past year of commit activity
    Python 34 GPL-3.0 3 0 0 Updated Sep 4, 2025
  • bicleaner-ai Public

    Bicleaner fork that uses neural networks

    bitextor/bicleaner-ai’s past year of commit activity
    Python 40 GPL-3.0 4 1 0 Updated Jun 12, 2025
  • biroamer Public

    Utility that will help you to ROAM (Random Omit Anonymize and Mix) your parallel corpus.

    bitextor/biroamer’s past year of commit activity
    Python 11 GPL-3.0 2 0 1 Updated Mar 3, 2025
  • cld2 Public Forked from CLD2Owners/cld2

    Compact Language Detector 2

    bitextor/cld2’s past year of commit activity
    C++ 0 Apache-2.0 142 0 0 Updated Feb 4, 2025
  • monocleaner-data Public

    Monocleaner models repository

    bitextor/monocleaner-data’s past year of commit activity
    1 GPL-3.0 0 0 0 Updated Jan 8, 2025
  • scrawl Public

    Playwright-based web crawler

    bitextor/scrawl’s past year of commit activity
    Python 1 GPL-3.0 0 0 0 Updated Nov 14, 2024
  • bitextor Public

    Bitextor generates translation memories from multilingual websites

    bitextor/bitextor’s past year of commit activity
    Python 299 GPL-3.0 42 3 4 Updated Nov 11, 2024

Most used topics

Loading…