Commit history

1. Commits on Nov 11, 2024

   • docs: Updated results table (#125)

     Show description for b1358a9
     Pringled

     authored
     b1358a9View commit details

     Copy full SHA for b1358a9

     Browse repository at this point

   • fix: Fixed CI (#124)

     Pringled

     authored
     b239058View commit details

     Copy full SHA for b239058

     Browse repository at this point
2. Commits on Nov 2, 2024

   • docs: Update readme (#122)

     Show description for 0475785
     Pringled

     authored
     0475785View commit details

     Copy full SHA for 0475785

     Browse repository at this point
3. Commits on Nov 1, 2024

   • feat: Added onnx and tokenizer files support script (#119)

     Show description for 54a6460
     Pringled

     authored
     54a6460View commit details

     Copy full SHA for 54a6460

     Browse repository at this point
4. Commits on Oct 31, 2024

   • Bump version (#121)

     Show description for 6022837
     Pringled

     authored
     6022837View commit details

     Copy full SHA for 6022837

     Browse repository at this point

   • fix: Fixed package extras bug (#120)

     Pringled

     authored
     29fbb75View commit details

     Copy full SHA for 29fbb75

     Browse repository at this point
5. Commits on Oct 29, 2024

   • Bump version (#118)

     Show description for 2f800d8
     Pringled

     authored
     2f800d8View commit details

     Copy full SHA for 2f800d8

     Browse repository at this point

   • docs: Updated plot (#117)

     Pringled

     authored
     3de37edView commit details

     Copy full SHA for 3de37ed

     Browse repository at this point

   • docs: Add tokenlearn results (#116)

     Show description for 16cc111
     Pringled

     authored
     16cc111View commit details

     Copy full SHA for 16cc111

     Browse repository at this point
6. Commits on Oct 25, 2024

   • fix: normalize would lead to NaN for empty docs (#114)

     stephantul

     authored
     261b028View commit details

     Copy full SHA for 261b028

     Browse repository at this point

   • feat: make encode_batch_fast optional (#113)

     Show description for 97c2f5e
     stephantul

     authored
     97c2f5eView commit details

     Copy full SHA for 97c2f5e

     Browse repository at this point

   • docs: Fixed broken links (#112)

     Show description for 2fe48d5
     Pringled

     authored
     2fe48d5View commit details

     Copy full SHA for 2fe48d5

     Browse repository at this point
7. Commits on Oct 23, 2024

   • fix: don't rely on reported vocab size, log warning if inconsistent (#109)

     stephantul

     authored
     5ed70a6View commit details

     Copy full SHA for 5ed70a6

     Browse repository at this point

   • fix: update added tokens to be more agnostic (#107)

     stephantul

     authored
     2f57b9cView commit details

     Copy full SHA for 2f57b9c

     Browse repository at this point
8. Commits on Oct 21, 2024

   • increment version (#104)

     stephantul

     authored
     9c73fdfView commit details

     Copy full SHA for 9c73fdf

     Browse repository at this point
9. Commits on Oct 20, 2024

   • docs: Fixed broken link (#103)

     Pringled

     authored
     90937fcView commit details

     Copy full SHA for 90937fc

     Browse repository at this point

   • docs: Added results link (#102)

     Show description for caf2992
     Pringled

     authored
     caf2992View commit details

     Copy full SHA for caf2992

     Browse repository at this point

   • Reverted eos bos change (#101)

     Pringled

     authored
     6941c7dView commit details

     Copy full SHA for 6941c7d

     Browse repository at this point
10. Commits on Oct 19, 2024

    • fix: rename show progress bar argument (#99)

      Show description for 4e74463
      stephantul

      authored
      4e74463View commit details

      Copy full SHA for 4e74463

      Browse repository at this point

    • enh: remove CLI command (#98)

      Show description for 0e4de30
      stephantul

      authored
      0e4de30View commit details

      Copy full SHA for 0e4de30

      Browse repository at this point

    • feat: Add python3.9 support (#96)

      Show description for 0624c84
      Pringled

      authored
      0624c84View commit details

      Copy full SHA for 0624c84

      Browse repository at this point
11. Commits on Oct 18, 2024

    • Updated slogan (#94)

      Pringled

      authored
      2fa168eView commit details

      Copy full SHA for 2fa168e

      Browse repository at this point
12. Commits on Oct 17, 2024

    • Add explained variance messages (#92)

      stephantul

      authored
      0fefc5fView commit details

      Copy full SHA for 0fefc5f

      Browse repository at this point

    • enhancement: Add dynamic version (#91)

      Show description for 31e74ec
      stephantul

      authored
      31e74ecView commit details

      Copy full SHA for 31e74ec

      Browse repository at this point
13. Commits on Oct 16, 2024

    • feat: faster tokenization (#89)

      stephantul

      authored
      70a4fe8View commit details

      Copy full SHA for 70a4fe8

      Browse repository at this point

    • Switched to math ceil

      Pringled

      committed
      29e8ebcView commit details

      Copy full SHA for 29e8ebc

      Browse repository at this point

    • feat: local loading (#88)

      Show description for a0f8c2b
      stephantul

      authored
      a0f8c2bView commit details

      Copy full SHA for a0f8c2b

      Browse repository at this point

    • feat: Numpy inference (#87)

      Show description for 010a7b7
      stephantul

      authored
      010a7b7View commit details

      Copy full SHA for 010a7b7

      Browse repository at this point
14. Commits on Oct 15, 2024

    • fix: move tensor to cpu (#86)

      stephantul

      authored
      5c1ba32View commit details

      Copy full SHA for 5c1ba32

      Browse repository at this point

    • Fixed broken link (#84)

      Pringled

      authored
      b4927e1View commit details

      Copy full SHA for b4927e1

      Browse repository at this point
15. Commits on Oct 14, 2024

    • docs: Move results and add blogpost (#82)

      Show description for 83db270
      Pringled

      authored
      83db270View commit details

      Copy full SHA for 83db270

      Browse repository at this point
16. Commits on Oct 13, 2024

    • docs: Update readme (#81)

      Show description for 464c504
      Pringled

      authored
      464c504View commit details

      Copy full SHA for 464c504

      Browse repository at this point

    • Updated readme (#80)

      Pringled

      authored
      4a2a27bView commit details

      Copy full SHA for 4a2a27b

      Browse repository at this point
17. Commits on Oct 12, 2024

    • fix: Fix distill model bos and eos token (#78)

      zechengz

      authored
      97d3677View commit details

      Copy full SHA for 97d3677

      Browse repository at this point
18. Commits on Oct 11, 2024

    • docs: Add deduplication tutorial (#72)

      Show description for 1836fef
      Pringled

      authored
      1836fefView commit details

      Copy full SHA for 1836fef

      Browse repository at this point