NEWS
tokenizers.bpe 0.1.5 (2026-05-20)
- phmap_base.h: replace
using GetIsAlwaysEqual = typename T::is_always_equal;
with GetIsAlwaysEqual = typename std::allocator_traits::is_always_equal;
to avoid warning: 'is_always_equal' is deprecated on Debian clang version 21.1.8
tokenizers.bpe 0.1.4 (2025-09-05)
- Update parallel-hashmap to commit 88123934b46b77c3b6d80167382734cbff6eff74 to fix clang 21.1.0 compiler warnings 'pointer' and 'const_pointer' is deprecated
tokenizers.bpe 0.1.3 (2023-09-15)
- Update parallel-hashmap to 1.3.11 which fixes C++17 deprecations about rebind, construct, destroy
tokenizers.bpe 0.1.2 (2023-09-14)
- Drop C++11 specification in Makevars
tokenizers.bpe 0.1.1 (2023-01-06)
- replace move with std::move to fix R CMD check warning on recent versions of clang compilers
tokenizers.bpe 0.1.0 (2019-08-02)
- Initial package based on VKCOM/YouTokenToMe version 1.0.1 commit 16fcf1d8e208f9bbbc9f522e83e6ff81708dba73