sentencepiece 0.2.1-2
| Status: | SUCCESS |
|---|---|
| Last updated: | 2026-06-02 07:06 |
| Description: | Python wrapper for SentencePiece |
| Upstream: | AUR |
Build Output
==> Making package: sentencepiece 0.2.1-2 (Tue Jun 2 07:05:05 2026)
==> Checking runtime dependencies...
==> Checking buildtime dependencies...
==> Installing missing dependencies...
resolving dependencies...
looking for conflicting packages...
Packages (29) cppdap-1.58.0-3 gtest-1.17.0-2 hicolor-icon-theme-0.18-1 jsoncpp-1.9.6-3 libunwind-1.8.2-1 libuv-1.52.1-1 python-autocommand-2.2.2-9 python-iniconfig-2.3.0-1 python-jaraco.collections-5.1.0-3 python-jaraco.context-6.1.2-1 python-jaraco.functools-4.1.0-3 python-jaraco.text-4.0.0-4 python-more-itertools-11.1.0-1 python-pkg_resources-81.0.0-1 python-platformdirs-4.10.0-1 python-pluggy-1.6.0-3 python-pygments-2.20.0-1 python-pyproject-hooks-1.2.0-6 python-typing_extensions-4.15.0-3 rhash-1.4.6-1 abseil-cpp-20260107.1-1 cmake-4.3.3-1 gperftools-2.18.1-1 protobuf-34.1-1 python-build-1.4.3-1 python-installer-1.0.0-1 python-pytest-1:9.0.3-1 python-setuptools-1:82.0.1-1 python-wheel-0.47.0-1
Total Download Size: 17.17 MiB
Total Installed Size: 161.25 MiB
:: Proceed with installation? [Y/n]
:: Retrieving packages...
cmake-4.3.3-1-x86_64 downloading...
python-setuptools-1:82.0.1-1-any downloading...
python-pytest-1:9.0.3-1-any downloading...
cppdap-1.58.0-3-x86_64 downloading...
python-more-itertools-11.1.0-1-any downloading...
python-wheel-0.47.0-1-any downloading...
python-build-1.4.3-1-any downloading...
python-platformdirs-4.10.0-1-any downloading...
python-pluggy-1.6.0-3-any downloading...
python-installer-1.0.0-1-any downloading...
python-iniconfig-2.3.0-1-any downloading...
python-jaraco.context-6.1.2-1-any downloading...
checking keyring...
checking package integrity...
loading package files...
checking for file conflicts...
checking available disk space...
:: Processing package changes...
installing cppdap...
installing hicolor-icon-theme...
installing jsoncpp...
Optional dependencies for jsoncpp
jsoncpp-doc: documentation
installing libuv...
installing rhash...
installing cmake...
Optional dependencies for cmake
make: for unix Makefile generator [installed]
ninja: for ninja generator [installed]
qt6-base: cmake-gui
installing gtest...
Optional dependencies for gtest
python: gmock generator [installed]
installing abseil-cpp...
installing libunwind...
installing gperftools...
installing protobuf...
installing python-pyproject-hooks...
installing python-build...
Optional dependencies for python-build
python-pip: to use as the Python package installer (default)
python-uv: to use as the Python package installer
python-virtualenv: to use virtualenv for build isolation
installing python-more-itertools...
installing python-jaraco.functools...
installing python-jaraco.context...
installing python-autocommand...
installing python-jaraco.text...
Optional dependencies for python-jaraco.text
python-inflect: for show-newlines script
installing python-jaraco.collections...
installing python-platformdirs...
installing python-wheel...
Optional dependencies for python-wheel
python-keyring: for wheel.signatures
python-xdg: for wheel.signatures
python-setuptools: for legacy bdist_wheel subcommand [pending]
installing python-typing_extensions...
installing python-pkg_resources...
installing python-setuptools...
installing python-installer...
installing python-iniconfig...
installing python-pluggy...
installing python-pygments...
installing python-pytest...
:: Running post-transaction hooks...
(1/1) Arming ConditionNeedsUpdate...
==> Retrieving sources...
-> Cloning sentencepiece git repo...
Cloning into bare repository '/builder/sentencepiece'...
-> Found dont-include-data-files-in-python-pkg.patch
==> WARNING: Skipping verification of source file PGP signatures.
==> Validating source files with sha512sums...
sentencepiece ... Passed
dont-include-data-files-in-python-pkg.patch ... Passed
==> Extracting sources...
-> Creating working copy of sentencepiece git repo...
Cloning into 'sentencepiece'...
done.
Switched to a new branch 'makepkg'
==> Starting prepare()...
Checking patch python/setup.py...
Checking patch python/src/sentencepiece/__init__.py...
Applied patch python/setup.py cleanly.
Applied patch python/src/sentencepiece/__init__.py cleanly.
==> Starting build()...
-- VERSION: 0.2.1
-- The C compiler identification is GNU 16.1.1
-- The CXX compiler identification is GNU 16.1.1
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/sbin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/sbin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
-- Found Threads: TRUE
-- Found Protobuf: /usr/lib/libprotobuf.so (found version "7.34.1")
-- Found TCMalloc: /usr/lib/libtcmalloc_minimal.so
-- Configuring done (1.0s)
-- Generating done (0.0s)
-- Build files have been written to: /builder/src/sentencepiece/build
[ 2%] Running cpp protocol buffer compiler on sentencepiece.proto
[ 2%] Running cpp protocol buffer compiler on sentencepiece_model.proto
[ 3%] Running cpp protocol buffer compiler on sentencepiece_model.proto
[ 4%] Running cpp protocol buffer compiler on sentencepiece_model.proto
[ 5%] Running cpp protocol buffer compiler on sentencepiece.proto
[ 6%] Running cpp protocol buffer compiler on sentencepiece.proto
[ 7%] Building CXX object src/CMakeFiles/sentencepiece.dir/sentencepiece.pb.cc.o
[ 8%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/unicode_script.cc.o
[ 9%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/builder.cc.o
[ 10%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/sentencepiece.pb.cc.o
[ 11%] Building CXX object src/CMakeFiles/sentencepiece.dir/sentencepiece_model.pb.cc.o
[ 12%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/sentencepiece_model.pb.cc.o
[ 13%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/bpe_model.cc.o
[ 14%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/trainer_factory.cc.o
[ 15%] Building CXX object src/CMakeFiles/sentencepiece.dir/bpe_model.cc.o
[ 17%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/trainer_interface.cc.o
[ 18%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/char_model.cc.o
[ 19%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/error.cc.o
/builder/src/sentencepiece/src/trainer_interface.cc: In member function ‘sentencepiece::util::Status sentencepiece::TrainerInterface::LoadSentences()’:
/builder/src/sentencepiece/src/trainer_interface.cc:484:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘const long unsigned int’ [-Wsign-compare]
484 | for (int n = 0; n < num_workers; ++n) {
| ~~^~~~~~~~~~~~~
/builder/src/sentencepiece/src/trainer_interface.cc: In instantiation of ‘void sentencepiece::AddDPNoise(const TrainerSpec&, std::mt19937*, T*) [with T = long int; std::mt19937 = std::mersenne_twister_engine<long unsigned int, 32, 624, 397, 31, 2567483615, 11, 4294967295, 7, 2636928640, 15, 4022730752, 18, 1812433253>]’:
/builder/src/sentencepiece/src/trainer_interface.cc:489:32: required from here
489 | AddDPNoise<int64_t>(trainer_spec_, generator,
| ~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~
490 | &(sentences_[i].second));
| ~~~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/trainer_interface.cc:320:18: warning: comparison of integer expressions of different signedness: ‘long int’ and ‘uint64_t’ {aka ‘long unsigned int’} [-Wsign-compare]
320 | if (*to_update < trainer_spec.differential_privacy_clipping_threshold()) {
| ~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[ 21%] Building CXX object src/CMakeFiles/sentencepiece.dir/error.cc.o
[ 21%] Building CXX object src/CMakeFiles/sentencepiece.dir/char_model.cc.o
[ 22%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/filesystem.cc.o
[ 23%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/unigram_model_trainer.cc.o
[ 24%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/model_factory.cc.o
[ 25%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/word_model_trainer.cc.o
[ 26%] Building CXX object src/CMakeFiles/sentencepiece.dir/filesystem.cc.o
[ 27%] Building CXX object src/CMakeFiles/sentencepiece.dir/model_factory.cc.o
/builder/src/sentencepiece/src/unigram_model_trainer.cc: In instantiation of ‘sentencepiece::unigram::TrainerModel::SentencePieces sentencepiece::unigram::Trainer::MakeSeedSentencePiecesInternal() [with node_int_type = long int; sentencepiece::unigram::TrainerModel::SentencePieces = std::vector<std::pair<std::__cxx11::basic_string<char>, float> >]’:
/builder/src/sentencepiece/src/unigram_model_trainer.cc:141:55: required from here
141 | ? MakeSeedSentencePiecesInternal<int64_t>()
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~
/builder/src/sentencepiece/src/unigram_model_trainer.cc:276:30: warning: comparison of integer expressions of different signedness: ‘const long int’ and ‘std::vector<unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
276 | if (len <= 1 || offset >= array.size() || offset + len >= array.size()) {
| ~~~~~~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model_trainer.cc:276:62: warning: comparison of integer expressions of different signedness: ‘long int’ and ‘std::vector<unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
276 | if (len <= 1 || offset >= array.size() || offset + len >= array.size()) {
| ~~~~~~~~~~~~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model_trainer.cc: In instantiation of ‘sentencepiece::unigram::TrainerModel::SentencePieces sentencepiece::unigram::Trainer::MakeSeedSentencePiecesInternal() [with node_int_type = int; sentencepiece::unigram::TrainerModel::SentencePieces = std::vector<std::pair<std::__cxx11::basic_string<char>, float> >]’:
/builder/src/sentencepiece/src/unigram_model_trainer.cc:142:55: required from here
142 | : MakeSeedSentencePiecesInternal<int32_t>();
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~
/builder/src/sentencepiece/src/unigram_model_trainer.cc:276:30: warning: comparison of integer expressions of different signedness: ‘const int’ and ‘std::vector<unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
276 | if (len <= 1 || offset >= array.size() || offset + len >= array.size()) {
| ~~~~~~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model_trainer.cc:276:62: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
276 | if (len <= 1 || offset >= array.size() || offset + len >= array.size()) {
| ~~~~~~~~~~~~~^~~~~~~~~~~~~~~
[ 28%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/model_interface.cc.o
[ 29%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/normalizer.cc.o
[ 30%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/char_model_trainer.cc.o
[ 31%] Building CXX object src/CMakeFiles/sentencepiece.dir/model_interface.cc.o
/builder/src/sentencepiece/src/normalizer.cc: In member function ‘std::pair<std::basic_string_view<char>, int> sentencepiece::normalizer::Normalizer::NormalizePrefix(std::string_view) const’:
/builder/src/sentencepiece/src/normalizer.cc:231:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::basic_string_view<char>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
231 | longest_value >= normalized_.size()) {
| ~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~
[ 32%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/bpe_model_trainer.cc.o
[ 34%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/sentencepiece_processor.cc.o
[ 35%] Building CXX object src/CMakeFiles/sentencepiece.dir/normalizer.cc.o
[ 36%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/unigram_model.cc.o
/builder/src/sentencepiece/src/sentencepiece_processor.cc: In function ‘std::vector<std::basic_string_view<char> > sentencepiece::{anonymous}::ToPieceArray(const std::vector<std::__cxx11::basic_string<char> >&)’:
/builder/src/sentencepiece/src/sentencepiece_processor.cc:59:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<std::__cxx11::basic_string<char> >::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
59 | for (int i = 0; i < v.size(); ++i) out[i] = v[i];
| ~~^~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc: In function ‘void sentencepiece::{anonymous}::ConvertToUnicodeSpansInternal(sentencepiece::SentencePieceText*)’:
/builder/src/sentencepiece/src/sentencepiece_processor.cc:72:26: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
72 | for (int i = prev; i < prev + mblen; ++i) {
| ~~^~~~~~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc: In member function ‘sentencepiece::util::Status sentencepiece::SentencePieceProcessor::PopulateSentencePieceText(std::string_view, std::string_view, const std::vector<long unsigned int>&, const sentencepiece::EncodeResult&, sentencepiece::SentencePieceText*) const’:
/builder/src/sentencepiece/src/sentencepiece_processor.cc:587:27: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::basic_string_view<char>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
587 | for (int i = 0; i < w.size(); ++i) {
| ~~^~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc:598:17: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::basic_string_view<char>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
598 | if (i == w.size() - 1) {
| ~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc: In lambda function:
/builder/src/sentencepiece/src/sentencepiece_processor.cc:870:27: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
870 | for (int j = 0; j < consumed; j++) {
| ~~^~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc:874:17: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
874 | if (j == consumed - 1) {
| ~~^~~~~~~~~~~~~~~
[ 37%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/sentencepiece_trainer.cc.o
/builder/src/sentencepiece/src/normalizer.cc: In member function ‘std::pair<std::basic_string_view<char>, int> sentencepiece::normalizer::Normalizer::NormalizePrefix(std::string_view) const’:
/builder/src/sentencepiece/src/normalizer.cc:231:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::basic_string_view<char>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
231 | longest_value >= normalized_.size()) {
| ~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~
[ 38%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/pretokenizer_for_training.cc.o
/builder/src/sentencepiece/src/unigram_model.cc: In member function ‘std::vector<std::pair<std::vector<sentencepiece::unigram::Lattice::Node*>, float> > sentencepiece::unigram::Lattice::NBest(size_t, bool, float)’:
/builder/src/sentencepiece/src/unigram_model.cc:431:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<sentencepiece::unigram::Lattice::Node*>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
431 | for (int i = 0; i < end_nodes(node->pos).size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:442:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<double>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
442 | for (int i = 0; i < adjusted_probs.size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:453:23: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<sentencepiece::unigram::Lattice::Node*>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
453 | for (int i = 0; i < end_nodes(node->pos).size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc: In member function ‘virtual sentencepiece::NBestEncodeResult sentencepiece::unigram::Model::SampleEncodeAndScore(std::string_view, float, int, bool, bool) const’:
/builder/src/sentencepiece/src/unigram_model.cc:778:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<std::pair<std::vector<sentencepiece::unigram::Lattice::Node*>, float> >::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
778 | for (int i = 0; i < nbest_samples.size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:788:25: warning: comparison of integer expressions of different signedness: ‘const int’ and ‘std::vector<std::pair<std::vector<sentencepiece::unigram::Lattice::Node*>, float> >::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
788 | if (index_of_best != nbest_samples.size()) {
| ~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:829:27: warning: comparison of integer expressions of different signedness: ‘std::vector<std::pair<std::vector<std::pair<std::basic_string_view<char>, int> >, float> >::size_type’ {aka ‘long unsigned int’} and ‘int’ [-Wsign-compare]
829 | while (results.size() < samples) {
| ~~~~~~~~~~~~~~~^~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc: In member function ‘sentencepiece::EncodeResult sentencepiece::unigram::Model::EncodeOptimized(std::string_view) const’:
/builder/src/sentencepiece/src/unigram_model.cc:969:20: warning: comparison of integer expressions of different signedness: ‘std::size_t’ {aka ‘long unsigned int’} and ‘const int’ [-Wsign-compare]
969 | while (key_pos < size) {
| ~~~~~~~~^~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:990:40: warning: comparison of integer expressions of different signedness: ‘const long unsigned int’ and ‘const int’ [-Wsign-compare]
990 | if (!has_single_node && length == mblen) {
| ~~~~~~~^~~~~~~~
[ 39%] Building CXX object src/CMakeFiles/sentencepiece.dir/sentencepiece_processor.cc.o
/builder/src/sentencepiece/src/pretokenizer_for_training.cc: In static member function ‘static std::vector<std::__cxx11::basic_string<char> > sentencepiece::pretokenizer::PretokenizerForTrainingInterface::Postprocess(const sentencepiece::SentencePieceText&)’:
/builder/src/sentencepiece/src/pretokenizer_for_training.cc:51:14: warning: comparison of integer expressions of different signedness: ‘int’ and ‘uint32_t’ {aka ‘unsigned int’} [-Wsign-compare]
51 | if (prev == piece.begin() && piece.begin() != 0) {
| ~~~~~^~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_trainer.cc: In lambda function:
/builder/src/sentencepiece/src/sentencepiece_trainer.cc:378:28: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
378 | for (int i = prev; i < prev + mblen; ++i) {
| ~~^~~~~~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_trainer.cc: In function ‘void sentencepiece::ConvertToUnicodeAlignment(std::string_view, std::string_view, std::vector<long unsigned int>*)’:
/builder/src/sentencepiece/src/sentencepiece_trainer.cc:394:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<long unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
394 | for (int i = 0; i < norm_to_orig->size(); ++i) {
| ~~^~~~~~~~~~~~~~~~~~~~~~
[ 40%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/util.cc.o
/builder/src/sentencepiece/src/sentencepiece_processor.cc: In function ‘std::vector<std::basic_string_view<char> > sentencepiece::{anonymous}::ToPieceArray(const std::vector<std::__cxx11::basic_string<char> >&)’:
/builder/src/sentencepiece/src/sentencepiece_processor.cc:59:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<std::__cxx11::basic_string<char> >::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
59 | for (int i = 0; i < v.size(); ++i) out[i] = v[i];
| ~~^~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc: In function ‘void sentencepiece::{anonymous}::ConvertToUnicodeSpansInternal(sentencepiece::SentencePieceText*)’:
/builder/src/sentencepiece/src/sentencepiece_processor.cc:72:26: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
72 | for (int i = prev; i < prev + mblen; ++i) {
| ~~^~~~~~~~~~~~~~
[ 41%] Building CXX object src/CMakeFiles/sentencepiece.dir/unigram_model.cc.o
/builder/src/sentencepiece/src/sentencepiece_processor.cc: In member function ‘sentencepiece::util::Status sentencepiece::SentencePieceProcessor::PopulateSentencePieceText(std::string_view, std::string_view, const std::vector<long unsigned int>&, const sentencepiece::EncodeResult&, sentencepiece::SentencePieceText*) const’:
/builder/src/sentencepiece/src/sentencepiece_processor.cc:587:27: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::basic_string_view<char>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
587 | for (int i = 0; i < w.size(); ++i) {
| ~~^~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc:598:17: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::basic_string_view<char>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
598 | if (i == w.size() - 1) {
| ~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc: In lambda function:
/builder/src/sentencepiece/src/sentencepiece_processor.cc:870:27: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
870 | for (int j = 0; j < consumed; j++) {
| ~~^~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc:874:17: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
874 | if (j == consumed - 1) {
| ~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/util.cc: In function ‘double sentencepiece::log_domain::LogSum(const std::vector<double>&)’:
/builder/src/sentencepiece/src/util.cc:309:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<double>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
309 | for (int i = 1; i < xs.size(); ++i) {
| ~~^~~~~~~~~~~
[ 42%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/word_model.cc.o
[ 43%] Linking CXX static library libsentencepiece_train.a
[ 43%] Built target sentencepiece_train-static
[ 44%] Building CXX object src/CMakeFiles/sentencepiece.dir/util.cc.o
/builder/src/sentencepiece/src/util.cc: In function ‘double sentencepiece::log_domain::LogSum(const std::vector<double>&)’:
/builder/src/sentencepiece/src/util.cc:309:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<double>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
309 | for (int i = 1; i < xs.size(); ++i) {
| ~~^~~~~~~~~~~
[ 45%] Building CXX object src/CMakeFiles/sentencepiece.dir/word_model.cc.o
/builder/src/sentencepiece/src/unigram_model.cc: In member function ‘std::vector<std::pair<std::vector<sentencepiece::unigram::Lattice::Node*>, float> > sentencepiece::unigram::Lattice::NBest(size_t, bool, float)’:
/builder/src/sentencepiece/src/unigram_model.cc:431:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<sentencepiece::unigram::Lattice::Node*>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
431 | for (int i = 0; i < end_nodes(node->pos).size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:442:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<double>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
442 | for (int i = 0; i < adjusted_probs.size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:453:23: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<sentencepiece::unigram::Lattice::Node*>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
453 | for (int i = 0; i < end_nodes(node->pos).size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc: In member function ‘virtual sentencepiece::NBestEncodeResult sentencepiece::unigram::Model::SampleEncodeAndScore(std::string_view, float, int, bool, bool) const’:
/builder/src/sentencepiece/src/unigram_model.cc:778:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<std::pair<std::vector<sentencepiece::unigram::Lattice::Node*>, float> >::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
778 | for (int i = 0; i < nbest_samples.size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:788:25: warning: comparison of integer expressions of different signedness: ‘const int’ and ‘std::vector<std::pair<std::vector<sentencepiece::unigram::Lattice::Node*>, float> >::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
788 | if (index_of_best != nbest_samples.size()) {
| ~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:829:27: warning: comparison of integer expressions of different signedness: ‘std::vector<std::pair<std::vector<std::pair<std::basic_string_view<char>, int> >, float> >::size_type’ {aka ‘long unsigned int’} and ‘int’ [-Wsign-compare]
829 | while (results.size() < samples) {
| ~~~~~~~~~~~~~~~^~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc: In member function ‘sentencepiece::EncodeResult sentencepiece::unigram::Model::EncodeOptimized(std::string_view) const’:
/builder/src/sentencepiece/src/unigram_model.cc:969:20: warning: comparison of integer expressions of different signedness: ‘std::size_t’ {aka ‘long unsigned int’} and ‘const int’ [-Wsign-compare]
969 | while (key_pos < size) {
| ~~~~~~~~^~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:990:40: warning: comparison of integer expressions of different signedness: ‘const long unsigned int’ and ‘const int’ [-Wsign-compare]
990 | if (!has_single_node && length == mblen) {
| ~~~~~~~^~~~~~~~
[ 46%] Linking CXX static library libsentencepiece.a
[ 46%] Built target sentencepiece-static
[ 47%] Linking CXX shared library libsentencepiece.so
[ 47%] Built target sentencepiece
[ 51%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/builder.cc.o
[ 51%] Building CXX object src/CMakeFiles/spm_encode.dir/spm_encode_main.cc.o
[ 51%] Building CXX object src/CMakeFiles/spm_decode.dir/spm_decode_main.cc.o
[ 52%] Building CXX object src/CMakeFiles/spm_export_vocab.dir/spm_export_vocab_main.cc.o
[ 53%] Linking CXX executable spm_export_vocab
[ 54%] Linking CXX executable spm_decode
[ 54%] Built target spm_export_vocab
[ 55%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/unicode_script.cc.o
[ 56%] Linking CXX executable spm_encode
[ 56%] Built target spm_decode
[ 57%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/trainer_factory.cc.o
[ 58%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/trainer_interface.cc.o
[ 58%] Built target spm_encode
[ 59%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/unigram_model_trainer.cc.o
[ 60%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/word_model_trainer.cc.o
/builder/src/sentencepiece/src/trainer_interface.cc: In member function ‘sentencepiece::util::Status sentencepiece::TrainerInterface::LoadSentences()’:
/builder/src/sentencepiece/src/trainer_interface.cc:484:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘const long unsigned int’ [-Wsign-compare]
484 | for (int n = 0; n < num_workers; ++n) {
| ~~^~~~~~~~~~~~~
[ 61%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/char_model_trainer.cc.o
/builder/src/sentencepiece/src/trainer_interface.cc: In instantiation of ‘void sentencepiece::AddDPNoise(const TrainerSpec&, std::mt19937*, T*) [with T = long int; std::mt19937 = std::mersenne_twister_engine<long unsigned int, 32, 624, 397, 31, 2567483615, 11, 4294967295, 7, 2636928640, 15, 4022730752, 18, 1812433253>]’:
/builder/src/sentencepiece/src/trainer_interface.cc:489:32: required from here
489 | AddDPNoise<int64_t>(trainer_spec_, generator,
| ~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~
490 | &(sentences_[i].second));
| ~~~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/trainer_interface.cc:320:18: warning: comparison of integer expressions of different signedness: ‘long int’ and ‘uint64_t’ {aka ‘long unsigned int’} [-Wsign-compare]
320 | if (*to_update < trainer_spec.differential_privacy_clipping_threshold()) {
| ~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model_trainer.cc: In instantiation of ‘sentencepiece::unigram::TrainerModel::SentencePieces sentencepiece::unigram::Trainer::MakeSeedSentencePiecesInternal() [with node_int_type = long int; sentencepiece::unigram::TrainerModel::SentencePieces = std::vector<std::pair<std::__cxx11::basic_string<char>, float> >]’:
/builder/src/sentencepiece/src/unigram_model_trainer.cc:141:55: required from here
141 | ? MakeSeedSentencePiecesInternal<int64_t>()
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~
/builder/src/sentencepiece/src/unigram_model_trainer.cc:276:30: warning: comparison of integer expressions of different signedness: ‘const long int’ and ‘std::vector<unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
276 | if (len <= 1 || offset >= array.size() || offset + len >= array.size()) {
| ~~~~~~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model_trainer.cc:276:62: warning: comparison of integer expressions of different signedness: ‘long int’ and ‘std::vector<unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
276 | if (len <= 1 || offset >= array.size() || offset + len >= array.size()) {
| ~~~~~~~~~~~~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model_trainer.cc: In instantiation of ‘sentencepiece::unigram::TrainerModel::SentencePieces sentencepiece::unigram::Trainer::MakeSeedSentencePiecesInternal() [with node_int_type = int; sentencepiece::unigram::TrainerModel::SentencePieces = std::vector<std::pair<std::__cxx11::basic_string<char>, float> >]’:
/builder/src/sentencepiece/src/unigram_model_trainer.cc:142:55: required from here
142 | : MakeSeedSentencePiecesInternal<int32_t>();
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~
/builder/src/sentencepiece/src/unigram_model_trainer.cc:276:30: warning: comparison of integer expressions of different signedness: ‘const int’ and ‘std::vector<unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
276 | if (len <= 1 || offset >= array.size() || offset + len >= array.size()) {
| ~~~~~~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model_trainer.cc:276:62: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
276 | if (len <= 1 || offset >= array.size() || offset + len >= array.size()) {
| ~~~~~~~~~~~~~^~~~~~~~~~~~~~~
[ 62%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/bpe_model_trainer.cc.o
[ 63%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/sentencepiece_trainer.cc.o
[ 64%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/pretokenizer_for_training.cc.o
/builder/src/sentencepiece/src/pretokenizer_for_training.cc: In static member function ‘static std::vector<std::__cxx11::basic_string<char> > sentencepiece::pretokenizer::PretokenizerForTrainingInterface::Postprocess(const sentencepiece::SentencePieceText&)’:
/builder/src/sentencepiece/src/pretokenizer_for_training.cc:51:14: warning: comparison of integer expressions of different signedness: ‘int’ and ‘uint32_t’ {aka ‘unsigned int’} [-Wsign-compare]
51 | if (prev == piece.begin() && piece.begin() != 0) {
| ~~~~~^~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_trainer.cc: In lambda function:
/builder/src/sentencepiece/src/sentencepiece_trainer.cc:378:28: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
378 | for (int i = prev; i < prev + mblen; ++i) {
| ~~^~~~~~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_trainer.cc: In function ‘void sentencepiece::ConvertToUnicodeAlignment(std::string_view, std::string_view, std::vector<long unsigned int>*)’:
/builder/src/sentencepiece/src/sentencepiece_trainer.cc:394:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<long unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
394 | for (int i = 0; i < norm_to_orig->size(); ++i) {
| ~~^~~~~~~~~~~~~~~~~~~~~~
[ 65%] Linking CXX shared library libsentencepiece_train.so
[ 68%] Built target sentencepiece_train
[ 69%] Building CXX object src/CMakeFiles/spm_normalize.dir/spm_normalize_main.cc.o
[ 70%] Building CXX object src/CMakeFiles/spm_train.dir/spm_train_main.cc.o
[ 72%] Building CXX object src/CMakeFiles/spm_test.dir/bpe_model_test.cc.o
[ 72%] Building CXX object src/CMakeFiles/spm_test.dir/test_main.cc.o
/builder/src/sentencepiece/src/spm_normalize_main.cc: In function ‘int main(int, char**)’:
/builder/src/sentencepiece/src/spm_normalize_main.cc:64:16: warning: unused variable ‘model_proto’ [-Wunused-variable]
64 | ModelProto model_proto;
| ^~~~~~~~~~~
[ 73%] Building CXX object src/CMakeFiles/spm_test.dir/bpe_model_trainer_test.cc.o
[ 74%] Linking CXX executable spm_normalize
[ 74%] Built target spm_normalize
[ 75%] Building CXX object src/CMakeFiles/spm_test.dir/builder_test.cc.o
[ 76%] Building CXX object src/CMakeFiles/spm_test.dir/char_model_test.cc.o
[ 77%] Linking CXX executable spm_train
[ 77%] Built target spm_train
[ 78%] Building CXX object src/CMakeFiles/spm_test.dir/char_model_trainer_test.cc.o
[ 79%] Building CXX object src/CMakeFiles/spm_test.dir/filesystem_test.cc.o
[ 80%] Building CXX object src/CMakeFiles/spm_test.dir/init_test.cc.o
[ 81%] Building CXX object src/CMakeFiles/spm_test.dir/model_factory_test.cc.o
[ 82%] Building CXX object src/CMakeFiles/spm_test.dir/model_interface_test.cc.o
[ 84%] Building CXX object src/CMakeFiles/spm_test.dir/normalizer_test.cc.o
[ 85%] Building CXX object src/CMakeFiles/spm_test.dir/sentencepiece_processor_test.cc.o
[ 86%] Building CXX object src/CMakeFiles/spm_test.dir/sentencepiece_trainer_test.cc.o
[ 87%] Building CXX object src/CMakeFiles/spm_test.dir/testharness.cc.o
[ 88%] Building CXX object src/CMakeFiles/spm_test.dir/trainer_factory_test.cc.o
[ 89%] Building CXX object src/CMakeFiles/spm_test.dir/trainer_interface_test.cc.o
[ 90%] Building CXX object src/CMakeFiles/spm_test.dir/unicode_script_test.cc.o
[ 91%] Building CXX object src/CMakeFiles/spm_test.dir/unigram_model_test.cc.o
[ 92%] Building CXX object src/CMakeFiles/spm_test.dir/unigram_model_trainer_test.cc.o
[ 93%] Building CXX object src/CMakeFiles/spm_test.dir/util_test.cc.o
[ 94%] Building CXX object src/CMakeFiles/spm_test.dir/word_model_test.cc.o
[ 95%] Building CXX object src/CMakeFiles/spm_test.dir/word_model_trainer_test.cc.o
[ 96%] Building CXX object src/CMakeFiles/spm_test.dir/pretokenizer_for_training_test.cc.o
[ 97%] Linking CXX executable spm_test
[100%] Built target spm_test
-- Install configuration: ""
-- Installing: build/root/lib/pkgconfig/sentencepiece.pc
-- Installing: build/root/lib/libsentencepiece.so.0.0.0
-- Installing: build/root/lib/libsentencepiece.so.0
-- Installing: build/root/lib/libsentencepiece.so
-- Installing: build/root/lib/libsentencepiece_train.so.0.0.0
-- Installing: build/root/lib/libsentencepiece_train.so.0
-- Set non-toolchain portion of runtime path of "build/root/lib/libsentencepiece_train.so.0.0.0" to ""
-- Installing: build/root/lib/libsentencepiece_train.so
-- Installing: build/root/lib/libsentencepiece.a
-- Installing: build/root/lib/libsentencepiece_train.a
-- Installing: build/root/bin/spm_encode
-- Set non-toolchain portion of runtime path of "build/root/bin/spm_encode" to ""
-- Installing: build/root/bin/spm_decode
-- Set non-toolchain portion of runtime path of "build/root/bin/spm_decode" to ""
-- Installing: build/root/bin/spm_normalize
-- Set non-toolchain portion of runtime path of "build/root/bin/spm_normalize" to ""
-- Installing: build/root/bin/spm_train
-- Set non-toolchain portion of runtime path of "build/root/bin/spm_train" to ""
-- Installing: build/root/bin/spm_export_vocab
-- Set non-toolchain portion of runtime path of "build/root/bin/spm_export_vocab" to ""
-- Installing: build/root/include/sentencepiece_trainer.h
-- Installing: build/root/include/sentencepiece_processor.h
-- Installing: build/root/include/sentencepiece.pb.h
* Getting build dependencies for wheel...
running egg_info
creating src/sentencepiece.egg-info
writing src/sentencepiece.egg-info/PKG-INFO
writing dependency_links to src/sentencepiece.egg-info/dependency_links.txt
writing requirements to src/sentencepiece.egg-info/requires.txt
writing top-level names to src/sentencepiece.egg-info/top_level.txt
writing manifest file 'src/sentencepiece.egg-info/SOURCES.txt'
reading manifest file 'src/sentencepiece.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching '*' under directory 'sentencepiece'
writing manifest file 'src/sentencepiece.egg-info/SOURCES.txt'
* Building wheel...
running bdist_wheel
running build
running build_py
creating build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/__init__.py -> build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/_version.py -> build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/sentencepiece_model_pb2.py -> build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/sentencepiece_pb2.py -> build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/sentencepiece_model_pb2.py -> build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/sentencepiece_pb2.py -> build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/_version.py -> build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/__init__.py -> build/lib.linux-x86_64-cpython-314/sentencepiece
running egg_info
writing src/sentencepiece.egg-info/PKG-INFO
writing dependency_links to src/sentencepiece.egg-info/dependency_links.txt
writing requirements to src/sentencepiece.egg-info/requires.txt
writing top-level names to src/sentencepiece.egg-info/top_level.txt
reading manifest file 'src/sentencepiece.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching '*' under directory 'sentencepiece'
writing manifest file 'src/sentencepiece.egg-info/SOURCES.txt'
copying src/sentencepiece/sentencepiece.i -> build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/sentencepiece_wrap.cxx -> build/lib.linux-x86_64-cpython-314/sentencepiece
running build_ext
## cflags=-std=c++17 -I../build/root/include -Wl,-strip-all
## libs=../build/root/lib/libsentencepiece.so ../build/root/lib/libsentencepiece_train.so -Wl,-strip-all -Wl,-Bsymbolic
building 'sentencepiece._sentencepiece' extension
creating build/temp.linux-x86_64-cpython-314/src/sentencepiece
g++ -march=x86-64 -mtune=generic -O2 -pipe -fno-plt -fexceptions -Wp,-D_FORTIFY_SOURCE=2 -Wformat -Werror=format-security -fstack-clash-protection -fcf-protection -Wp,-D_GLIBCXX_ASSERTIONS -flto=auto -fPIC -I/usr/include/python3.14 -c src/sentencepiece/sentencepiece_wrap.cxx -o build/temp.linux-x86_64-cpython-314/src/sentencepiece/sentencepiece_wrap.o -std=c++17 -I../build/root/include -Wl,-strip-all
g++ -march=x86-64 -mtune=generic -O2 -pipe -fno-plt -fexceptions -Wp,-D_FORTIFY_SOURCE=2 -Wformat -Werror=format-security -fstack-clash-protection -fcf-protection -Wp,-D_GLIBCXX_ASSERTIONS -flto=auto -shared -Wl,-O1 -Wl,--sort-common -Wl,--as-needed -Wl,-z,relro -Wl,-z,now -Wl,-z,pack-relative-relocs -flto=auto -Wl,-O1 -Wl,--sort-common -Wl,--as-needed -Wl,-z,relro -Wl,-z,now -Wl,-z,pack-relative-relocs -flto=auto -Wl,-O1,--sort-common,--as-needed,-z,relro,-z,now -flto=auto -march=x86-64 -mtune=generic -O2 -pipe -fno-plt -fexceptions -Wp,-D_FORTIFY_SOURCE=2 -Wformat -Werror=format-security -fstack-clash-protection -fcf-protection -Wp,-D_GLIBCXX_ASSERTIONS -flto=auto build/temp.linux-x86_64-cpython-314/src/sentencepiece/sentencepiece_wrap.o -L/usr/lib -o build/lib.linux-x86_64-cpython-314/sentencepiece/_sentencepiece.cpython-314-x86_64-linux-gnu.so ../build/root/lib/libsentencepiece.so ../build/root/lib/libsentencepiece_train.so -Wl,-strip-all -Wl,-Bsymbolic
installing to build/bdist.linux-x86_64/wheel
running install
running install_lib
creating build/bdist.linux-x86_64/wheel
creating build/bdist.linux-x86_64/wheel/sentencepiece
copying build/lib.linux-x86_64-cpython-314/sentencepiece/sentencepiece_model_pb2.py -> build/bdist.linux-x86_64/wheel/./sentencepiece
copying build/lib.linux-x86_64-cpython-314/sentencepiece/sentencepiece_pb2.py -> build/bdist.linux-x86_64/wheel/./sentencepiece
copying build/lib.linux-x86_64-cpython-314/sentencepiece/_version.py -> build/bdist.linux-x86_64/wheel/./sentencepiece
copying build/lib.linux-x86_64-cpython-314/sentencepiece/__init__.py -> build/bdist.linux-x86_64/wheel/./sentencepiece
copying build/lib.linux-x86_64-cpython-314/sentencepiece/sentencepiece.i -> build/bdist.linux-x86_64/wheel/./sentencepiece
copying build/lib.linux-x86_64-cpython-314/sentencepiece/sentencepiece_wrap.cxx -> build/bdist.linux-x86_64/wheel/./sentencepiece
copying build/lib.linux-x86_64-cpython-314/sentencepiece/_sentencepiece.cpython-314-x86_64-linux-gnu.so -> build/bdist.linux-x86_64/wheel/./sentencepiece
running install_egg_info
Copying src/sentencepiece.egg-info to build/bdist.linux-x86_64/wheel/./sentencepiece-0.2.1-py3.14.egg-info
running install_scripts
creating build/bdist.linux-x86_64/wheel/sentencepiece-0.2.1.dist-info/WHEEL
creating '/builder/src/sentencepiece/python/dist/.tmp-lhwxfwhu/sentencepiece-0.2.1-cp314-cp314-linux_x86_64.whl' and adding 'build/bdist.linux-x86_64/wheel' to it
adding 'sentencepiece/__init__.py'
adding 'sentencepiece/_sentencepiece.cpython-314-x86_64-linux-gnu.so'
adding 'sentencepiece/_version.py'
adding 'sentencepiece/sentencepiece.i'
adding 'sentencepiece/sentencepiece_model_pb2.py'
adding 'sentencepiece/sentencepiece_pb2.py'
adding 'sentencepiece/sentencepiece_wrap.cxx'
adding 'sentencepiece-0.2.1.dist-info/METADATA'
adding 'sentencepiece-0.2.1.dist-info/WHEEL'
adding 'sentencepiece-0.2.1.dist-info/top_level.txt'
adding 'sentencepiece-0.2.1.dist-info/RECORD'
removing build/bdist.linux-x86_64/wheel
Successfully built sentencepiece-0.2.1-cp314-cp314-linux_x86_64.whl
==> Starting check()...
Test project /builder/src/sentencepiece/build
Start 1: sentencepiece_test
1/1 Test #1: sentencepiece_test ............... Passed 7.80 sec
100% tests passed, 0 tests failed out of 1
Total Test time (real) = 7.81 sec
============================= test session starts ==============================
platform linux -- Python 3.14.5, pytest-9.0.3, pluggy-1.6.0
rootdir: /builder/src/sentencepiece/python
configfile: pyproject.toml
collected 23 items
test/sentencepiece_test.py ....................... [100%]
=============================== warnings summary ===============================
<frozen importlib._bootstrap>:491
<frozen importlib._bootstrap>:491: DeprecationWarning: builtin type SwigPyPacked has no __module__ attribute
<frozen importlib._bootstrap>:491
<frozen importlib._bootstrap>:491: DeprecationWarning: builtin type SwigPyObject has no __module__ attribute
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
======================== 23 passed, 2 warnings in 3.67s ========================
<sys>:0: DeprecationWarning: builtin type swigvarlink has no __module__ attribute
==> Entering fakeroot environment...
==> Starting package_sentencepiece()...
-- Install configuration: ""
-- Installing: /builder/pkg/sentencepiece/usr/lib/pkgconfig/sentencepiece.pc
-- Installing: /builder/pkg/sentencepiece/usr/lib/libsentencepiece.so.0.0.0
-- Installing: /builder/pkg/sentencepiece/usr/lib/libsentencepiece.so.0
-- Installing: /builder/pkg/sentencepiece/usr/lib/libsentencepiece.so
-- Installing: /builder/pkg/sentencepiece/usr/lib/libsentencepiece_train.so.0.0.0
-- Installing: /builder/pkg/sentencepiece/usr/lib/libsentencepiece_train.so.0
-- Set non-toolchain portion of runtime path of "/builder/pkg/sentencepiece/usr/lib/libsentencepiece_train.so.0.0.0" to ""
-- Installing: /builder/pkg/sentencepiece/usr/lib/libsentencepiece_train.so
-- Installing: /builder/pkg/sentencepiece/usr/lib/libsentencepiece.a
-- Installing: /builder/pkg/sentencepiece/usr/lib/libsentencepiece_train.a
-- Installing: /builder/pkg/sentencepiece/usr/bin/spm_encode
-- Set non-toolchain portion of runtime path of "/builder/pkg/sentencepiece/usr/bin/spm_encode" to ""
-- Installing: /builder/pkg/sentencepiece/usr/bin/spm_decode
-- Set non-toolchain portion of runtime path of "/builder/pkg/sentencepiece/usr/bin/spm_decode" to ""
-- Installing: /builder/pkg/sentencepiece/usr/bin/spm_normalize
-- Set non-toolchain portion of runtime path of "/builder/pkg/sentencepiece/usr/bin/spm_normalize" to ""
-- Installing: /builder/pkg/sentencepiece/usr/bin/spm_train
-- Set non-toolchain portion of runtime path of "/builder/pkg/sentencepiece/usr/bin/spm_train" to ""
-- Installing: /builder/pkg/sentencepiece/usr/bin/spm_export_vocab
-- Set non-toolchain portion of runtime path of "/builder/pkg/sentencepiece/usr/bin/spm_export_vocab" to ""
-- Installing: /builder/pkg/sentencepiece/usr/include/sentencepiece_trainer.h
-- Installing: /builder/pkg/sentencepiece/usr/include/sentencepiece_processor.h
-- Installing: /builder/pkg/sentencepiece/usr/include/sentencepiece.pb.h
==> Tidying install...
-> Removing libtool files...
-> Removing static library files...
libfakeroot internal error: payload not recognized!
-> Purging unwanted files...
-> Stripping unneeded symbols from binaries and libraries...
-> Compressing man and info pages...
==> Checking for packaging issues...
==> Creating package "sentencepiece"...
-> Generating .PKGINFO file...
-> Generating .BUILDINFO file...
-> Generating .MTREE file...
-> Compressing package...
==> Starting package_python-sentencepiece()...
==> Tidying install...
-> Removing libtool files...
-> Removing static library files...
-> Purging unwanted files...
-> Stripping unneeded symbols from binaries and libraries...
-> Compressing man and info pages...
==> Checking for packaging issues...
==> Creating package "python-sentencepiece"...
-> Generating .PKGINFO file...
-> Generating .BUILDINFO file...
-> Generating .MTREE file...
-> Compressing package...
==> Leaving fakeroot environment.
==> Finished making: sentencepiece 0.2.1-2 (Tue Jun 2 07:06:35 2026)
==> Checking runtime dependencies...
==> Checking buildtime dependencies...
==> Installing missing dependencies...
resolving dependencies...
looking for conflicting packages...
Packages (29) cppdap-1.58.0-3 gtest-1.17.0-2 hicolor-icon-theme-0.18-1 jsoncpp-1.9.6-3 libunwind-1.8.2-1 libuv-1.52.1-1 python-autocommand-2.2.2-9 python-iniconfig-2.3.0-1 python-jaraco.collections-5.1.0-3 python-jaraco.context-6.1.2-1 python-jaraco.functools-4.1.0-3 python-jaraco.text-4.0.0-4 python-more-itertools-11.1.0-1 python-pkg_resources-81.0.0-1 python-platformdirs-4.10.0-1 python-pluggy-1.6.0-3 python-pygments-2.20.0-1 python-pyproject-hooks-1.2.0-6 python-typing_extensions-4.15.0-3 rhash-1.4.6-1 abseil-cpp-20260107.1-1 cmake-4.3.3-1 gperftools-2.18.1-1 protobuf-34.1-1 python-build-1.4.3-1 python-installer-1.0.0-1 python-pytest-1:9.0.3-1 python-setuptools-1:82.0.1-1 python-wheel-0.47.0-1
Total Download Size: 17.17 MiB
Total Installed Size: 161.25 MiB
:: Proceed with installation? [Y/n]
:: Retrieving packages...
cmake-4.3.3-1-x86_64 downloading...
python-setuptools-1:82.0.1-1-any downloading...
python-pytest-1:9.0.3-1-any downloading...
cppdap-1.58.0-3-x86_64 downloading...
python-more-itertools-11.1.0-1-any downloading...
python-wheel-0.47.0-1-any downloading...
python-build-1.4.3-1-any downloading...
python-platformdirs-4.10.0-1-any downloading...
python-pluggy-1.6.0-3-any downloading...
python-installer-1.0.0-1-any downloading...
python-iniconfig-2.3.0-1-any downloading...
python-jaraco.context-6.1.2-1-any downloading...
checking keyring...
checking package integrity...
loading package files...
checking for file conflicts...
checking available disk space...
:: Processing package changes...
installing cppdap...
installing hicolor-icon-theme...
installing jsoncpp...
Optional dependencies for jsoncpp
jsoncpp-doc: documentation
installing libuv...
installing rhash...
installing cmake...
Optional dependencies for cmake
make: for unix Makefile generator [installed]
ninja: for ninja generator [installed]
qt6-base: cmake-gui
installing gtest...
Optional dependencies for gtest
python: gmock generator [installed]
installing abseil-cpp...
installing libunwind...
installing gperftools...
installing protobuf...
installing python-pyproject-hooks...
installing python-build...
Optional dependencies for python-build
python-pip: to use as the Python package installer (default)
python-uv: to use as the Python package installer
python-virtualenv: to use virtualenv for build isolation
installing python-more-itertools...
installing python-jaraco.functools...
installing python-jaraco.context...
installing python-autocommand...
installing python-jaraco.text...
Optional dependencies for python-jaraco.text
python-inflect: for show-newlines script
installing python-jaraco.collections...
installing python-platformdirs...
installing python-wheel...
Optional dependencies for python-wheel
python-keyring: for wheel.signatures
python-xdg: for wheel.signatures
python-setuptools: for legacy bdist_wheel subcommand [pending]
installing python-typing_extensions...
installing python-pkg_resources...
installing python-setuptools...
installing python-installer...
installing python-iniconfig...
installing python-pluggy...
installing python-pygments...
installing python-pytest...
:: Running post-transaction hooks...
(1/1) Arming ConditionNeedsUpdate...
==> Retrieving sources...
-> Cloning sentencepiece git repo...
Cloning into bare repository '/builder/sentencepiece'...
-> Found dont-include-data-files-in-python-pkg.patch
==> WARNING: Skipping verification of source file PGP signatures.
==> Validating source files with sha512sums...
sentencepiece ... Passed
dont-include-data-files-in-python-pkg.patch ... Passed
==> Extracting sources...
-> Creating working copy of sentencepiece git repo...
Cloning into 'sentencepiece'...
done.
Switched to a new branch 'makepkg'
==> Starting prepare()...
Checking patch python/setup.py...
Checking patch python/src/sentencepiece/__init__.py...
Applied patch python/setup.py cleanly.
Applied patch python/src/sentencepiece/__init__.py cleanly.
==> Starting build()...
-- VERSION: 0.2.1
-- The C compiler identification is GNU 16.1.1
-- The CXX compiler identification is GNU 16.1.1
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/sbin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/sbin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
-- Found Threads: TRUE
-- Found Protobuf: /usr/lib/libprotobuf.so (found version "7.34.1")
-- Found TCMalloc: /usr/lib/libtcmalloc_minimal.so
-- Configuring done (1.0s)
-- Generating done (0.0s)
-- Build files have been written to: /builder/src/sentencepiece/build
[ 2%] Running cpp protocol buffer compiler on sentencepiece.proto
[ 2%] Running cpp protocol buffer compiler on sentencepiece_model.proto
[ 3%] Running cpp protocol buffer compiler on sentencepiece_model.proto
[ 4%] Running cpp protocol buffer compiler on sentencepiece_model.proto
[ 5%] Running cpp protocol buffer compiler on sentencepiece.proto
[ 6%] Running cpp protocol buffer compiler on sentencepiece.proto
[ 7%] Building CXX object src/CMakeFiles/sentencepiece.dir/sentencepiece.pb.cc.o
[ 8%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/unicode_script.cc.o
[ 9%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/builder.cc.o
[ 10%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/sentencepiece.pb.cc.o
[ 11%] Building CXX object src/CMakeFiles/sentencepiece.dir/sentencepiece_model.pb.cc.o
[ 12%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/sentencepiece_model.pb.cc.o
[ 13%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/bpe_model.cc.o
[ 14%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/trainer_factory.cc.o
[ 15%] Building CXX object src/CMakeFiles/sentencepiece.dir/bpe_model.cc.o
[ 17%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/trainer_interface.cc.o
[ 18%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/char_model.cc.o
[ 19%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/error.cc.o
/builder/src/sentencepiece/src/trainer_interface.cc: In member function ‘sentencepiece::util::Status sentencepiece::TrainerInterface::LoadSentences()’:
/builder/src/sentencepiece/src/trainer_interface.cc:484:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘const long unsigned int’ [-Wsign-compare]
484 | for (int n = 0; n < num_workers; ++n) {
| ~~^~~~~~~~~~~~~
/builder/src/sentencepiece/src/trainer_interface.cc: In instantiation of ‘void sentencepiece::AddDPNoise(const TrainerSpec&, std::mt19937*, T*) [with T = long int; std::mt19937 = std::mersenne_twister_engine<long unsigned int, 32, 624, 397, 31, 2567483615, 11, 4294967295, 7, 2636928640, 15, 4022730752, 18, 1812433253>]’:
/builder/src/sentencepiece/src/trainer_interface.cc:489:32: required from here
489 | AddDPNoise<int64_t>(trainer_spec_, generator,
| ~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~
490 | &(sentences_[i].second));
| ~~~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/trainer_interface.cc:320:18: warning: comparison of integer expressions of different signedness: ‘long int’ and ‘uint64_t’ {aka ‘long unsigned int’} [-Wsign-compare]
320 | if (*to_update < trainer_spec.differential_privacy_clipping_threshold()) {
| ~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[ 21%] Building CXX object src/CMakeFiles/sentencepiece.dir/error.cc.o
[ 21%] Building CXX object src/CMakeFiles/sentencepiece.dir/char_model.cc.o
[ 22%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/filesystem.cc.o
[ 23%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/unigram_model_trainer.cc.o
[ 24%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/model_factory.cc.o
[ 25%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/word_model_trainer.cc.o
[ 26%] Building CXX object src/CMakeFiles/sentencepiece.dir/filesystem.cc.o
[ 27%] Building CXX object src/CMakeFiles/sentencepiece.dir/model_factory.cc.o
/builder/src/sentencepiece/src/unigram_model_trainer.cc: In instantiation of ‘sentencepiece::unigram::TrainerModel::SentencePieces sentencepiece::unigram::Trainer::MakeSeedSentencePiecesInternal() [with node_int_type = long int; sentencepiece::unigram::TrainerModel::SentencePieces = std::vector<std::pair<std::__cxx11::basic_string<char>, float> >]’:
/builder/src/sentencepiece/src/unigram_model_trainer.cc:141:55: required from here
141 | ? MakeSeedSentencePiecesInternal<int64_t>()
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~
/builder/src/sentencepiece/src/unigram_model_trainer.cc:276:30: warning: comparison of integer expressions of different signedness: ‘const long int’ and ‘std::vector<unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
276 | if (len <= 1 || offset >= array.size() || offset + len >= array.size()) {
| ~~~~~~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model_trainer.cc:276:62: warning: comparison of integer expressions of different signedness: ‘long int’ and ‘std::vector<unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
276 | if (len <= 1 || offset >= array.size() || offset + len >= array.size()) {
| ~~~~~~~~~~~~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model_trainer.cc: In instantiation of ‘sentencepiece::unigram::TrainerModel::SentencePieces sentencepiece::unigram::Trainer::MakeSeedSentencePiecesInternal() [with node_int_type = int; sentencepiece::unigram::TrainerModel::SentencePieces = std::vector<std::pair<std::__cxx11::basic_string<char>, float> >]’:
/builder/src/sentencepiece/src/unigram_model_trainer.cc:142:55: required from here
142 | : MakeSeedSentencePiecesInternal<int32_t>();
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~
/builder/src/sentencepiece/src/unigram_model_trainer.cc:276:30: warning: comparison of integer expressions of different signedness: ‘const int’ and ‘std::vector<unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
276 | if (len <= 1 || offset >= array.size() || offset + len >= array.size()) {
| ~~~~~~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model_trainer.cc:276:62: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
276 | if (len <= 1 || offset >= array.size() || offset + len >= array.size()) {
| ~~~~~~~~~~~~~^~~~~~~~~~~~~~~
[ 28%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/model_interface.cc.o
[ 29%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/normalizer.cc.o
[ 30%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/char_model_trainer.cc.o
[ 31%] Building CXX object src/CMakeFiles/sentencepiece.dir/model_interface.cc.o
/builder/src/sentencepiece/src/normalizer.cc: In member function ‘std::pair<std::basic_string_view<char>, int> sentencepiece::normalizer::Normalizer::NormalizePrefix(std::string_view) const’:
/builder/src/sentencepiece/src/normalizer.cc:231:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::basic_string_view<char>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
231 | longest_value >= normalized_.size()) {
| ~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~
[ 32%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/bpe_model_trainer.cc.o
[ 34%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/sentencepiece_processor.cc.o
[ 35%] Building CXX object src/CMakeFiles/sentencepiece.dir/normalizer.cc.o
[ 36%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/unigram_model.cc.o
/builder/src/sentencepiece/src/sentencepiece_processor.cc: In function ‘std::vector<std::basic_string_view<char> > sentencepiece::{anonymous}::ToPieceArray(const std::vector<std::__cxx11::basic_string<char> >&)’:
/builder/src/sentencepiece/src/sentencepiece_processor.cc:59:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<std::__cxx11::basic_string<char> >::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
59 | for (int i = 0; i < v.size(); ++i) out[i] = v[i];
| ~~^~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc: In function ‘void sentencepiece::{anonymous}::ConvertToUnicodeSpansInternal(sentencepiece::SentencePieceText*)’:
/builder/src/sentencepiece/src/sentencepiece_processor.cc:72:26: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
72 | for (int i = prev; i < prev + mblen; ++i) {
| ~~^~~~~~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc: In member function ‘sentencepiece::util::Status sentencepiece::SentencePieceProcessor::PopulateSentencePieceText(std::string_view, std::string_view, const std::vector<long unsigned int>&, const sentencepiece::EncodeResult&, sentencepiece::SentencePieceText*) const’:
/builder/src/sentencepiece/src/sentencepiece_processor.cc:587:27: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::basic_string_view<char>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
587 | for (int i = 0; i < w.size(); ++i) {
| ~~^~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc:598:17: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::basic_string_view<char>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
598 | if (i == w.size() - 1) {
| ~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc: In lambda function:
/builder/src/sentencepiece/src/sentencepiece_processor.cc:870:27: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
870 | for (int j = 0; j < consumed; j++) {
| ~~^~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc:874:17: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
874 | if (j == consumed - 1) {
| ~~^~~~~~~~~~~~~~~
[ 37%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/sentencepiece_trainer.cc.o
/builder/src/sentencepiece/src/normalizer.cc: In member function ‘std::pair<std::basic_string_view<char>, int> sentencepiece::normalizer::Normalizer::NormalizePrefix(std::string_view) const’:
/builder/src/sentencepiece/src/normalizer.cc:231:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::basic_string_view<char>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
231 | longest_value >= normalized_.size()) {
| ~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~
[ 38%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/pretokenizer_for_training.cc.o
/builder/src/sentencepiece/src/unigram_model.cc: In member function ‘std::vector<std::pair<std::vector<sentencepiece::unigram::Lattice::Node*>, float> > sentencepiece::unigram::Lattice::NBest(size_t, bool, float)’:
/builder/src/sentencepiece/src/unigram_model.cc:431:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<sentencepiece::unigram::Lattice::Node*>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
431 | for (int i = 0; i < end_nodes(node->pos).size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:442:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<double>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
442 | for (int i = 0; i < adjusted_probs.size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:453:23: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<sentencepiece::unigram::Lattice::Node*>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
453 | for (int i = 0; i < end_nodes(node->pos).size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc: In member function ‘virtual sentencepiece::NBestEncodeResult sentencepiece::unigram::Model::SampleEncodeAndScore(std::string_view, float, int, bool, bool) const’:
/builder/src/sentencepiece/src/unigram_model.cc:778:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<std::pair<std::vector<sentencepiece::unigram::Lattice::Node*>, float> >::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
778 | for (int i = 0; i < nbest_samples.size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:788:25: warning: comparison of integer expressions of different signedness: ‘const int’ and ‘std::vector<std::pair<std::vector<sentencepiece::unigram::Lattice::Node*>, float> >::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
788 | if (index_of_best != nbest_samples.size()) {
| ~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:829:27: warning: comparison of integer expressions of different signedness: ‘std::vector<std::pair<std::vector<std::pair<std::basic_string_view<char>, int> >, float> >::size_type’ {aka ‘long unsigned int’} and ‘int’ [-Wsign-compare]
829 | while (results.size() < samples) {
| ~~~~~~~~~~~~~~~^~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc: In member function ‘sentencepiece::EncodeResult sentencepiece::unigram::Model::EncodeOptimized(std::string_view) const’:
/builder/src/sentencepiece/src/unigram_model.cc:969:20: warning: comparison of integer expressions of different signedness: ‘std::size_t’ {aka ‘long unsigned int’} and ‘const int’ [-Wsign-compare]
969 | while (key_pos < size) {
| ~~~~~~~~^~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:990:40: warning: comparison of integer expressions of different signedness: ‘const long unsigned int’ and ‘const int’ [-Wsign-compare]
990 | if (!has_single_node && length == mblen) {
| ~~~~~~~^~~~~~~~
[ 39%] Building CXX object src/CMakeFiles/sentencepiece.dir/sentencepiece_processor.cc.o
/builder/src/sentencepiece/src/pretokenizer_for_training.cc: In static member function ‘static std::vector<std::__cxx11::basic_string<char> > sentencepiece::pretokenizer::PretokenizerForTrainingInterface::Postprocess(const sentencepiece::SentencePieceText&)’:
/builder/src/sentencepiece/src/pretokenizer_for_training.cc:51:14: warning: comparison of integer expressions of different signedness: ‘int’ and ‘uint32_t’ {aka ‘unsigned int’} [-Wsign-compare]
51 | if (prev == piece.begin() && piece.begin() != 0) {
| ~~~~~^~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_trainer.cc: In lambda function:
/builder/src/sentencepiece/src/sentencepiece_trainer.cc:378:28: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
378 | for (int i = prev; i < prev + mblen; ++i) {
| ~~^~~~~~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_trainer.cc: In function ‘void sentencepiece::ConvertToUnicodeAlignment(std::string_view, std::string_view, std::vector<long unsigned int>*)’:
/builder/src/sentencepiece/src/sentencepiece_trainer.cc:394:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<long unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
394 | for (int i = 0; i < norm_to_orig->size(); ++i) {
| ~~^~~~~~~~~~~~~~~~~~~~~~
[ 40%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/util.cc.o
/builder/src/sentencepiece/src/sentencepiece_processor.cc: In function ‘std::vector<std::basic_string_view<char> > sentencepiece::{anonymous}::ToPieceArray(const std::vector<std::__cxx11::basic_string<char> >&)’:
/builder/src/sentencepiece/src/sentencepiece_processor.cc:59:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<std::__cxx11::basic_string<char> >::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
59 | for (int i = 0; i < v.size(); ++i) out[i] = v[i];
| ~~^~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc: In function ‘void sentencepiece::{anonymous}::ConvertToUnicodeSpansInternal(sentencepiece::SentencePieceText*)’:
/builder/src/sentencepiece/src/sentencepiece_processor.cc:72:26: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
72 | for (int i = prev; i < prev + mblen; ++i) {
| ~~^~~~~~~~~~~~~~
[ 41%] Building CXX object src/CMakeFiles/sentencepiece.dir/unigram_model.cc.o
/builder/src/sentencepiece/src/sentencepiece_processor.cc: In member function ‘sentencepiece::util::Status sentencepiece::SentencePieceProcessor::PopulateSentencePieceText(std::string_view, std::string_view, const std::vector<long unsigned int>&, const sentencepiece::EncodeResult&, sentencepiece::SentencePieceText*) const’:
/builder/src/sentencepiece/src/sentencepiece_processor.cc:587:27: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::basic_string_view<char>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
587 | for (int i = 0; i < w.size(); ++i) {
| ~~^~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc:598:17: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::basic_string_view<char>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
598 | if (i == w.size() - 1) {
| ~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc: In lambda function:
/builder/src/sentencepiece/src/sentencepiece_processor.cc:870:27: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
870 | for (int j = 0; j < consumed; j++) {
| ~~^~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_processor.cc:874:17: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
874 | if (j == consumed - 1) {
| ~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/util.cc: In function ‘double sentencepiece::log_domain::LogSum(const std::vector<double>&)’:
/builder/src/sentencepiece/src/util.cc:309:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<double>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
309 | for (int i = 1; i < xs.size(); ++i) {
| ~~^~~~~~~~~~~
[ 42%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/word_model.cc.o
[ 43%] Linking CXX static library libsentencepiece_train.a
[ 43%] Built target sentencepiece_train-static
[ 44%] Building CXX object src/CMakeFiles/sentencepiece.dir/util.cc.o
/builder/src/sentencepiece/src/util.cc: In function ‘double sentencepiece::log_domain::LogSum(const std::vector<double>&)’:
/builder/src/sentencepiece/src/util.cc:309:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<double>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
309 | for (int i = 1; i < xs.size(); ++i) {
| ~~^~~~~~~~~~~
[ 45%] Building CXX object src/CMakeFiles/sentencepiece.dir/word_model.cc.o
/builder/src/sentencepiece/src/unigram_model.cc: In member function ‘std::vector<std::pair<std::vector<sentencepiece::unigram::Lattice::Node*>, float> > sentencepiece::unigram::Lattice::NBest(size_t, bool, float)’:
/builder/src/sentencepiece/src/unigram_model.cc:431:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<sentencepiece::unigram::Lattice::Node*>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
431 | for (int i = 0; i < end_nodes(node->pos).size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:442:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<double>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
442 | for (int i = 0; i < adjusted_probs.size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:453:23: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<sentencepiece::unigram::Lattice::Node*>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
453 | for (int i = 0; i < end_nodes(node->pos).size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc: In member function ‘virtual sentencepiece::NBestEncodeResult sentencepiece::unigram::Model::SampleEncodeAndScore(std::string_view, float, int, bool, bool) const’:
/builder/src/sentencepiece/src/unigram_model.cc:778:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<std::pair<std::vector<sentencepiece::unigram::Lattice::Node*>, float> >::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
778 | for (int i = 0; i < nbest_samples.size(); i++) {
| ~~^~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:788:25: warning: comparison of integer expressions of different signedness: ‘const int’ and ‘std::vector<std::pair<std::vector<sentencepiece::unigram::Lattice::Node*>, float> >::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
788 | if (index_of_best != nbest_samples.size()) {
| ~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:829:27: warning: comparison of integer expressions of different signedness: ‘std::vector<std::pair<std::vector<std::pair<std::basic_string_view<char>, int> >, float> >::size_type’ {aka ‘long unsigned int’} and ‘int’ [-Wsign-compare]
829 | while (results.size() < samples) {
| ~~~~~~~~~~~~~~~^~~~~~~~~
/builder/src/sentencepiece/src/unigram_model.cc: In member function ‘sentencepiece::EncodeResult sentencepiece::unigram::Model::EncodeOptimized(std::string_view) const’:
/builder/src/sentencepiece/src/unigram_model.cc:969:20: warning: comparison of integer expressions of different signedness: ‘std::size_t’ {aka ‘long unsigned int’} and ‘const int’ [-Wsign-compare]
969 | while (key_pos < size) {
| ~~~~~~~~^~~~~~
/builder/src/sentencepiece/src/unigram_model.cc:990:40: warning: comparison of integer expressions of different signedness: ‘const long unsigned int’ and ‘const int’ [-Wsign-compare]
990 | if (!has_single_node && length == mblen) {
| ~~~~~~~^~~~~~~~
[ 46%] Linking CXX static library libsentencepiece.a
[ 46%] Built target sentencepiece-static
[ 47%] Linking CXX shared library libsentencepiece.so
[ 47%] Built target sentencepiece
[ 51%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/builder.cc.o
[ 51%] Building CXX object src/CMakeFiles/spm_encode.dir/spm_encode_main.cc.o
[ 51%] Building CXX object src/CMakeFiles/spm_decode.dir/spm_decode_main.cc.o
[ 52%] Building CXX object src/CMakeFiles/spm_export_vocab.dir/spm_export_vocab_main.cc.o
[ 53%] Linking CXX executable spm_export_vocab
[ 54%] Linking CXX executable spm_decode
[ 54%] Built target spm_export_vocab
[ 55%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/unicode_script.cc.o
[ 56%] Linking CXX executable spm_encode
[ 56%] Built target spm_decode
[ 57%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/trainer_factory.cc.o
[ 58%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/trainer_interface.cc.o
[ 58%] Built target spm_encode
[ 59%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/unigram_model_trainer.cc.o
[ 60%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/word_model_trainer.cc.o
/builder/src/sentencepiece/src/trainer_interface.cc: In member function ‘sentencepiece::util::Status sentencepiece::TrainerInterface::LoadSentences()’:
/builder/src/sentencepiece/src/trainer_interface.cc:484:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘const long unsigned int’ [-Wsign-compare]
484 | for (int n = 0; n < num_workers; ++n) {
| ~~^~~~~~~~~~~~~
[ 61%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/char_model_trainer.cc.o
/builder/src/sentencepiece/src/trainer_interface.cc: In instantiation of ‘void sentencepiece::AddDPNoise(const TrainerSpec&, std::mt19937*, T*) [with T = long int; std::mt19937 = std::mersenne_twister_engine<long unsigned int, 32, 624, 397, 31, 2567483615, 11, 4294967295, 7, 2636928640, 15, 4022730752, 18, 1812433253>]’:
/builder/src/sentencepiece/src/trainer_interface.cc:489:32: required from here
489 | AddDPNoise<int64_t>(trainer_spec_, generator,
| ~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~
490 | &(sentences_[i].second));
| ~~~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/trainer_interface.cc:320:18: warning: comparison of integer expressions of different signedness: ‘long int’ and ‘uint64_t’ {aka ‘long unsigned int’} [-Wsign-compare]
320 | if (*to_update < trainer_spec.differential_privacy_clipping_threshold()) {
| ~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model_trainer.cc: In instantiation of ‘sentencepiece::unigram::TrainerModel::SentencePieces sentencepiece::unigram::Trainer::MakeSeedSentencePiecesInternal() [with node_int_type = long int; sentencepiece::unigram::TrainerModel::SentencePieces = std::vector<std::pair<std::__cxx11::basic_string<char>, float> >]’:
/builder/src/sentencepiece/src/unigram_model_trainer.cc:141:55: required from here
141 | ? MakeSeedSentencePiecesInternal<int64_t>()
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~
/builder/src/sentencepiece/src/unigram_model_trainer.cc:276:30: warning: comparison of integer expressions of different signedness: ‘const long int’ and ‘std::vector<unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
276 | if (len <= 1 || offset >= array.size() || offset + len >= array.size()) {
| ~~~~~~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model_trainer.cc:276:62: warning: comparison of integer expressions of different signedness: ‘long int’ and ‘std::vector<unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
276 | if (len <= 1 || offset >= array.size() || offset + len >= array.size()) {
| ~~~~~~~~~~~~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model_trainer.cc: In instantiation of ‘sentencepiece::unigram::TrainerModel::SentencePieces sentencepiece::unigram::Trainer::MakeSeedSentencePiecesInternal() [with node_int_type = int; sentencepiece::unigram::TrainerModel::SentencePieces = std::vector<std::pair<std::__cxx11::basic_string<char>, float> >]’:
/builder/src/sentencepiece/src/unigram_model_trainer.cc:142:55: required from here
142 | : MakeSeedSentencePiecesInternal<int32_t>();
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~
/builder/src/sentencepiece/src/unigram_model_trainer.cc:276:30: warning: comparison of integer expressions of different signedness: ‘const int’ and ‘std::vector<unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
276 | if (len <= 1 || offset >= array.size() || offset + len >= array.size()) {
| ~~~~~~~^~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/unigram_model_trainer.cc:276:62: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
276 | if (len <= 1 || offset >= array.size() || offset + len >= array.size()) {
| ~~~~~~~~~~~~~^~~~~~~~~~~~~~~
[ 62%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/bpe_model_trainer.cc.o
[ 63%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/sentencepiece_trainer.cc.o
[ 64%] Building CXX object src/CMakeFiles/sentencepiece_train.dir/pretokenizer_for_training.cc.o
/builder/src/sentencepiece/src/pretokenizer_for_training.cc: In static member function ‘static std::vector<std::__cxx11::basic_string<char> > sentencepiece::pretokenizer::PretokenizerForTrainingInterface::Postprocess(const sentencepiece::SentencePieceText&)’:
/builder/src/sentencepiece/src/pretokenizer_for_training.cc:51:14: warning: comparison of integer expressions of different signedness: ‘int’ and ‘uint32_t’ {aka ‘unsigned int’} [-Wsign-compare]
51 | if (prev == piece.begin() && piece.begin() != 0) {
| ~~~~~^~~~~~~~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_trainer.cc: In lambda function:
/builder/src/sentencepiece/src/sentencepiece_trainer.cc:378:28: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
378 | for (int i = prev; i < prev + mblen; ++i) {
| ~~^~~~~~~~~~~~~~
/builder/src/sentencepiece/src/sentencepiece_trainer.cc: In function ‘void sentencepiece::ConvertToUnicodeAlignment(std::string_view, std::string_view, std::vector<long unsigned int>*)’:
/builder/src/sentencepiece/src/sentencepiece_trainer.cc:394:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<long unsigned int>::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
394 | for (int i = 0; i < norm_to_orig->size(); ++i) {
| ~~^~~~~~~~~~~~~~~~~~~~~~
[ 65%] Linking CXX shared library libsentencepiece_train.so
[ 68%] Built target sentencepiece_train
[ 69%] Building CXX object src/CMakeFiles/spm_normalize.dir/spm_normalize_main.cc.o
[ 70%] Building CXX object src/CMakeFiles/spm_train.dir/spm_train_main.cc.o
[ 72%] Building CXX object src/CMakeFiles/spm_test.dir/bpe_model_test.cc.o
[ 72%] Building CXX object src/CMakeFiles/spm_test.dir/test_main.cc.o
/builder/src/sentencepiece/src/spm_normalize_main.cc: In function ‘int main(int, char**)’:
/builder/src/sentencepiece/src/spm_normalize_main.cc:64:16: warning: unused variable ‘model_proto’ [-Wunused-variable]
64 | ModelProto model_proto;
| ^~~~~~~~~~~
[ 73%] Building CXX object src/CMakeFiles/spm_test.dir/bpe_model_trainer_test.cc.o
[ 74%] Linking CXX executable spm_normalize
[ 74%] Built target spm_normalize
[ 75%] Building CXX object src/CMakeFiles/spm_test.dir/builder_test.cc.o
[ 76%] Building CXX object src/CMakeFiles/spm_test.dir/char_model_test.cc.o
[ 77%] Linking CXX executable spm_train
[ 77%] Built target spm_train
[ 78%] Building CXX object src/CMakeFiles/spm_test.dir/char_model_trainer_test.cc.o
[ 79%] Building CXX object src/CMakeFiles/spm_test.dir/filesystem_test.cc.o
[ 80%] Building CXX object src/CMakeFiles/spm_test.dir/init_test.cc.o
[ 81%] Building CXX object src/CMakeFiles/spm_test.dir/model_factory_test.cc.o
[ 82%] Building CXX object src/CMakeFiles/spm_test.dir/model_interface_test.cc.o
[ 84%] Building CXX object src/CMakeFiles/spm_test.dir/normalizer_test.cc.o
[ 85%] Building CXX object src/CMakeFiles/spm_test.dir/sentencepiece_processor_test.cc.o
[ 86%] Building CXX object src/CMakeFiles/spm_test.dir/sentencepiece_trainer_test.cc.o
[ 87%] Building CXX object src/CMakeFiles/spm_test.dir/testharness.cc.o
[ 88%] Building CXX object src/CMakeFiles/spm_test.dir/trainer_factory_test.cc.o
[ 89%] Building CXX object src/CMakeFiles/spm_test.dir/trainer_interface_test.cc.o
[ 90%] Building CXX object src/CMakeFiles/spm_test.dir/unicode_script_test.cc.o
[ 91%] Building CXX object src/CMakeFiles/spm_test.dir/unigram_model_test.cc.o
[ 92%] Building CXX object src/CMakeFiles/spm_test.dir/unigram_model_trainer_test.cc.o
[ 93%] Building CXX object src/CMakeFiles/spm_test.dir/util_test.cc.o
[ 94%] Building CXX object src/CMakeFiles/spm_test.dir/word_model_test.cc.o
[ 95%] Building CXX object src/CMakeFiles/spm_test.dir/word_model_trainer_test.cc.o
[ 96%] Building CXX object src/CMakeFiles/spm_test.dir/pretokenizer_for_training_test.cc.o
[ 97%] Linking CXX executable spm_test
[100%] Built target spm_test
-- Install configuration: ""
-- Installing: build/root/lib/pkgconfig/sentencepiece.pc
-- Installing: build/root/lib/libsentencepiece.so.0.0.0
-- Installing: build/root/lib/libsentencepiece.so.0
-- Installing: build/root/lib/libsentencepiece.so
-- Installing: build/root/lib/libsentencepiece_train.so.0.0.0
-- Installing: build/root/lib/libsentencepiece_train.so.0
-- Set non-toolchain portion of runtime path of "build/root/lib/libsentencepiece_train.so.0.0.0" to ""
-- Installing: build/root/lib/libsentencepiece_train.so
-- Installing: build/root/lib/libsentencepiece.a
-- Installing: build/root/lib/libsentencepiece_train.a
-- Installing: build/root/bin/spm_encode
-- Set non-toolchain portion of runtime path of "build/root/bin/spm_encode" to ""
-- Installing: build/root/bin/spm_decode
-- Set non-toolchain portion of runtime path of "build/root/bin/spm_decode" to ""
-- Installing: build/root/bin/spm_normalize
-- Set non-toolchain portion of runtime path of "build/root/bin/spm_normalize" to ""
-- Installing: build/root/bin/spm_train
-- Set non-toolchain portion of runtime path of "build/root/bin/spm_train" to ""
-- Installing: build/root/bin/spm_export_vocab
-- Set non-toolchain portion of runtime path of "build/root/bin/spm_export_vocab" to ""
-- Installing: build/root/include/sentencepiece_trainer.h
-- Installing: build/root/include/sentencepiece_processor.h
-- Installing: build/root/include/sentencepiece.pb.h
* Getting build dependencies for wheel...
running egg_info
creating src/sentencepiece.egg-info
writing src/sentencepiece.egg-info/PKG-INFO
writing dependency_links to src/sentencepiece.egg-info/dependency_links.txt
writing requirements to src/sentencepiece.egg-info/requires.txt
writing top-level names to src/sentencepiece.egg-info/top_level.txt
writing manifest file 'src/sentencepiece.egg-info/SOURCES.txt'
reading manifest file 'src/sentencepiece.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching '*' under directory 'sentencepiece'
writing manifest file 'src/sentencepiece.egg-info/SOURCES.txt'
* Building wheel...
running bdist_wheel
running build
running build_py
creating build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/__init__.py -> build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/_version.py -> build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/sentencepiece_model_pb2.py -> build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/sentencepiece_pb2.py -> build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/sentencepiece_model_pb2.py -> build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/sentencepiece_pb2.py -> build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/_version.py -> build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/__init__.py -> build/lib.linux-x86_64-cpython-314/sentencepiece
running egg_info
writing src/sentencepiece.egg-info/PKG-INFO
writing dependency_links to src/sentencepiece.egg-info/dependency_links.txt
writing requirements to src/sentencepiece.egg-info/requires.txt
writing top-level names to src/sentencepiece.egg-info/top_level.txt
reading manifest file 'src/sentencepiece.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching '*' under directory 'sentencepiece'
writing manifest file 'src/sentencepiece.egg-info/SOURCES.txt'
copying src/sentencepiece/sentencepiece.i -> build/lib.linux-x86_64-cpython-314/sentencepiece
copying src/sentencepiece/sentencepiece_wrap.cxx -> build/lib.linux-x86_64-cpython-314/sentencepiece
running build_ext
## cflags=-std=c++17 -I../build/root/include -Wl,-strip-all
## libs=../build/root/lib/libsentencepiece.so ../build/root/lib/libsentencepiece_train.so -Wl,-strip-all -Wl,-Bsymbolic
building 'sentencepiece._sentencepiece' extension
creating build/temp.linux-x86_64-cpython-314/src/sentencepiece
g++ -march=x86-64 -mtune=generic -O2 -pipe -fno-plt -fexceptions -Wp,-D_FORTIFY_SOURCE=2 -Wformat -Werror=format-security -fstack-clash-protection -fcf-protection -Wp,-D_GLIBCXX_ASSERTIONS -flto=auto -fPIC -I/usr/include/python3.14 -c src/sentencepiece/sentencepiece_wrap.cxx -o build/temp.linux-x86_64-cpython-314/src/sentencepiece/sentencepiece_wrap.o -std=c++17 -I../build/root/include -Wl,-strip-all
g++ -march=x86-64 -mtune=generic -O2 -pipe -fno-plt -fexceptions -Wp,-D_FORTIFY_SOURCE=2 -Wformat -Werror=format-security -fstack-clash-protection -fcf-protection -Wp,-D_GLIBCXX_ASSERTIONS -flto=auto -shared -Wl,-O1 -Wl,--sort-common -Wl,--as-needed -Wl,-z,relro -Wl,-z,now -Wl,-z,pack-relative-relocs -flto=auto -Wl,-O1 -Wl,--sort-common -Wl,--as-needed -Wl,-z,relro -Wl,-z,now -Wl,-z,pack-relative-relocs -flto=auto -Wl,-O1,--sort-common,--as-needed,-z,relro,-z,now -flto=auto -march=x86-64 -mtune=generic -O2 -pipe -fno-plt -fexceptions -Wp,-D_FORTIFY_SOURCE=2 -Wformat -Werror=format-security -fstack-clash-protection -fcf-protection -Wp,-D_GLIBCXX_ASSERTIONS -flto=auto build/temp.linux-x86_64-cpython-314/src/sentencepiece/sentencepiece_wrap.o -L/usr/lib -o build/lib.linux-x86_64-cpython-314/sentencepiece/_sentencepiece.cpython-314-x86_64-linux-gnu.so ../build/root/lib/libsentencepiece.so ../build/root/lib/libsentencepiece_train.so -Wl,-strip-all -Wl,-Bsymbolic
installing to build/bdist.linux-x86_64/wheel
running install
running install_lib
creating build/bdist.linux-x86_64/wheel
creating build/bdist.linux-x86_64/wheel/sentencepiece
copying build/lib.linux-x86_64-cpython-314/sentencepiece/sentencepiece_model_pb2.py -> build/bdist.linux-x86_64/wheel/./sentencepiece
copying build/lib.linux-x86_64-cpython-314/sentencepiece/sentencepiece_pb2.py -> build/bdist.linux-x86_64/wheel/./sentencepiece
copying build/lib.linux-x86_64-cpython-314/sentencepiece/_version.py -> build/bdist.linux-x86_64/wheel/./sentencepiece
copying build/lib.linux-x86_64-cpython-314/sentencepiece/__init__.py -> build/bdist.linux-x86_64/wheel/./sentencepiece
copying build/lib.linux-x86_64-cpython-314/sentencepiece/sentencepiece.i -> build/bdist.linux-x86_64/wheel/./sentencepiece
copying build/lib.linux-x86_64-cpython-314/sentencepiece/sentencepiece_wrap.cxx -> build/bdist.linux-x86_64/wheel/./sentencepiece
copying build/lib.linux-x86_64-cpython-314/sentencepiece/_sentencepiece.cpython-314-x86_64-linux-gnu.so -> build/bdist.linux-x86_64/wheel/./sentencepiece
running install_egg_info
Copying src/sentencepiece.egg-info to build/bdist.linux-x86_64/wheel/./sentencepiece-0.2.1-py3.14.egg-info
running install_scripts
creating build/bdist.linux-x86_64/wheel/sentencepiece-0.2.1.dist-info/WHEEL
creating '/builder/src/sentencepiece/python/dist/.tmp-lhwxfwhu/sentencepiece-0.2.1-cp314-cp314-linux_x86_64.whl' and adding 'build/bdist.linux-x86_64/wheel' to it
adding 'sentencepiece/__init__.py'
adding 'sentencepiece/_sentencepiece.cpython-314-x86_64-linux-gnu.so'
adding 'sentencepiece/_version.py'
adding 'sentencepiece/sentencepiece.i'
adding 'sentencepiece/sentencepiece_model_pb2.py'
adding 'sentencepiece/sentencepiece_pb2.py'
adding 'sentencepiece/sentencepiece_wrap.cxx'
adding 'sentencepiece-0.2.1.dist-info/METADATA'
adding 'sentencepiece-0.2.1.dist-info/WHEEL'
adding 'sentencepiece-0.2.1.dist-info/top_level.txt'
adding 'sentencepiece-0.2.1.dist-info/RECORD'
removing build/bdist.linux-x86_64/wheel
Successfully built sentencepiece-0.2.1-cp314-cp314-linux_x86_64.whl
==> Starting check()...
Test project /builder/src/sentencepiece/build
Start 1: sentencepiece_test
1/1 Test #1: sentencepiece_test ............... Passed 7.80 sec
100% tests passed, 0 tests failed out of 1
Total Test time (real) = 7.81 sec
============================= test session starts ==============================
platform linux -- Python 3.14.5, pytest-9.0.3, pluggy-1.6.0
rootdir: /builder/src/sentencepiece/python
configfile: pyproject.toml
collected 23 items
test/sentencepiece_test.py ....................... [100%]
=============================== warnings summary ===============================
<frozen importlib._bootstrap>:491
<frozen importlib._bootstrap>:491: DeprecationWarning: builtin type SwigPyPacked has no __module__ attribute
<frozen importlib._bootstrap>:491
<frozen importlib._bootstrap>:491: DeprecationWarning: builtin type SwigPyObject has no __module__ attribute
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
======================== 23 passed, 2 warnings in 3.67s ========================
<sys>:0: DeprecationWarning: builtin type swigvarlink has no __module__ attribute
==> Entering fakeroot environment...
==> Starting package_sentencepiece()...
-- Install configuration: ""
-- Installing: /builder/pkg/sentencepiece/usr/lib/pkgconfig/sentencepiece.pc
-- Installing: /builder/pkg/sentencepiece/usr/lib/libsentencepiece.so.0.0.0
-- Installing: /builder/pkg/sentencepiece/usr/lib/libsentencepiece.so.0
-- Installing: /builder/pkg/sentencepiece/usr/lib/libsentencepiece.so
-- Installing: /builder/pkg/sentencepiece/usr/lib/libsentencepiece_train.so.0.0.0
-- Installing: /builder/pkg/sentencepiece/usr/lib/libsentencepiece_train.so.0
-- Set non-toolchain portion of runtime path of "/builder/pkg/sentencepiece/usr/lib/libsentencepiece_train.so.0.0.0" to ""
-- Installing: /builder/pkg/sentencepiece/usr/lib/libsentencepiece_train.so
-- Installing: /builder/pkg/sentencepiece/usr/lib/libsentencepiece.a
-- Installing: /builder/pkg/sentencepiece/usr/lib/libsentencepiece_train.a
-- Installing: /builder/pkg/sentencepiece/usr/bin/spm_encode
-- Set non-toolchain portion of runtime path of "/builder/pkg/sentencepiece/usr/bin/spm_encode" to ""
-- Installing: /builder/pkg/sentencepiece/usr/bin/spm_decode
-- Set non-toolchain portion of runtime path of "/builder/pkg/sentencepiece/usr/bin/spm_decode" to ""
-- Installing: /builder/pkg/sentencepiece/usr/bin/spm_normalize
-- Set non-toolchain portion of runtime path of "/builder/pkg/sentencepiece/usr/bin/spm_normalize" to ""
-- Installing: /builder/pkg/sentencepiece/usr/bin/spm_train
-- Set non-toolchain portion of runtime path of "/builder/pkg/sentencepiece/usr/bin/spm_train" to ""
-- Installing: /builder/pkg/sentencepiece/usr/bin/spm_export_vocab
-- Set non-toolchain portion of runtime path of "/builder/pkg/sentencepiece/usr/bin/spm_export_vocab" to ""
-- Installing: /builder/pkg/sentencepiece/usr/include/sentencepiece_trainer.h
-- Installing: /builder/pkg/sentencepiece/usr/include/sentencepiece_processor.h
-- Installing: /builder/pkg/sentencepiece/usr/include/sentencepiece.pb.h
==> Tidying install...
-> Removing libtool files...
-> Removing static library files...
libfakeroot internal error: payload not recognized!
-> Purging unwanted files...
-> Stripping unneeded symbols from binaries and libraries...
-> Compressing man and info pages...
==> Checking for packaging issues...
==> Creating package "sentencepiece"...
-> Generating .PKGINFO file...
-> Generating .BUILDINFO file...
-> Generating .MTREE file...
-> Compressing package...
==> Starting package_python-sentencepiece()...
==> Tidying install...
-> Removing libtool files...
-> Removing static library files...
-> Purging unwanted files...
-> Stripping unneeded symbols from binaries and libraries...
-> Compressing man and info pages...
==> Checking for packaging issues...
==> Creating package "python-sentencepiece"...
-> Generating .PKGINFO file...
-> Generating .BUILDINFO file...
-> Generating .MTREE file...
-> Compressing package...
==> Leaving fakeroot environment.
==> Finished making: sentencepiece 0.2.1-2 (Tue Jun 2 07:06:35 2026)