For those on a mac, as of right now you may get an error with pip install sentencepiece. For example, I got
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
Fortunately, there is a fix:
pip install https://github.com/google/sentencepiece/releases/download/v0.1.85/tf_sentencepiece-0.1.85-py2.py3-none-macosx_10_10_x86_64.whl
Note: the install was successful, but I haven’t tested the package (yet).