论文标题
领导者：在更快的单词矢量序列化的长度之前
Leader: Prefixing a Length for Faster Word Vector Serialization
论文作者
论文摘要
两种相互竞争的文件格式已成为分发预训练单词嵌入的事实上的标准。两者都是以该格式分布的最受欢迎的预训练嵌入命名。手套格式是一种完全基于文本的格式，它具有巨大的文件大小和缓慢的读取，而word2vec格式是一种较小的二进制格式，将单词的文本表示与向量本身的二进制表示。两种格式都有我们称为领导格式的新格式解决的问题。我们包括一个单词长度的前缀，用于更快读取，同时保持二进制格式提供的较小文件大小。我们还创建了一个简约的库，以促进各种单词向量格式的读写，以及将预训练的嵌入到我们新的领导者格式的工具。
Two competing file formats have become the de facto standards for distributing pre-trained word embeddings. Both are named after the most popular pre-trained embeddings that are distributed in that format. The GloVe format is an entirely text based format that suffers from huge file sizes and slow reads, and the word2vec format is a smaller binary format that mixes a textual representation of words with a binary representation of the vectors themselves. Both formats have problems that we solve with a new format we call the Leader format. We include a word length prefix for faster reads while maintaining the smaller file size a binary format offers. We also created a minimalist library to facilitate the reading and writing of various word vector formats, as well as tools for converting pre-trained embeddings to our new Leader format.
