论文标题
通过神经图过滤学习多样的时尚搭配
Learning Diverse Fashion Collocation by Neural Graph Filtering
论文作者
论文摘要
客户高度期望时尚推荐系统找到视觉上的时尚物品,例如衣服,鞋子,袋子等。尽管现有方法表现出令人鼓舞的结果,但它们仍然缺乏灵活性和多样性,例如假设有固定数量的项目或喜欢安全但无聊的建议。在本文中,我们提出了一个新型的时尚搭配框架,即神经图过滤,该框架通过图神经网络建模了一组灵活的时尚项目。具体而言,我们将每件服装的视觉嵌入方式视为图中的节点,并将其相互关系描述为节点之间的边缘。通过在边缘向量上应用对称操作,该框架允许不同的输入/输出数量,并且对其排序不变。我们进一步包括一个风格的分类器,并增加了焦点损失,以实现明显多样化的样式的搭配,这些样式在训练集中固有地不平衡。为了促进有关各种时尚搭配的全面研究,我们通过精心设计的评估协议重新组织了亚马逊时尚数据集。我们评估了三个流行的基准测试,即Polyvore数据集,Polyvore-D数据集和我们重新组织的Amazon Fashion DataSet上提出的方法。广泛的实验结果表明,我们的方法显着超过了最先进的方法,对已建立任务的标准AUC度量提高了10%。更重要的是,在一项现实世界的感知研究中,有82.5%的用户更喜欢我们的多样化的建议,而不是其他替代方案。
Fashion recommendation systems are highly desired by customers to find visually-collocated fashion items, such as clothes, shoes, bags, etc. While existing methods demonstrate promising results, they remain lacking in flexibility and diversity, e.g. assuming a fixed number of items or favoring safe but boring recommendations. In this paper, we propose a novel fashion collocation framework, Neural Graph Filtering, that models a flexible set of fashion items via a graph neural network. Specifically, we consider the visual embeddings of each garment as a node in the graph, and describe the inter-garment relationship as the edge between nodes. By applying symmetric operations on the edge vectors, this framework allows varying numbers of inputs/outputs and is invariant to their ordering. We further include a style classifier augmented with focal loss to enable the collocation of significantly diverse styles, which are inherently imbalanced in the training set. To facilitate a comprehensive study on diverse fashion collocation, we reorganize Amazon Fashion dataset with carefully designed evaluation protocols. We evaluate the proposed approach on three popular benchmarks, the Polyvore dataset, the Polyvore-D dataset, and our reorganized Amazon Fashion dataset. Extensive experimental results show that our approach significantly outperforms the state-of-the-art methods with over 10% improvements on the standard AUC metric on the established tasks. More importantly, 82.5% of the users prefer our diverse-style recommendations over other alternatives in a real-world perception study.