论文标题
带有简短匿名的小说片段的单一盲文味测验的结果
Results of a Single Blind Literary Taste Test with Short Anonymized Novel Fragments
论文作者
论文摘要
这是一个公开的问题，在多大程度上，对文学质量的看法是从文本中的和社会因素中得出的。如文学质量项目（Koolen等，2020）所示，有监督的模型可以非常成功地从文本因素中预测文学质量评级，但这并不能证明社会因素并不重要，我们也不能假设读者以与机器学习模型相同的信息来判断文学质量。我们报告了一项试点研究的结果，以评估参与者在与48位参与者的受控实验中，参与者对参与者的文学评级的影响。在探索性分析中，我们将不排除社会因素的谜语的大读者调查的评分与这些文学评级的机器学习预测进行了比较。我们发现问卷等级与调查等级的中等至强相关性，但预测更接近调查等级。代码和数据：https：//github.com/andreasvc/litquest
It is an open question to what extent perceptions of literary quality are derived from text-intrinsic versus social factors. While supervised models can predict literary quality ratings from textual factors quite successfully, as shown in the Riddle of Literary Quality project (Koolen et al., 2020), this does not prove that social factors are not important, nor can we assume that readers make judgments on literary quality in the same way and based on the same information as machine learning models. We report the results of a pilot study to gauge the effect of textual features on literary ratings of Dutch-language novels by participants in a controlled experiment with 48 participants. In an exploratory analysis, we compare the ratings to those from the large reader survey of the Riddle in which social factors were not excluded, and to machine learning predictions of those literary ratings. We find moderate to strong correlations of questionnaire ratings with the survey ratings, but the predictions are closer to the survey ratings. Code and data: https://github.com/andreasvc/litquest
