Current Location:home > Browse

1. chinaXiv:201910.00076 [pdf]

Masked Sentence Model based on BERT for Move Recognition in Medical Scientific Abstracts

Yu, Gaihong; Zhang, Zhixiong; Liu, Huan ; Ding, Liangping
Subjects: Computer Science >> Natural Language Understanding and Machine Translation

Purpose: Move recognition in scientific abstracts is an NLP task of classifying sentences of the abstracts into different types of language unit. To improve the performance of move recognition in scientific abstracts, a novel model of move recognition is proposed that outperforms BERT-Base method. Design: Prevalent models based on BERT for sentence classification often classify sentences without considering the context of the sentences. In this paper, inspired by the BERT's Masked Language Model (MLM), we propose a novel model called Masked Sentence Model that integrates the content and contextual information of the sentences in move recognition. Experiments are conducted on the benchmark dataset PubMed 20K RCT in three steps. And then compare our model with HSLN-RNN, BERT-Base and SciBERT using the same dataset. Findings: Compared with BERT-Base and SciBERT model, the F1 score of our model outperforms them by 4.96% and 4.34% respectively, which shows the feasibility and effectiveness of the novel model and the result of our model comes closest to the state-of-the-art results of HSLN-RNN at present. Research Limitations: The sequential features of move labels are not considered, which might be one of the reasons why HSLN-RNN has better performance. And our model is restricted to dealing with bio-medical English literature because we use dataset from PubMed which is a typical bio-medical database to fine-tune our model. Practical implications: The proposed model is better and simpler in identifying move structure in scientific abstracts, and is worthy for text classification experiments to capture contextual features of sentences. Originality: The study proposes a Masked Sentence Model based on BERT which takes account of the contextual features of the sentences in abstracts in a new way. And the performance of this classification model is significantly improved by rebuilding the input layer without changing the structure of neural networks.

submitted time 2019-10-29 Hits36032Downloads938 Comment 0

2. chinaXiv:201710.00016 [pdf]

Organization and Exploration Fined-grained Historical Knowledge on Contemporary China Based on Semantic Mining

Zhang, Zhixiong; Wang, Ying; Sun, Hui; Lei, Feng
Subjects: Library Science,Information Science >> Library Science

China has a huge volume of historical resources on its contemporary history. Lots of valuable knowledge are hidden in those resources and cannot be utilized easily. It is an urgent problem to mine the implicit semantic knowledge scattered in a large number of historical resources and to reorganize the historical knowledge and facts in a fined-grained manner, so that can help user to explore the historical knowledge for research and education. This paper proposes a method, which is called “Mining down, Organizing up”, to semantically represent and organize historical knowledge on contemporary China hidden in historical encyclopedia text. Based on the proposed historical ontology of contemporary Chinese, this method extracts knowledge objects and facts from the unstructured historical text items by utilizing text mining technologies, represents the historical knowledge in semantically enriched way, and interlinks the related historical knowledge objects and facts to form a historical knowledge network of the contemporary China. By mining the historical facts and the historical knowledge network, the authors get more valuable patterns from the historical knowledge which could be used to form the new organization scheme to reorganize the historical knowledge in a more vivid way. Based on this method, the authors developed a system which can represent and organize historical knowledge of contemporary China in a fined-grained manner, support user to explore historical knowledge by providing functions such as semantic retrieval, historical objects and facts clustering, visualization navigation, association analysis, and chronicle facts reconstruction etc.

submitted time 2017-10-20 Hits16259Downloads591 Comment 0

3. chinaXiv:201602.00008 [pdf]

Profiling science and innovation policy by object-based computing

Zhang Zhixiong; Liu Jianhua; Zou Yimin; Xie Jing; Qian Li
Subjects: Library Science,Information Science >> Library Science

If they find some words closely related to their target task of titles or abstracts, which are definedIf they find some words closely related to their target task of titles or abstracts, which are definedas intelligent sensitive words in this paper, they will decide to read these resources in depth tofind more useful information. These sensitive words may refer to special persons, organisations,programmes, terms and so on. All of these sensitive words and their featured information areincluded in our object. Basing on the above processes, we have determined that some featurescould be used for automatic computation.Downloaded by [National Science Library] at 03:28 19 January 2015 Profiling science and innovation policy by object-based computing 587? Authority of source. If one piece of news is released in an official website, then this resource ismore reliable than other resources from no

submitted time 2016-02-02 Hits5334Downloads1474 Comment 0

  [1 Pages/ 3 Totals]