宋明秋,张瑞雪,吴新涛,李文立.网页正文信息抽取新方法[J].,2009,(4):594-597 |
网页正文信息抽取新方法 |
A new approach to content extraction from web page |
|
DOI:10.7511/dllgxb200904022 |
中文关键词: 包装器 HTML树 网页信息提取 |
英文关键词: wrapper HTML tree web information extraction |
基金项目:国家自然科学基金资助项目70671016 |
|
摘要点击次数: 1092 |
全文下载次数: 1969 |
中文摘要: |
基于包装器的信息抽取方法只能处理一种特定的信息源,而且对网页结构的依赖性强.基于此提出了一种将中文标点符号和HTML树结构作为识别网页正文内容重要特征的网页分析方法,通过统计中文标点符号确定部分正文信息,然后根据正文信息在结构上的相似性确定其他正文信息内容.实验结果表明该方法能有效地剔除网页噪音并提取网页正文,具有较好的通用性和较高的准确性. |
英文摘要: |
The approach to data extraction based on wrapper is limited to one specific information source, and greatly depends on web page structure. A new web page analysis method is proposed, which can recognize web page content according to the number of Chinese punctuations and HTML tree structure. It can eliminate noise and extract content from web page effectively. Parts of contents are confirmed by Chinese punctuations, while other parts are found by the similarity among contents. Experimental results show that this method is accurate and suitable for most web sites. |
查看全文
查看/发表评论 下载PDF阅读器 |
关闭 |
|
|
|