“Document classification test”版本间的差异

来自cslt Wiki
跳转至: 导航搜索
Word2vec Test
Lr讨论 | 贡献
Document classification of Sougou data
 
(相同用户的14个中间修订版本未显示)
第2行: 第2行:
 
*[[How to import the sparse data of vsm to weka]]
 
*[[How to import the sparse data of vsm to weka]]
  
==Document classification of Sougou data ==
+
==Test==
* DATA
+
[[Sougou data]]
:* Data from SougouLab [http://www.sogou.com/labs/dl/c.html],using SogouC.reduced(30M)
+
:* 9-Classes:财经,IT,健康,体育,旅游,教育,招聘,文化,军事
+
:* train and test: train(),test(),dev()
+
*Text preprocessing
+
:* Segment word using wordlist of 9W.(tencent)
+
:* Remove stop word.stop_wordlist is
+
:*
+
*Some Tools
+
:* weka
+
:* scw
+
:* google word2ve
+
:* LDA
+
*class map
+
C000007 汽车
+
C000008 财经
+
C000010 IT
+
C000013 健康
+
C000014 体育
+
C000016 旅游
+
C000020 教育
+
C000022 招聘
+
C000023 文化
+
C000024 军事
+
===VSM Test===
+
*Data
+
:* dimension:9402
+
*Method
+
:* document reprenstion: use the tf-idf weight for word weight
+
:* classifier: Native Bayes
+
*Result
+
 
+
{| border="2px"
+
|+ classification result
+
|-
+
!  !! 财经!! IT!! 健康!! 体育!! 旅游 !!教育 !! 招聘!! 文化!!军事!!sum
+
|-
+
! ACC-test
+
|  0.72139 || 0.72139 || 0.75124 || 0.82089 || 0.79602 || 0.61194 || 0.70647 || 0.64179|| 0.79104 || 0.72913
+
|-
+
! ACC-train
+
| 0.678 || 0.718 || 0.708 || 0.708 || 0.73
+
|-
+
|}
+
 
+
===LDA Test===
+
===Word2vec Test===
+
*Word2vec result
+

2014年9月28日 (日) 11:33的最后版本

Problem And Solve

Test

Sougou data