“Document classification test”版本间的差异

来自cslt Wiki
跳转至： 导航、 搜索
（→‎Word2vec Test）
Lr（讨论 | 贡献）
（→‎Word2vec Test）
第174行： 第174行：
 
|-
 
|-
 
!10
 
!10
−
|0.641791045 0.701492537 0.671641791 0.711442786 0.651741294 0.606965174 0.71641791 0.736318408 0.885572139 0.702598121
+
|0.641791045|| 0.701492537|| 0.671641791|| 0.711442786|| 0.651741294|| 0.606965174|| 0.71641791|| 0.736318408|| 0.885572139|| 0.702598121
 
|-
 
|-
 
!20
 
!20
−
|0.656716418 0.771144279 0.656716418 0.691542289 0.711442786 0.60199005 0.68159204 0.810945274 0.890547264 0.719181868
+
|0.656716418|| 0.771144279|| 0.656716418|| 0.691542289|| 0.711442786|| 0.60199005|| 0.68159204|| 0.810945274|| 0.890547264|| 0.719181868
 
|-
 
|-
 
!30
 
!30
−
|0.686567164 0.771144279 0.68159204 0.666666667 0.741293532 0.631840796 0.771144279 0.746268657 0.910447761 0.734107242
+
|0.686567164|| 0.771144279|| 0.68159204|| 0.666666667|| 0.741293532|| 0.631840796|| 0.771144279|| 0.746268657|| 0.910447761|| 0.734107242
 
|-
 
|-
 
!40
 
!40
−
|0.68159204 0.791044776 0.686567164 0.671641791 0.726368159 0.63681592 0.76119403 0.781094527 0.885572139 0.735765616
+
|0.68159204|| 0.791044776|| 0.686567164|| 0.671641791|| 0.726368159|| 0.63681592|| 0.76119403|| 0.781094527|| 0.885572139|| 0.735765616
 
|-
 
|-
 
!50
 
!50
−
|0.696517413 0.771144279 0.676616915 0.597014925 0.706467662 0.621890547 0.741293532 0.7960199 0.885572139 0.721393035
+
|0.696517413|| 0.771144279|| 0.676616915|| 0.597014925|| 0.706467662|| 0.621890547|| 0.741293532|| 0.7960199|| 0.885572139|| 0.721393035
 
|-
 
|-
 
!60
 
!60
−
|0.68159204 0.786069652 0.68159204 0.592039801 0.731343284 0.606965174 0.741293532 0.805970149 0.885572139 0.723604201
+
|0.68159204|| 0.786069652|| 0.68159204|| 0.592039801|| 0.731343284|| 0.606965174|| 0.741293532|| 0.805970149|| 0.885572139|| 0.723604201
 
|-
 
|-
 
!70
 
!70
−
|0.686567164 0.781094527 0.686567164 0.592039801 0.746268657 0.611940299 0.741293532 0.805970149 0.900497512 0.728026534
+
|0.686567164|| 0.781094527|| 0.686567164|| 0.592039801|| 0.746268657|| 0.611940299|| 0.741293532|| 0.805970149|| 0.900497512|| 0.728026534
 
|-
 
|-
 
!80
 
!80
−
|0.676616915 0.766169154 0.676616915 0.592039801 0.741293532 0.606965174 0.746268657 0.810945274 0.890547264 0.72305141
+
|0.676616915|| 0.766169154|| 0.676616915|| 0.592039801|| 0.741293532|| 0.606965174|| 0.746268657|| 0.810945274|| 0.890547264|| 0.72305141
 
|-
 
|-
 
!90
 
!90
−
|0.666666667 0.781094527 0.676616915 0.60199005 0.726368159 0.592039801 0.751243781 0.805970149 0.910447761 0.723604201
+
|0.666666667|| 0.781094527|| 0.676616915|| 0.60199005|| 0.726368159|| 0.592039801|| 0.751243781|| 0.805970149|| 0.910447761|| 0.723604201
 
|-
 
|-
 
!100
 
!100
−
|0.651741294 0.776119403 0.68159204 0.60199005 0.736318408 0.616915423 0.756218905 0.815920398 0.895522388 0.725815368
+
|0.651741294|| 0.776119403|| 0.68159204|| 0.60199005|| 0.736318408|| 0.616915423|| 0.756218905|| 0.815920398|| 0.895522388|| 0.725815368
 
|-
 
|-
 
|}
 
|}
 
:* Window
 
:* Window

2014年9月9日 (二) 06:55的版本

Problem And Solve

Document classification of Sougou data

  • DATA
  • Data from SougouLab [1],using SogouC.reduced(30M)
  • 9-Classes:财经,IT,健康,体育,旅游,教育,招聘,文化,军事
  • train and test: train(),test(),dev()
  • Text preprocessing
  • Segment word using wordlist of 9W.(tencent)
  • Remove stop word.stop_wordlist is
  • Some Tools
  • weka
  • scw
  • google word2ve
  • LDA
  • class map

C000007 汽车 C000008 财经 C000010 IT C000013 健康 C000014 体育 C000016 旅游 C000020 教育 C000022 招聘 C000023 文化 C000024 军事

VSM Test

  • Data
  • dimension:9402
  • Method
  • document reprenstion: use the tf-idf weight for word weight
  • classifier: Native Bayes
  • Result
classification result
财经 IT 健康 体育 旅游 教育 招聘 文化 军事 sum
ACC-test 0.72139 0.72139 0.75124 0.82089 0.79602 0.61194 0.70647 0.64179 0.79104 0.72913
ACC-train 0.678 0.718 0.708 0.708 0.73

LDA Test

Word2vec Test

  • Word2vec result
  • Dimension
classification result Of ACC in different dimension
Dimension 财经 IT 健康 体育 旅游 教育 招聘 文化 军事 sum
10 0.766169154 0.383084577 0.52238806 0.820895522 0.666666667 0.44278607 0.567164179 0.721393035 0.850746269 0.637921504
20 0.781094527 0.537313433 0.572139303 0.830845771 0.76119403 0.452736318 0.611940299 0.646766169 0.860696517 0.672747374
30 0.815920398 0.671641791 0.606965174 0.835820896 0.766169154 0.552238806 0.577114428 0.68159204 0.885572139 0.710337203
40 0.7960199 0.68159204 0.631840796 0.805970149 0.756218905 0.572139303 0.577114428 0.701492537 0.905472637 0.714206744
50 0.805970149 0.691542289 0.641791045 0.800995025 0.751243781 0.552238806 0.651741294 0.656716418 0.910447761 0.718076285
60 0.7960199 0.68159204 0.626865672 0.776119403 0.736318408 0.572139303 0.626865672 0.651741294 0.895522388 0.707020453
70 0.7960199 0.701492537 0.621890547 0.781094527 0.771144279 0.572139303 0.631840796 0.656716418 0.905472637 0.715312327
80 0.7960199 0.686567164 0.626865672 0.805970149 0.776119403 0.582089552 0.631840796 0.676616915 0.905472637 0.720840243
90 0.805970149 0.71641791 0.621890547 0.776119403 0.766169154 0.572139303 0.646766169 0.666666667 0.915422886 0.720840243
100 0.776119403 0.706467662 0.631840796 0.751243781 0.786069652 0.577114428 0.646766169 0.666666667 0.910447761 0.716970702
110 0.771144279 0.71641791 0.656716418 0.741293532 0.76119403 0.597014925 0.606965174 0.691542289 0.910447761 0.716970702
120 0.76119403 0.71641791 0.646766169 0.756218905 0.766169154 0.60199005 0.661691542 0.686567164 0.915422886 0.723604201
130 0.776119403 0.731343284 0.631840796 0.76119403 0.771144279 0.577114428 0.626865672 0.701492537 0.905472637 0.720287452
140 0.76119403 0.746268657 0.63681592 0.736318408 0.786069652 0.587064677 0.651741294 0.68159204 0.900497512 0.720840243
150 0.756218905 0.726368159 0.63681592 0.736318408 0.771144279 0.611940299 0.651741294 0.686567164 0.910447761 0.720840243
160 0.751243781 0.71641791 0.646766169 0.731343284 0.776119403 0.597014925 0.651741294 0.696517413 0.895522388 0.718076285
170 0.756218905 0.741293532 0.661691542 0.731343284 0.766169154 0.60199005 0.651741294 0.666666667 0.900497512 0.71973466
180 0.781094527 0.731343284 0.651741294 0.736318408 0.781094527 0.606965174 0.631840796 0.676616915 0.895522388 0.721393035
190 0.771144279 0.726368159 0.661691542 0.731343284 0.766169154 0.60199005 0.631840796 0.706467662 0.900497512 0.721945826
200 0.771144279 0.736318408 0.641791045 0.706467662 0.771144279 0.606965174 0.611940299 0.71641791 0.900497512 0.718076285
  • Window
classification result Of ACC in different dimension
Dimension 财经 IT 健康 体育 旅游 教育 招聘 文化 军事 sum
3 0.805970149 0.666666667 0.621890547 0.766169154 0.76119403 0.542288557 0.646766169 0.641791045 0.900497512 0.70591487
4 0.756218905 0.686567164 0.646766169 0.776119403 0.776119403 0.567164179 0.631840796 0.651741294 0.905472637 0.710889994
5 0.791044776 0.711442786 0.641791045 0.800995025 0.76119403 0.567164179 0.68159204 0.641791045 0.895522388 0.721393035
6 0.820895522 0.68159204 0.626865672 0.771144279 0.76119403 0.537313433 0.656716418 0.656716418 0.900497512 0.712548369
7 0.7960199 0.656716418 0.656716418 0.800995025 0.756218905 0.562189055 0.661691542 0.621890547 0.900497512 0.712548369
8 0.786069652 0.68159204 0.631840796 0.7960199 0.766169154 0.552238806 0.592039801 0.696517413 0.910447761 0.712548369
9 0.786069652 0.666666667 0.606965174 0.860696517 0.771144279 0.532338308 0.582089552 0.686567164 0.900497512 0.710337203
10 0.805970149 0.671641791 0.616915423 0.835820896 0.771144279 0.606965174 0.651741294 0.666666667 0.910447761 0.726368159
11 0.800995025 0.696517413 0.631840796 0.771144279 0.751243781 0.587064677 0.597014925 0.671641791 0.885572139 0.710337203
12 0.7960199 0.671641791 0.626865672 0.7960199 0.76119403 0.542288557 0.606965174 0.706467662 0.900497512 0.711995578
13 0.791044776 0.661691542 0.641791045 0.830845771 0.766169154 0.592039801 0.552238806 0.71641791 0.905472637 0.717523494
14 0.781094527 0.701492537 0.676616915 0.791044776 0.741293532 0.587064677 0.671641791 0.621890547 0.900497512 0.719181868
15 0.810945274 0.696517413 0.63681592 0.815920398 0.771144279 0.55721393 0.55721393 0.711442786 0.905472637 0.718076285
  • train-word2vec result
  • Dimension
classification result Of ACC in different dimension
Dimension 财经 IT 健康 体育 旅游 教育 招聘 文化 军事 sum
10 0.641791045 0.701492537 0.671641791 0.711442786 0.651741294 0.606965174 0.71641791 0.736318408 0.885572139 0.702598121
20 0.656716418 0.771144279 0.656716418 0.691542289 0.711442786 0.60199005 0.68159204 0.810945274 0.890547264 0.719181868
30 0.686567164 0.771144279 0.68159204 0.666666667 0.741293532 0.631840796 0.771144279 0.746268657 0.910447761 0.734107242
40 0.68159204 0.791044776 0.686567164 0.671641791 0.726368159 0.63681592 0.76119403 0.781094527 0.885572139 0.735765616
50 0.696517413 0.771144279 0.676616915 0.597014925 0.706467662 0.621890547 0.741293532 0.7960199 0.885572139 0.721393035
60 0.68159204 0.786069652 0.68159204 0.592039801 0.731343284 0.606965174 0.741293532 0.805970149 0.885572139 0.723604201
70 0.686567164 0.781094527 0.686567164 0.592039801 0.746268657 0.611940299 0.741293532 0.805970149 0.900497512 0.728026534
80 0.676616915 0.766169154 0.676616915 0.592039801 0.741293532 0.606965174 0.746268657 0.810945274 0.890547264 0.72305141
90 0.666666667 0.781094527 0.676616915 0.60199005 0.726368159 0.592039801 0.751243781 0.805970149 0.910447761 0.723604201
100 0.651741294 0.776119403 0.68159204 0.60199005 0.736318408 0.616915423 0.756218905 0.815920398 0.895522388 0.725815368
  • Window
取自“http://index.cslt.org/mediawiki/index.php?title=Document_classification_test&oldid=11291”