반응형
Notice
Recent Posts
Recent Comments
Link
안단테 안단테
머하웃 완벽 가이드) - 9장 classdump로 k-means 결과 확인하기 2 본문
728x90
반응형
새로 만든 벡터로 k-means 인풋으로 넣고.... 결과값 확인하려고 classdump 이용했는데...
다음과 같은 오류가 나서...
MAHOUT_LOCAL is not set; adding HADOOP_CONF_DIR to classpath.
Running on hadoop, using /usr/local/hadoop/hadoop-1.1.1/bin/hadoop and HADOOP_CONF_DIR=/usr/local/hadoop/hadoop-1.1.1/conf
MAHOUT-JOB: /usr/local/mahout/mahout-distribution-0.9/mahout-examples-0.9-job.jar
15/03/09 20:15:03 INFO common.AbstractJob: Command line arguments: {--dictionary=[reuters-vectors/dictionary.file-0], --dictionaryType=[sequencefile], --distanceMeasure=[org.apache.mahout.common.distance.SquaredEuclideanDistanceMeasure], --endPhase=[2147483647], --input=[whgudfkr_output/clusters-1], --numWords=[10], --outputFormat=[TEXT], --startPhase=[0], --substring=[10], --tempDir=[temp]}
Exception in thread "main" java.lang.IllegalStateException: java.io.EOFException
at org.apache.mahout.common.iterator.sequencefile.SequenceFileValueIterator.computeNext(SequenceFileValueIterator.java:93)
at org.apache.mahout.common.iterator.sequencefile.SequenceFileValueIterator.computeNext(SequenceFileValueIterator.java:37)
at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
at com.google.common.collect.Iterators$5.hasNext(Iterators.java:542)
at com.google.common.collect.ForwardingIterator.hasNext(ForwardingIterator.java:43)
at org.apache.mahout.utils.clustering.AbstractClusterWriter.write(AbstractClusterWriter.java:114)
at org.apache.mahout.utils.clustering.AbstractClusterWriter.write(AbstractClusterWriter.java:102)
at org.apache.mahout.utils.clustering.ClusterDumper.printClusters(ClusterDumper.java:192)
at org.apache.mahout.utils.clustering.ClusterDumper.run(ClusterDumper.java:157)
at org.apache.mahout.utils.clustering.ClusterDumper.main(ClusterDumper.java:101)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: java.io.EOFException
at java.io.DataInputStream.readFully(DataInputStream.java:197)
at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:63)
at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:101)
at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1992)
at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1892)
at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1938)
at org.apache.mahout.common.iterator.sequencefile.SequenceFileValueIterator.computeNext(SequenceFileValueIterator.java:81)
... 22 more
hadoop/conf/mapred-site.xml 에
<property>
<name>mapreduce.fileoutputcommitter.marksuccessfuljobs</name>
<value>false</value>
</property>
추가해줬는데.... 이것도 안되네...
728x90
반응형
'IT 기술 > BigData' 카테고리의 다른 글
머하웃 완벽 가이드) - mahout seqdirectory 인자값 (0) | 2023.02.02 |
---|---|
머하웃 완벽 가이드) - 9장 LDA 알고리즘 돌리기 (0) | 2023.02.02 |
머하웃 완벽 가이드) - 9장 classdump로 k-means 결과 확인하기 (0) | 2023.02.02 |
머하웃 완벽 가이드) - 7장 분산으로 처리하기 (0) | 2023.02.02 |
머하웃 완벽 가이드) - 8장 벡터 생성기 (0) | 2023.02.02 |
Comments