안단테 안단테

머하웃 완벽 가이드) - 9장 classdump로 k-means 결과 확인하기 2 본문

IT 기술/BigData

머하웃 완벽 가이드) - 9장 classdump로 k-means 결과 확인하기 2

안단테에 2023. 2. 2. 13:24
728x90
반응형

새로 만든 벡터로 k-means 인풋으로 넣고.... 결과값 확인하려고 classdump 이용했는데...

 

다음과 같은 오류가 나서...

 

MAHOUT_LOCAL is not set; adding HADOOP_CONF_DIR to classpath.

Running on hadoop, using /usr/local/hadoop/hadoop-1.1.1/bin/hadoop and HADOOP_CONF_DIR=/usr/local/hadoop/hadoop-1.1.1/conf

MAHOUT-JOB: /usr/local/mahout/mahout-distribution-0.9/mahout-examples-0.9-job.jar

15/03/09 20:15:03 INFO common.AbstractJob: Command line arguments: {--dictionary=[reuters-vectors/dictionary.file-0], --dictionaryType=[sequencefile], --distanceMeasure=[org.apache.mahout.common.distance.SquaredEuclideanDistanceMeasure], --endPhase=[2147483647], --input=[whgudfkr_output/clusters-1], --numWords=[10], --outputFormat=[TEXT], --startPhase=[0], --substring=[10], --tempDir=[temp]}

Exception in thread "main" java.lang.IllegalStateException: java.io.EOFException

     at org.apache.mahout.common.iterator.sequencefile.SequenceFileValueIterator.computeNext(SequenceFileValueIterator.java:93)

     at org.apache.mahout.common.iterator.sequencefile.SequenceFileValueIterator.computeNext(SequenceFileValueIterator.java:37)

     at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)

     at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)

     at com.google.common.collect.Iterators$5.hasNext(Iterators.java:542)

     at com.google.common.collect.ForwardingIterator.hasNext(ForwardingIterator.java:43)

     at org.apache.mahout.utils.clustering.AbstractClusterWriter.write(AbstractClusterWriter.java:114)

     at org.apache.mahout.utils.clustering.AbstractClusterWriter.write(AbstractClusterWriter.java:102)

     at org.apache.mahout.utils.clustering.ClusterDumper.printClusters(ClusterDumper.java:192)

     at org.apache.mahout.utils.clustering.ClusterDumper.run(ClusterDumper.java:157)

     at org.apache.mahout.utils.clustering.ClusterDumper.main(ClusterDumper.java:101)

     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

     at java.lang.reflect.Method.invoke(Method.java:483)

     at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)

     at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)

     at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)

     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

     at java.lang.reflect.Method.invoke(Method.java:483)

     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

Caused by: java.io.EOFException

     at java.io.DataInputStream.readFully(DataInputStream.java:197)

     at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:63)

     at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:101)

     at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1992)

     at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1892)

     at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1938)

     at org.apache.mahout.common.iterator.sequencefile.SequenceFileValueIterator.computeNext(SequenceFileValueIterator.java:81)

     ... 22 more
 

hadoop/conf/mapred-site.xml 에

 

        <property>

                <name>mapreduce.fileoutputcommitter.marksuccessfuljobs</name>

                <value>false</value>

        </property>
 
추가해줬는데.... 이것도 안되네...
728x90
반응형
Comments