本文共 1063 字,大约阅读时间需要 3 分钟。
使用sparkml库的linalg类库等,尽管引入spark mllib依赖,但是发现无法导入相应库,运行后报错:
Error:(2, 25) object ml is not a member of package org.apache.sparkimport org.apache.spark.ml.classification.LogisticRegressionError:(4, 25) object ml is not a member of package org.apache.sparkimport org.apache.spark.ml.feature.VectorAssemblerError:(5, 25) object ml is not a member of package org.apache.sparkimport org.apache.spark.ml.linalgError:(6, 25) object ml is not a member of package org.apache.sparkimport org.apache.spark.ml.regression.LinearRegressionError:(46, 13) not found: value model val s = model.summary.totalIterations
排除了很多原因:
(1)已经导入spark的maven依赖
org.apache.spark spark-mllib_2.11 2.1.0
(2)查看maven依赖,确实有这个jar包,以及对应类库
(3)最后发现竟然因为是没有导入源码,而导致无法引入,坑啊!
1.右键maven的pom依赖
2.导入源码如下图
3.然后就可以导入相应类库了
import org.apache.spark.ml.classification.LogisticRegressionimport org.apache.spark.ml.feature.VectorAssemblerimport org.apache.spark.ml.linalgimport org.apache.spark.ml.regression.LinearRegression
转载地址:http://kgygi.baihongyu.com/