2017-01-24-0403Z


spark-submit isn't ready for prime time yet. I keep getting this verbose error reporting when specifying --packages org.apache.hadoop:hadoop-aws:2.7.1:

:: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
Exception in thread "main" java.lang.RuntimeException: [download failed: asm#asm;3.2!asm.jar]
at org.apache.spark.deploy.SparkSubmitUtils$.resolveMavenCoordinates(SparkSubmit.scala:1078)
at org.apache.spark.deploy.SparkSubmit$.prepareSubmitEnvironment(SparkSubmit.scala:296)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:160)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:126)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

and Googling doesn't give any results intelligible to a non-Hadooper. it's failing a download. so now what? what a load of crap.

Back to blog or home page

last updated 2017-01-23 23:08:45. served from tektonic.jcomeau.com