How to reference file on Blob storage using scala | بلاگ

How to reference file on Blob storage using scala

تعرفه تبلیغات در سایت

آخرین مطالب

امکانات وب

Vote count: 0

I have a piece of scala code that works locally

val test = "resources/test.csv"

val trainInput = spark.read
  .option("header", "true")
  .option("inferSchema", "true")
  .format("com.databricks.spark.csv")
  .load(train)
  .cache

However when i try to run it on azure, spark by submitting the job, and adjusting the following line: val test = "wasb:///tmp/MachineLearningScala/test.csv"

It doesn't work. How do i reference files in blob storage in azure using scala? This should be straight forward.

asked 47 secs ago
ConorS79

...
نویسنده : استخدام کار بازدید : 8 تاريخ : دوشنبه 7 اسفند 1396 ساعت: 20:32