What I have found from googling are mostly about loading data from hdfs into dataframe, I wonder what’s the best practice to load data from file system.
For RDD, I know I can do this way:
val productsRaw = scala.io.Source.fromFile("/data/retail_db/products/part-00000")
For DataFrame, how do I write my code?
Thank you very much.