Whats the way to get rid of the below error :-
2019-12-20 22:09:22 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
Due to the above error, I was not able to open the files using SparkContext.
from pyspark import SparkConf, SparkContext
sc = SparkContext(master=“local”,appName=“Spark”)
I expected that the winutils will provide all the required Hadoop APIs to enable the Spark read the local file system.
Kindly suggest if I am missing something here.