How can I use structured streaming in Lab

#1

Hi,

When I start spark-shell it shows version 1.6.x and I want to use structured streaming with Kafka. How can I do that?

Thanks,
Muhammad

0 Likes

#2

I got this working by issuing following command:

$ export SPARK_MAJOR_VERSION=2
$ spark-shell --packages org.apache.spark:spark-sql-kafka-0-10_2.11:2.3.0

1 Like

closed #3
0 Likes