Spark running issue


#1

Dear itversity-team,

I have a problem while running Spark at itversity-labs. I launch Spark and it works well for simple commands, but once I write something more complex using reduceByKey or sorting, I can see only the ellipsis and never get results back. What’s the problem and how it can be fixed. Thank you in advance!


#2

Please send the command that you are using and getting stuck.

And, Please paste the screenshot for better resolution.


#3

Hi, here is one example
data5 = data4.flatMap(lambda p: sorted(p[1], key=lambda k: float(k.split(“,”)[4]), reverse=True[:3])


#4

Hi @Alexander There is one close bracket is missing in your query.