Executed few queries/transformations in pyspark. Few of the the queries/transformations should involve map and reduce phases. However I am not able to find any of my execution details in SPARK UI history server. Using the link below for SPARK UI history server http://rm01.itversity.com:18080/?page=1&showIncomplete=false Please guide me if I am missing anything. Thank You.