Spark console is not working

[Harinath]

Hi Team,

I am very happy to use Synfusion BigData Platoform for learning purpose. When i am working with components like hive,hdfs it's good to go.

While doing spark operations in  scala,the application is very slow and hangs. Please let me know how to overcome this problem?

[Dinesh Kumar P]

Hi Harinath, 

  

Thanks for using Syncfusion products. 

  

Regarding your query "While doing spark operations in  scala,the application is very slow and hangs", can you confirm whether your operating system is Windows 10? If yes, please try the following and let us know that issue gets resolved at your end. 

  

Letters slowly getting typed scenario in Spark-Scala console occurs only in Windows 10 operating system. On checking the same, we would suggest to upgrade “jline” jar to latest version(2.14.6) in your Spark package. 

  

Steps:  

  

Step 1: Download the 2.14.6 version of jline jar from the location - https://mvnrepository.com/artifact/jline/jline/2.14.6   

  

Step 2: Stop all the services via 'Local Service Manager'  

                                  

 

   

Step 3: Replace the downloaded jar “jline-2.14.6” instead of already existing “jline-2.12.1” in Spark Jars folder(..\Syncfusion\BigData\3.2.0.20\BigDataSDK\SDK\Spark\jars\jline-2.12.1).  

  

Step 4: Now start the services and make use of scala/pyspark. (Refer below screenshot)  

                                 

 

  

   

Please let us know, if you have any other concerns.  

  

Thanks,  

Dinesh Kumar P