SyncFusion BigData Agent is not installed or running

[Oula Alshiekh]

i have created three virtual machines related to the same network
and installed SyncFusion  Big Data Agent on each one
and SyncFusion Big Data Cluster manager on another machine in the same network
i maked sure that syncfusion big data agent is running on each one
but when i followed manual cluster setup from cluster manager that is installed on a machine in the network  i still get the error
SyncFusion BigData Agent is not installed or running
for each node
what will be the error please

[Baskaran]

Hi Oula, 

  

We regret for the inconvenience caused. 

  

Though the agent service is running on each node, there is a chance to that  

  

·         The agent API may not be hosted properly in the particular port. By default, it runs on the port 60008. 

Make sure whether it is listening using Resource Monitor on each node. 

Type "resmon.exe" in Run window -> Network -> Check the port 60008 in "Listening Ports" section as show in below screenshot. 

  

 

  

  

·         Despite we are adding firewall rule when installing agent to access the port (60008) from outside the machine in the same network, please ensure all agents from cluster manager installed machine whether it is accessible using below URL in browser. Any other services or network settings may restrict the access. 

  

URL:  https://[hostnameOrIP]:60008/validation/testconnection/  

Where hostnameOrIP is host name or IP address of the node where the agent is running.  

  

 

  

  

Please ensure the above cases and let us know the results. Also, please share below logs to assist you further. 

  

Cluster Manager log location - [installedDrive]:\Syncfusion\BigData\[version]\BigDataPlatform\ClusterManager\logs 

Agent log location on each node - [installedDrive]:\Syncfusion\BigData\[version]\BigDataAgent\Manager Service\logs 

  

  

Regards, 

Baskaran V 

[Oula Alshiekh]

   i tried the url with no response even though i can see port 60008 in listening ports with allowed ,not restricted

URL:  http://[hostnameOrIP]:60008/validation/testconnection/  

what can be the result

[Oula Alshiekh]

that are my logs files can you verify them please

Attachment: Logs_183ee1d1.rar

[Oula Alshiekh]

should we have internet on all  cluster nodes in order to let syncfusion cluster manager works well or is it enough to have internet on the node that host cluster manager  only

[Baskaran]

Hi Oula, 

Please find the response as follows. 

Query	Response
i tried the url with no response even though i can see port 60008 in listening ports with allowed ,not restricted   URL:  https://[hostnameOrIP]:60008/validation/testconnection/     what can be the result	We have checked the log you have shared, it states that there is proxy authentication required for cluster manager to access the agents.  Seems proxy is enabled in your network. Could you please ensure it from your side?  By default, cluster manager and agents do not support proxy settings, we need to have some changes in configuration files of cluster manager and agents manually.   Please share details about your proxy settings. (obviously credentials are NOT needed). Information such as whether you used default credentials or network credential, proxy type, etc. will be helpful so that we will check here in the same environment and let you know the configuration changes.
should we have internet on all cluster nodes in order to let syncfusion cluster manager works well or is it enough to have internet on the node that host cluster manager  only	No. Internet connection is not needed on any of nodes to create cluster. Even cluster manager node doesn’t need internet.

Regards, 

Baskaran V 

[Oula Alshiekh]

what about the message that is found in big data agent log please
C:\Syncfusion\BigData\1.0\SDK\Hadoop\etc\hadoop\hdfs-site.xml'
should big data agent installation add this path to other nodes that don't contain cluster manager
the only installed path i get is
C:\Syncfusion\BigData\3.1.0.25\BigDataAgent

and there is no SDK Files
here is the agent link which i installed https://s3.amazonaws.com/files2.syncfusion.com/Installs/DataScience/v3.1.0.25/syncfusionbigdataagent.exe

[Oula Alshiekh]

i started the cluster manager url with no proxy settings and the problem of Proxy Authentication Required is solved but iam getting now this message
ERROR ClusterManagerLog ClientValidation
System.Net.WebException: The request was aborted: The operation has timed out.
   at System.Net.HttpWebRequest.GetResponse()
   at Syncfusion.BigData.Platform.Manager.Base.Helpers.BaseConfigurator.ClientValidation(Host host, Host nameNodeHost, Boolean aws, List`1 advanceConfiguration, Boolean isSecured)

for each cluster node what is the problem please ?

[Baskaran]

Hi Oula, 

Please find the response as follows. 

Query	Response
i started the cluster manager url with no proxy settings and the problem of Proxy Authentication Required is solved but iam getting now this message  ERROR ClusterManagerLog ClientValidation System.Net.WebException: The request was aborted: The operation has timed out.    at System.Net.HttpWebRequest.GetResponse()    at Syncfusion.BigData.Platform.Manager.Base.Helpers.BaseConfigurator.ClientValidation(Host host, Host nameNodeHost, Boolean aws, List`1 advanceConfiguration, Boolean isSecured) for each cluster node what is the problem please ?	Seems you are using older cluster manager (v3.1.0.3 or lower) with newer agent v3.1.0.25.  In our latest release, we had migration changes for SSL support in both agent and cluster manager.  So newer agent will work with newer cluster manager only.  Reference: https://help.syncfusion.com/bigdata/release-notes/v3.1.0.25#common   Could you please ensure your cluster manager version and upgrade to newer version v3.1.0.25?  https://s3.amazonaws.com/files2.syncfusion.com/Installs/DataScience/v3.1.0.25/syncfusionbigdatacluster.exe
what about the message that is found in big data agent log please  C:\Syncfusion\BigData\1.0\SDK\Hadoop\etc\hadoop\hdfs-site.xml' should big data agent installation add this path to other nodes that don't contain cluster manager  the only installed path i get is  C:\Syncfusion\BigData\3.1.0.25\BigDataAgent and there is no SDK Files  here is the agent link which i installed https://s3.amazonaws.com/files2.syncfusion.com/Installs/DataScience/v3.1.0.25/syncfusionbigdataagent.exe	This log can be ignored. It is an unhandled exception in initial state when agent starts. It will not affect any other agent functionality.

Regards, 

Baskaran V 

[Oula Alshiekh]

thanks a lot for your support
i downloaded cluster manager on 16th October from this page https://www.syncfusion.com/downloads/bigdata/confirmation
then on 17th October i downloaded big data agent so a new  version was added 
there should be a hint telling me that the version of big data agent is not compataible with cluster manager version
i wasn't able to recognize this ever
if i want to download previous version  from big data agent is there any page showing all versions of big data agent,big data studio and big data cluster

[Baskaran]

Hi Oula, 

Please find the response as follows. 

Query	Response
if i want to download previous version from big data agent is there any page showing all versions of big data agent,big data studio and big data cluster	Please find all big data platform version download details here  https://www.syncfusion.com/downloads/version-history
there should be a hint telling me that the version of big data agent is not compatible with cluster manager version   i wasn't able to recognize this ever	We regret for the inconvenience caused.  Actually we will alert user when agent and cluster manger are in different version or having compatibility issues provided when the cluster manager is able to access the agent API. As we stated earlier we had migration for SSL support, the agent API will run on https:// instead of http:// so cluster manager couldn’t check the compatibility. We will consider this feedback to handle the compatible check more efficiently in next version.

Regards, 

Baskaran V 

[Oula Alshiekh]

thanks very mush for your quick helpness
i really find syncfusion big data platform as abrilliant platform that saves alot of work and interact with windows  .net applications

[Baskaran]

Hi Oula, 

Thank you for the update.  

Please let us know if you require any further assistance on this. We will be happy to assist you. 

Regards, 

Baskaran V