Big Data Services Ports

[Oula Alshiekh]

How can i know each port for the services on my local instance
like hive on 10000
i want to know the port of hdfs hadoop file system because i want to connect with by using polybase

[Churchil Mariyasagayaraj]

Hi Oula Alshiekh, 

Thank you for using Syncfusion Big Data Platform. 

Please use the port 9000 for HDFS access for polybase connectivity. 

Note: 

In case you are using Big Data Studio, all services bind with “localhost” and run as local instance so it cannot be accessible from outside the machine. 

If you want to have external access, we recommend you to use cluster manager to create single node or multiple node cluster. 

https://help.syncfusion.com/bigdata/cluster-manager/cluster-creation#pseudo-node-cluster  

https://help.syncfusion.com/bigdata/cluster-manager/cluster-creation#create-cluster--manual-mode  

Also find the below list of other ports details of Syncfusion Big Data Platform. This ports are common for both Big Data Studio and cluster manager. 

Service	Port Number
Syncfusion Big Data Agent	60008
Syncfusion Big Data Remote Agent	60009
Hadoop – HDFS
Namenode HTTP address	50070
Namenode Rpc address	9000
Namenode Backup address	50100
Datanode HTTP address	50075
Datanode TCP address	50010
Datanode IPC address	50020
Journal Node	8485
Hadoop – YARN
Resourcemanager Address	8032
Resourcemanager Scheduler Address	8030
Resourcemanager Resource Tracker Address	8031
Resourcemanager HTTP address	8088
Resourcemanager HTTPS address	8090
Nodemanager address	8042
Hadoop - MAPRED
JobHistory Server address	19888
JobHistory Server HTTPS address	19890
HIVE
Derby Server	1527 (optional)
Hiver Server 2	10000
Hiver Server 2  web UI	10004
Hive Metastore	9083
Sqoop
Sqoop MetaStore	16000
Oozie
Oozie Server	11000
ZOOKEEPER
Zookeeper server	2181
Zookeeper Internal server	2888 (Peer connection)
Zookeeper Internal server	3888 (Peer connection)
Zookeeper Failover control (ZKFC)	8019
SPARK
Standalone Master	8080
Standalone Worker	8081
Standalone Master	7077(Submit job to cluster)
Application	4040
History Server	18080
Thrift Server	10001
HBase
ZooKeeper	2181
Master	60000
Master	60010(Web UI)
Region server	60020
Region server	60030(Web UI)
Thrift server	10003
Thrift server	9095(Web UI)
REST server	8080
REST server	8085(Web UI)
IPython
Ipython	10002

Regards, 

Churchil M. 

[Oula Alshiekh]

thanks so much for the answer we can also find out these  ports from hadoop configuration  files as core-site.xml  found in
C:\Syncfusion\BigData\3.1.0.3\BigDataSDK\SDK\Hadoop

[Karthikeyan SankaraVadivel]

Hi Oula Alshiekh, 

Thanks for the update 

Please let us know if you need any further assistance.  

Thanks, 

Karthikeyan S