We use cookies to give you the best experience on our website. If you continue to browse, then you agree to our privacy policy and cookie policy. Image for the cookie policy date

Big Data Services Ports

How can i know each port for the services on my local instance
like hive on 10000
i want to know the port of hdfs hadoop file system because i want to connect with by using polybase

3 Replies

CM Churchil Mariyasagayaraj Syncfusion Team October 11, 2016 11:58 AM UTC

Hi Oula Alshiekh, 

Thank you for using Syncfusion Big Data Platform. 
Please use the port 9000 for HDFS access for polybase connectivity. 

Note: 
In case you are using Big Data Studio, all services bind with “localhost” and run as local instance so it cannot be accessible from outside the machine. 
If you want to have external access, we recommend you to use cluster manager to create single node or multiple node cluster. 

Also find the below list of other ports details of Syncfusion Big Data Platform. This ports are common for both Big Data Studio and cluster manager. 

Service 
Port Number 
Syncfusion Big Data Agent 
60008 
Syncfusion Big Data Remote Agent 
60009 
Hadoop – HDFS 
Namenode HTTP address 
50070 
Namenode Rpc address 
9000 
Namenode Backup address 
50100 
Datanode HTTP address 
50075 
Datanode TCP address 
50010 
Datanode IPC address 
50020 
Journal Node 
8485 
Hadoop – YARN 
Resourcemanager Address 
8032 
Resourcemanager Scheduler Address 
8030 
Resourcemanager Resource Tracker Address 
8031 
Resourcemanager HTTP address 
8088 
Resourcemanager HTTPS address 
8090 
Nodemanager address 
8042 
Hadoop - MAPRED 
JobHistory Server address 
19888 
JobHistory Server HTTPS address 
19890 
HIVE 
Derby Server 
1527 (optional) 
Hiver Server 2  
10000 
Hiver Server 2  web UI 
10004 
Hive Metastore 
9083 
Sqoop 
Sqoop MetaStore 
16000 
Oozie 
Oozie Server 
11000 
ZOOKEEPER 
Zookeeper server 
2181 
Zookeeper Internal server 
2888 (Peer connection) 
Zookeeper Internal server 
3888 (Peer connection) 
Zookeeper Failover control (ZKFC) 
8019 
SPARK 
Standalone Master 
8080 
Standalone Worker 
8081 
Standalone Master 
7077(Submit job to cluster) 
Application 
4040 
History Server 
18080 
Thrift Server 
10001 
HBase 
ZooKeeper 
2181 
Master 
60000 
Master 
60010(Web UI) 
Region server 
60020 
Region server 
60030(Web UI) 
Thrift server 
10003 
Thrift server 
9095(Web UI) 
REST server 
8080 
REST server 
8085(Web UI) 
IPython 
Ipython 
10002 


Regards, 
Churchil M. 



OA Oula Alshiekh October 17, 2016 12:57 PM UTC

thanks so much for the answer we can also find out these  ports from hadoop configuration  files as core-site.xml  found in
C:\Syncfusion\BigData\3.1.0.3\BigDataSDK\SDK\Hadoop


KS Karthikeyan SankaraVadivel Syncfusion Team October 18, 2016 09:20 AM UTC

Hi Oula Alshiekh, 

Thanks for the update 

Please let us know if you need any further assistance.  

Thanks, 
Karthikeyan S  


Loader.
Live Chat Icon For mobile
Up arrow icon