In today's data-driven world, managing large quantities of data has become an important ingredient in business success. Managing big data comes with several challenges, including cost-effective storage and querying across structured and unstructured data. It also offers tremendous potential. Imagine not having to decide which of your data is valuable. Imagine being able to store any amount of data using commodity hardware with linear scalability. The Hadoop environment makes all of this, and much more, possible today.
And now, Syncfusion has made these powerful technologies available on both Windows and Linux. With the Syncfusion Big Data Platform, you have complete access to the Hadoop environment. By adopting our platform, you are using an industry-tested solution currently employed by companies such as Microsoft, Facebook, Amazon, Adobe, Hulu, LinkedIn, and Yahoo.
The platform comes with integrated support for HBase. Store and process massive amounts of data in a horizontally scalable manner. Achieve high speed reads and writes. HBase is quickly becoming the NoSQL store of choice and the Syncfusion Big Data Platform makes it easier to deploy than ever before.
When creating a cluster, manual configuration is not required. The cluster configuration and management system we provide takes care of everything.
All you need on each node is a small agent that depends on .NET Framework 4.5 or later on Windows and .NET Core (self-contained) on Linux. There are absolutely no other dependencies. The cluster manager will then coordinate the complete installation process with the agent.
While the agent can be manually installed for smaller clusters, we provide scripts that can automate the installation of agents to a large number of nodes in a completely unattended manner.
The Syncfusion Big Data platform can run jobs written in any language. Java, Pig, Hive, Python, and Scala are all supported. There is also complete support for C# or any other .NET platform language.
The Syncfusion Big Data platform comes ready for YARN applications. You can run any YARN-compatible application system. You are not limited to MapReduce.
Data stored in the Hadoop distributed file system (HDFS) can be directly accessed from your C# applications through Hive. We ship an extensive set of C# samples that demonstrate access under different scenarios.
No ODBC driver or other extensions are needed. Everything you need is included.
Syncfusion Big Data Studio includes complete access to the Spark environment over YARN. Take advantage of new higher level paradigms for processing massive amounts of data faster than ever before.
You can start with a 5- or 10-node cluster and scale as you need. Hadoop has scaled to thousands of nodes and can grow with your business needs.
When we say commodity hardware, we really mean it. You can buy any reasonably capable, desktop-grade hardware and put it to good use. As your needs grow, you can move to higher-grade hardware.
You can also run your own custom-configured Hadoop cluster on Azure or AWS virtual machines. Unlike Hadoop in cloud services, you have complete and direct control over your cluster.
We have fine-tuned the entire experience starting from the moment you download the product. We guarantee zero manual configuration whether you are configuring a small cluster or a much larger one.
Syncfusion ships a unique, local, single-node distribution of Hadoop complete with an interactive development environment. You can install your own local version of Hadoop with no dependencies other than the .NET framework.
Hadoop development on Windows today involves dealing with Linux virtual machines, and using command-line tools to get most of the work done. With Syncfusion, you get a native Windows experience with absolutely no need to run virtual machines.
Get all your scripts tested and working before running them on a cluster. Scripts are 100% compatible, not just with Syncfusion production clusters, but with any other Hadoop distribution.
You can also work offline with the local cluster. You can now author big data applications wherever you may be.
The Syncfusion Big Data Platform provides several complete samples written using Pig, Hive, Java, Scala, Python and C#. These samples are designed to help you start quickly.
You can seamlessly deploy to Microsoft Azure HDInsight. Azure HDInsight is a cloud implementation of Hadoop provided by our partner Microsoft.
If you qualify for our community license, the Syncfusion Big Data Platform is available to you completely free.
The commercial version of the Syncfusion Big Data Platform comes bundled with technical support. There are no limits to the number of support incidents you can create. You can interact directly with our big data team through our unique Direct-Trac support system.
You will find our pricing for commercial support to be a breath of fresh air. Contact us today to get started.
If you are a Syncfusion customer with an enterprise-scope license, you are likely already covered with substantial support benefits. Simply log into Direct-Trac or contact Syncfusion for additional details.
At Syncfusion, we have deep expertise on the Hadoop stack. With our extensive experience building the Syncfusion Big Data Platform, we can build end-to-end big data solutions for you better and faster than anyone else. Contact us today.
Yes, if you qualify for a community license or if you obtain a commercial license.
Forum support is available to everyone for free. Commercial support under a defined SLA is available for an annual fee. Details of the fees are given in the following FAQ.
No. As a matter of policy, Syncfusion does not normally limit the number of support incidents for those under commercial support.
You can log feature requests through our Direct-Trac customer-service portal.
You can report bugs using our Direct-Trac customer-service portal.
Yes. Please contact us for additional information.
Yes. If you are a Syncfusion Plus member, you as a named user, will automatically receive commercial support for one cluster up to a maximum of 5 nodes (cluster limit is a per-organization limit). In addition, current Syncfusion Global Enterprise License holders receive commercial support at the Platinum level for no charge.
Yes. You will receive commercial support on a single cluster for up to 5 nodes.
Windows 7 or a later version with .NET Framework 4.5 and Linux (Ubuntu, CentOS).For a production cluster, we recommend that you deploy on Windows Server 2008 and later or Linux (Ubuntu, CentOS).
No. We automatically handle all dependencies. Cygwin is not used by the Syncfusion Big Data Platform.
The Syncfusion Big Data Platform runs on a variety of hardware. We recommend you start with new hardware with 16 GB of RAM or more, and one or more disks with sufficient capacity for your needs. RAID is not required for data nodes. RAID is a good idea for name nodes. Specification-wise, you can certainly go as high as you want once your needs expand. You can contact us for specific advice based on your requirements.
As an example, we have a system for gathering and summarizing product metrics running on a small cluster with off-the-shelf, desktop-quality hardware. It has delivered tremendous value over the past few months. We also run other clusters that are much larger. Don't feel the need to scale up when you get started. Start with the basics. One of the nice things is that it is very simple to scale up as you need.
Yes. We test this use-case using Microsoft Azure and other cloud providers.
Yes. The core version of Apache Hadoop we ship is 2.5.2 or higher, and it comes with complete support for YARN.
Yes. We ship several samples with the Syncfusion Big Data Studio installation.
Yes. We ship several samples with the Syncfusion Big Data Studio install. You can write code or use third-party assemblies as needed.
Absolutely. We ship several samples with the Syncfusion Big Data Studio install.
Absolutely. We ship several Python samples with the product.
No. Support for high availability is built-in and works out of the box with Syncfusion Big Data Platform.
Yes. Our platform is compatible with the Microsoft HDInsight platform. Identical code will run on both platforms. Please note that our interactive studio environment does not however support direct connections to the HDInsight platform.
Not that we know of. From a practical perspective, we test clusters of up to 100 nodes. Custom tuning will almost certainly be required for very large clusters. Contact us for assistance.
You need to have DNS and reverse DNS configured properly to install Syncfusion Big Data Platform. Configuration with IP addresses is not recommended and is not supported by the cluster manager. If you provide IP addresses, we will translate these into host names, assuming DNS is configured as expected.
Most current distributions are focused on the Linux platform alone. They are not easy to setup and maintain on Windows. We aim to provide a solid, big data platform tailored for both Windows and Linux. Additionally, the platform is designed to offer a lot of additional features such as a powerful cross platform cluster manager that minimize the efforts required to get started.
We have been in business since 2001. We are one of the largest providers of software frameworks in the world. We provide frameworks to approximately half of the Fortune 500 companies, and we globally have over half a million users. Some of the best-known software packages in the world are built with our technology under the hood.