Pre-requisites for executing jobs in Sqoop
Sqoop requires JDBC connector jar files to be present in lib folder (SDK\Sqoop\lib) for execution of jobs.
Please follow below steps to move JDBC connector jar files to Sqoop lib folder.
Step 1 – Download jar files
Refer below table for download links on required JDBC connector jars
Database | Jar file name | Download reference Link |
SQL Server | Sqljdbc41 | |
MySQL | mysql-connector-java-5.1.39 | https://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.39.zip |
Oracle | ojdbc6 | http://www.oracle.com/technetwork/database/features/jdbc/index-091264.html |
Step 2 – Move the downloaded JDBC connector jars to Sqoop\lib folder.
- For local cluster installed with big data studio, move the jar files to below location.
Directory:
<InstalledDirectory>\Syncfusion\BigData\<Version>\BigDataSDK\SDK\Sqoop\lib
Screenshot for reference:
- For Hadoop cluster formed with the help of Syncfusion big data cluster manager, move the jar files to each node where the Sqoop is installed.
Note: By default Sqoop will be installed in active name node machine.
Reference directory for remote cluster:
<InstalledDirectory>\Syncfusion\HadoopNode\<Version>\BigDataSDK\SDK\Sqoop\lib
Screenshot for reference:
Note: if you run into errors with the message “ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not load db driver class:”, then please ensure that the proper connector jar files present in the Sqoop lib folder.