Articles in this section
Category / Section

Pre-requisites for executing jobs in Sqoop

1 min read

Sqoop requires JDBC connector jar files to be present in lib folder (SDK\Sqoop\lib) for execution of jobs.

Please follow below steps to move JDBC connector jar files to Sqoop lib folder.

 

Step 1 – Download jar files

 

Refer below table for download links on required JDBC connector jars

 

 

 

Step 2 – Move the downloaded JDBC connector jars to Sqoop\lib folder.

  1. For local cluster installed with big data studio, move the jar files to below location.

Directory:

<InstalledDirectory>\Syncfusion\BigData\<Version>\BigDataSDK\SDK\Sqoop\lib

 

Screenshot for reference:

C:\Users\rajendran.sp\Documents\My Received Files\local.PNG

  1. For Hadoop cluster formed with the help of Syncfusion big data cluster manager, move the jar files to each node where the Sqoop is installed.

 

Note: By default Sqoop will be installed in active name node machine.

 

Reference directory for remote cluster:

<InstalledDirectory>\Syncfusion\HadoopNode\<Version>\BigDataSDK\SDK\Sqoop\lib

 

Screenshot for reference:

C:\Users\rajendran.sp\Documents\My Received Files\remote.png

 

Note: if you run into errors with the message “ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not load db driver class:”, then please ensure that the proper connector jar files present in the Sqoop lib folder.

Did you find this information helpful?
Yes
No
Help us improve this page
Please provide feedback or comments
Comments
Please sign in to leave a comment
Access denied
Access denied