We use cookies to give you the best experience on our website. If you continue to browse, then you agree to our privacy policy and cookie policy. Image for the cookie policy date

Sqoop and Hive erros

Hey Folks,

I am testing the big data studio and having errors like this , can anyone please help ?

hive import error

hive> load data inpath '/GettingStarted/Input/Recommend/ratings.csv' into table  recommend_ratings1;

load data inpath '/GettingStarted/Input/Recommend/ratings.csv' into table  recommend_ratings1;

FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/GettingStarted/Input/Recommend/ratings.csv'': Move from: hdfs://localhost:9000/GettingStarted/Input/Recommend/ratings.csv to: hdfs://synccluster/GettingStarted/Input/Recommend is not valid. Please check that values for params "default.fs.name" and "hive.metastore.warehouse.dir" do not conflict.


sqoop error when I am importing data from sql server





 


15/09/08 09:30:53 INFO mapreduce.Job: Job job_1441675559247_0002 failed with state FAILED due to: Application application_1441675559247_0002 failed 2 times due to AM Container for appattempt_1441675559247_0002_000002 exited with  exitCode: -1000 due to: Call From HADOOP-DATA1/192.168.100.103 to localhost:9000 failed on connection exception: java.net.ConnectException: Connection refused: no further information; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused


.Failing this attempt.. Failing the application.


15/09/08 09:30:53 INFO mapreduce.Job: Counters: 0


15/09/08 09:30:53 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead


15/09/08 09:30:53 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 13.8993 seconds (0 bytes/sec)


15/09/08 09:30:53 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead


15/09/08 09:30:53 INFO mapreduce.ImportJobBase: Retrieved 0 records.


15/09/08 09:30:53 ERROR tool.ImportTool: Error during import: Import job failed!






3 Replies

PP Praveena P Syncfusion Team September 11, 2015 02:54 PM UTC

Hi John,
Could you please share the following details with us:

1.       What version of Big Data Platform build have you installed?
2.       Are you working with pseudo node cluster or remote cluster?
3.       Have you done any changes in Hadoop configuration files? If so , would you share the information?

This will help us to determine the cause of the issue and find a solution.

Regards,
Praveena.


JW jwan218 September 15, 2015 04:51 AM UTC

Hi Praveena

Please kindly find below my replies:

1.       What version of Big Data Platform build have you installed?
2.1.0.77
2.       Are you working with pseudo node cluster or remote cluster?
Remote Cluster, we had a 3-servers testing environment.
3.       Have you done any changes in Hadoop configuration files? If so , would you share the information?
No, we didn't touch the configuration files.


Also, please kindly find below the detail error log for your reference, thanks in advance.

sqoop import --connect "jdbc:sqlserver://xxxxx:1433;database=Mobile_data"  --username xxxx --password xxxxx --table appuse_test --target-dir /test01  --fields-terminated-by "," -m 1

Warning: HBASE_HOME and HBASE_VERSION not set.

Warning: HCAT_HOME not set

Warning: HCATALOG_HOME does not exist HCatalog imports will fail.

Please set HCATALOG_HOME to the root of your HCatalog installation.

Warning: ACCUMULO_HOME not set.

Warning: ZOOKEEPER_HOME not set.

Warning: HBASE_HOME does not exist HBase imports will fail.

Please set HBASE_HOME to the root of your HBase installation.

Warning: ACCUMULO_HOME does not exist Accumulo imports will fail.

Please set ACCUMULO_HOME to the root of your Accumulo installation.

Warning: ZOOKEEPER_HOME does not exist Accumulo imports will fail.

Please set ZOOKEEPER_HOME to the root of your Zookeeper installation.

15/09/15 12:27:08 INFO sqoop.Sqoop: Running Sqoop version: 1.4.5

15/09/15 12:27:08 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.

15/09/15 12:27:09 INFO manager.SqlManager: Using default fetchSize of 1000

15/09/15 12:27:09 INFO tool.CodeGenTool: Beginning code generation

15/09/15 12:27:11 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM [appuse_test] AS t WHERE 1=0

15/09/15 12:27:12 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is D:\Syncfusion\BigDataSDK\2.1.0.77\SDK\Hadoop

?: \tmp\sqoop-HADOOP-MASTER$\compile\e13fcea9c53297bfd8bb6772e9acb500\appuse_test.javaʹ򸲸����ѹʱ��? API��

?: ����ϸ��Ϣ?, ��ʹ�� -Xlint:deprecation �����ä

15/09/15 12:27:15 INFO orm.CompilationManager: Writing jar file: \tmp\sqoop-HADOOP-MASTER$\compile\e13fcea9c53297bfd8bb6772e9acb500\appuse_test.jar

15/09/15 12:27:16 INFO mapreduce.ImportJobBase: Beginning import of appuse_test

15/09/15 12:27:17 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032

15/09/15 12:27:23 INFO db.DBInputFormat: Using read commited transaction isolation

15/09/15 12:27:23 INFO mapreduce.JobSubmitter: number of splits:1

15/09/15 12:27:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1442290977388_0002

15/09/15 12:27:24 INFO impl.YarnClientImpl: Submitted application application_1442290977388_0002

15/09/15 12:27:24 INFO mapreduce.Job: The url to track the job: http://Hadoop-master:8088/proxy/application_1442290977388_0002/

15/09/15 12:27:24 INFO mapreduce.Job: Running job: job_1442290977388_0002

15/09/15 12:27:30 INFO mapreduce.Job: Job job_1442290977388_0002 running in uber mode : false

15/09/15 12:27:30 INFO mapreduce.Job:  map 0% reduce 0%

15/09/15 12:27:30 INFO mapreduce.Job: Job job_1442290977388_0002 failed with state FAILED due to: Application application_1442290977388_0002 failed 2 times due to AM Container for appattempt_1442290977388_0002_000002 exited with  exitCode: -1000 due to: Call From HADOOP-DATA1/192.168.100.103 to localhost:9000 failed on connection exception: java.net.ConnectException: Connection refused: no further information; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused

.Failing this attempt.. Failing the application.

15/09/15 12:27:31 INFO mapreduce.Job: Counters: 0

15/09/15 12:27:31 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead

15/09/15 12:27:31 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 13.7619 seconds (0 bytes/sec)

15/09/15 12:27:31 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead

15/09/15 12:27:31 INFO mapreduce.ImportJobBase: Retrieved 0 records.

15/09/15 12:27:31 ERROR tool.ImportTool: Error during import: Import job failed!

 

D:\Syncfusion\BigDataSDK\2.1.0.77\SDK\Sqoop\bin>




PP Praveena P Syncfusion Team September 15, 2015 12:35 PM UTC

Hi John,
Thank you for your update.
We have created a new incident to reproduce the issue. Please follow up the incident for further follow-up using your Direct-Trac account.
https://www.syncfusion.com/account/login?ReturnUrl=%2fsupport%2fdirecttrac%2fincidents
Please let us know if you have any query.
Regards,
Praveena

Loader.
Up arrow icon