We use cookies to give you the best experience on our website. If you continue to browse, then you agree to our privacy policy and cookie policy. (Last updated on : Nov 16th 2018).
Unfortunately, activation email could not send to your email. Please try again.
Syncfusion Feedback

Pig Error

Thread ID:

Created:

Updated:

Platform:

Replies:

117463 Oct 25,2014 10:34 AM UTC Oct 30,2014 04:38 AM UTC Big Data Platform 4
loading
Tags: General
Venu Bukka
Asked On October 25, 2014 10:34 AM UTC

Hi,
     I've been trying trying out your Big data solution & its cool. But ran into a problem when running a pig job . Can you help me out?

emp = load 'data.txt' using PigStorage(',') as (name:chararray,id:int,city:chararray);
a = foreach emp generate $0;
dump a;

Error:

2014-10-25 13:53:20,251 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Failed!

2014-10-25 13:53:20,251 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1066: Unable to open iterator for alias a. Backend error : org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException: Application with id 'application_1414217179201_0009' doesn't exist in RM.

at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getApplicationReport(ClientRMService.java:251)

at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.getApplicationReport(ApplicationClientProtocolPBServiceImpl.java:120)

at org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:241)

at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)

at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)

at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1962)

at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1958)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:415)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)

at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1958)


Attachment: Screen_Shot_20141025_at_4.03.07_pm_cc8c9ed6.zip

Praveena P [Syncfusion]
Replied On October 27, 2014 09:38 AM UTC

Hi,
     I've been trying trying out your Big data solution & its cool. But ran into a problem when running a pig job . Can you help me out?

emp = load 'data.txt' using PigStorage(',') as (name:chararray,id:int,city:chararray);
a = foreach emp generate $0;
dump a;

Error:

2014-10-25 13:53:20,251 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Failed!

2014-10-25 13:53:20,251 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1066: Unable to open iterator for alias a. Backend error : org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException: Application with id 'application_1414217179201_0009' doesn't exist in RM.

at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getApplicationReport(ClientRMService.java:251)

at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.getApplicationReport(ApplicationClientProtocolPBServiceImpl.java:120)

at org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:241)

at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)

at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)

at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1962)

at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1958)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:415)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)

at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1958)


Attachment: Screen_Shot_20141025_at_4.03.07_pm_cc8c9ed6.zip

 

Hi Venu,

Thanks for your interest in Syncfusion products.

 

 

 

 

 


Query:

Problem in running pig job.

 

 

 

 

 

The pig job submitted has been failed due to the below cause:

“Input path does not exist”.

Please refer the  attached screenshot highlighted with the failed message.


The input path specified in provided pig script is as follows.

     emp = load 'data.txt' using PigStorage(',') as (name:chararray,id:int,city:chararray);

which contains only a file name to load. This implies the default path as ‘/user/username/inputfile’. In your case ‘/user/Venu/data.txt’. So place the input file in the corresponding location and execute the script.

 

If the input file is in hdfs root location, then the pig script should be

      emp = load ' /data.txt' using PigStorage(',') as (name:chararray,id:int,city:chararray)

 

Please let us know if you have any queries.

Regards,

Praveena.


Praveena P [Syncfusion]
Replied On October 27, 2014 09:53 AM UTC

Hi Venu,

Please find the screenshot attachment which is missed in last update.

Regards,
Praveena.

Attachment: screenshot_7424948a.zip

Venu Bukka
Replied On October 28, 2014 04:15 PM UTC

Thanks. I got the path wrong

Praveena P [Syncfusion]
Replied On October 30, 2014 04:38 AM UTC

Hi Venu,

We are glad that your problem has resolved. Please let us know if you have any queries.

Regards,
Praveena.

CONFIRMATION

This post will be permanently deleted. Are you sure you want to continue?

Sorry, An error occured while processing your request. Please try again later.

Warning Icon You are using an outdated version of Internet Explorer that may not display all features of this and other websites. Upgrade to Internet Explorer 8 or newer for a better experience.Close Icon

;