Unable to execute pig scripts using Azure powershell -


this pig script

$querystring = "a =  load 'wasb://$containername@$storageaccount.blob.core.windows.net/table1' using pigstorage(',') (col1 chararray,col2 chararray,col3 chararray,col4 chararray,col5 chararray,col6 chararray,col7 int,col8 int);" + "user_list = foreach generate $0;" + "unique_user = distinct user_list;" + "unique_users_group = group unique_user all;" + "uu_count = foreach unique_users_group generate count(unique_user);" + "dump uu_count;"

i error when execute above pig script

'2015-04-14 23:17:55,177 [main] error org.apache.pig.pigserver - exception during parsing: error during parsing. <line 1, column 166>  mismatched input 'chararray' expecting right_paren failed parse: <line 1, column 166>  mismatched input 'chararray' expecting right_paren @ org.apache.pig.parser.queryparserdriver.parse(queryparserdriver.java:241) @ org.apache.pig.parser.queryparserdriver.parse(queryparserdriver.java:179) @ org.apache.pig.pigserver$graph.parsequery(pigserver.java:1678) @ org.apache.pig.pigserver$graph.access$000(pigserver.java:1411) @ org.apache.pig.pigserver.parseandbuild(pigserver.java:344) @ org.apache.pig.pigserver.executebatch(pigserver.java:369) @ org.apache.pig.pigserver.executebatch(pigserver.java:355) @ org.apache.pig.tools.grunt.gruntparser.executebatch(gruntparser.java:140) @ org.apache.pig.tools.grunt.gruntparser.processdump(gruntparser.java:769) @ org.apache.pig.tools.pigscript.parser.pigscriptparser.parse(pigscriptparser.java:372) @ org.apache.pig.tools.grunt.gruntparser.parsestoponerror(gruntparser.java:198) @ org.apache.pig.tools.grunt.gruntparser.parsestoponerror(gruntparser.java:173) @ org.apache.pig.tools.grunt.grunt.exec(grunt.java:84) @ org.apache.pig.main.run(main.java:509) @ org.apache.pig.main.main(main.java:156) 2015-04-14 23:17:55,177 [main] error org.apache.pig.tools.grunt.grunt -   error 1200: <line 1, column 166>  mismatched input 'chararray' expecting right_paren

i edited load statement , rest of script same

$querystring = "a =  load 'wasb://$containername@$storageaccount.blob.core.windows.net/table1';" +

the error is

2015-04-14 23:23:00,117 [main] error org.apache.pig.pigserver - exception during parsing: error during parsing. <line 1, column 162>  syntax error, unexpected symbol @ or near ';' failed parse: <line 1, column 162>  syntax error, unexpected symbol @ or near ';' @ org.apache.pig.parser.queryparserdriver.parse(queryparserdriver.java:241) @ org.apache.pig.parser.queryparserdriver.parse(queryparserdriver.java:179) @ org.apache.pig.pigserver$graph.parsequery(pigserver.java:1678) @ org.apache.pig.pigserver$graph.access$000(pigserver.java:1411) @ org.apache.pig.pigserver.parseandbuild(pigserver.java:344) @ org.apache.pig.pigserver.executebatch(pigserver.java:369) @ org.apache.pig.pigserver.executebatch(pigserver.java:355) @ org.apache.pig.tools.grunt.gruntparser.executebatch(gruntparser.java:140) @ org.apache.pig.tools.grunt.gruntparser.processdump(gruntparser.java:769) @ org.apache.pig.tools.pigscript.parser.pigscriptparser.parse(pigscriptparser.java:372) @ org.apache.pig.tools.grunt.gruntparser.parsestoponerror(gruntparser.java:198) @ org.apache.pig.tools.grunt.gruntparser.parsestoponerror(gruntparser.java:173) @ org.apache.pig.tools.grunt.grunt.exec(grunt.java:84) @ org.apache.pig.main.run(main.java:509) @ org.apache.pig.main.main(main.java:156) 2015-04-14 23:23:00,132 [main] error org.apache.pig.tools.grunt.grunt - error 1200: <line 1, column 162>  syntax error, unexpected symbol @ or near ';' details @ logfile: c:\apps\dist\hadoop-2.4.0.2.1.9.0-2196\logs\pig_1429053777602.log

i don't understand error is. can me executing query on windows powershell(i using windows powershell ise, can edit queries)

terminal execution

the issue @ statement user_list = foreach generate $0;. powershell interpreting $0 parameter, , since not defined powershell substituting empty string. can define parameter in script $0 = '$0'; or escape $ like: 

user_list = foreach generate `$0;

powershell uses ` (backtick, next '1' key) escape character double-quoted strings.

so script can like:

$0 = '$0'; $querystring = "a =  load 'wasb://$containername@$storageaccountname.blob.core.windows.net/table1' using pigstorage(',') (col1,col2,col3,col4,col5,col6,col7,col8) ;"+ "user_list = foreach generate $0;" + "unique_user = distinct user_list;" + "unique_users_group = group unique_user all;" + "uu_count = foreach unique_users_group generate count(unique_user);" + "dump uu_count;"

or

$querystring = "a =  load 'wasb://$containername@$storageaccountname.blob.core.windows.net/table1' using pigstorage(',') (col1,col2,col3,col4,col5,col6,col7,col8) ;"+ "user_list = foreach generate `$0;" + "unique_user = distinct user_list;" + "unique_users_group = group unique_user all;" + "uu_count = foreach unique_users_group generate count(unique_user);" + "dump uu_count;"

-

Comments

Post a Comment

Popular posts from this blog

css - SVG using textPath a symbol not rendering in Firefox -

using textpath within symbol doesn't render in firefox. renders fine in latest chrome , ie, when try reference symbol, svg text doesn't render in firefox (37.0.1) - first box appears empty. code below (no external dependencies), there should 2 boxes word test flowing vertically in centre of each. edit: thought issue somehow involved flexbox layout, until paul pointed out issue exists without flexbox layout. the html is: <div> <svg id="not_working" viewbox="0 0 250 1200" preserveaspectratio="xmidymid meet"> <symbol id="test_symbol1" preserveaspectratio="xmidymid meet" viewbox="0 0 250 1200"> <path id="test_symbol_path" d="m 100 1200 l 100 0" /> <text font-size="100" fill="red"> <textpath text-anchor="middle" startoffset="50%" xlink:href="#test_symbol_path...
Read more

Java 8 + Maven Javadoc plugin: Error fetching URL -

i attempting generate javadoc links javadoc dependencies. have tried various means generate javadoc not produce qualified class names references classes dependencies. wanted links java doc simplified class names. however, java api classnames, no links , have qualified class names. working java 8. have following configuration: <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-javadoc-plugin</artifactid> <version>2.10.2</version> <configuration> <reportoutputdirectory>${project.basedir}/target</reportoutputdirectory> <destdir>javadoc</destdir> <windowtitle>epiphany</windowtitle> <doctitle>epiphany</doctitle> <show>private</show> <detectlinks>false</detectlinks> <detectoffline...
Read more

order - Notification for user in user account opencart -

thanks helps or points me in right direction. i want show pending notification user in account page after login. notification show when order status pending. after changing other status admin remove notification. this notification show like: your order id: order status: , [ button custom url] if multiple order show multiple order id. open cart version 1.5.6.3 custom theme. $this->load->model('account/order'); $results = $this->model_account_order->getorders(); foreach ($results $result) { $product_total = $this->model_account_order->gettotalorderproductsbyorderid($result['order_id']); $voucher_total = $this->model_account_order->gettotalordervouchersbyorderid($result['order_id']); if( $result['status'] =! 5){ // 5 order status means completed $this->data['orders'][] = array( 'order_id' => $result['order_id'], ...
Read more