新聞中心
Load 語句會(huì)簡單地將數(shù)據(jù)加載到Apache Pig中的指定關(guān)系中。要驗(yàn)證Load語句的執(zhí)行,必須使用Diagnostic運(yùn)算符。Pig Latin提供四種不同類型的診斷運(yùn)算符:

創(chuàng)新互聯(lián)專注于企業(yè)成都全網(wǎng)營銷推廣、網(wǎng)站重做改版、撫順縣網(wǎng)站定制設(shè)計(jì)、自適應(yīng)品牌網(wǎng)站建設(shè)、HTML5建站、購物商城網(wǎng)站建設(shè)、集團(tuán)公司官網(wǎng)建設(shè)、成都外貿(mào)網(wǎng)站制作、高端網(wǎng)站制作、響應(yīng)式網(wǎng)頁設(shè)計(jì)等建站業(yè)務(wù),價(jià)格優(yōu)惠性價(jià)比高,為撫順縣等各大城市提供網(wǎng)站開發(fā)制作服務(wù)。
- Dump運(yùn)算符
- Describe運(yùn)算符
- Explanation運(yùn)算符
- Illustration運(yùn)算符
在本章中,我們將討論P(yáng)ig Latin的Dump運(yùn)算符。
Dump運(yùn)算符
Dump 運(yùn)算符用于運(yùn)行Pig Latin語句,并在屏幕上顯示結(jié)果,它通常用于調(diào)試目的。
語法
下面給出了 Dump 運(yùn)算符的語法。
grunt> Dump Relation_Name
例
假設(shè)在HDFS中有一個(gè)包含以下內(nèi)容的文件 student_data.txt 。
001,Rajiv,Reddy,9848022337,Hyderabad 002,siddarth,Battacharya,9848022338,Kolkata 003,Rajesh,Khanna,9848022339,Delhi 004,Preethi,Agarwal,9848022330,Pune 005,Trupthi,Mohanthy,9848022336,Bhuwaneshwar 006,Archana,Mishra,9848022335,Chennai.
我們使用LOAD運(yùn)算符將它讀入關(guān)系 student ,如下所示。
grunt> student = LOAD 'hdfs://localhost:9000/pig_data/student_data.txt'
USING PigStorage(',')
as ( id:int, firstname:chararray, lastname:chararray, phone:chararray,
city:chararray );
現(xiàn)在,使用Dump運(yùn)算符打印關(guān)系的內(nèi)容,如下所示。
grunt> Dump student
一旦執(zhí)行上述 Pig Latin 語句,將啟動(dòng)一個(gè)MapReduce作業(yè)以從HDFS讀取數(shù)據(jù),將產(chǎn)生以下輸出。
2015-10-01 15:05:27,642 [main]
INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher -
100% complete
2015-10-01 15:05:27,652 [main]
INFO org.apache.pig.tools.pigstats.mapreduce.SimplePigStats - Script Statistics:
HadoopVersion PigVersion UserId StartedAt FinishedAt Features
2.6.0 0.15.0 Hadoop 2015-10-01 15:03:11 2015-10-01 05:27 UNKNOWN
Success!
Job Stats (time in seconds):
JobId job_14459_0004
Maps 1
Reduces 0
MaxMapTime n/a
MinMapTime n/a
AvgMapTime n/a
MedianMapTime n/a
MaxReduceTime 0
MinReduceTime 0
AvgReduceTime 0
MedianReducetime 0
Alias student
Feature MAP_ONLY
Outputs hdfs://localhost:9000/tmp/temp580182027/tmp757878456,
Input(s): Successfully read 0 records from: "hdfs://localhost:9000/pig_data/
student_data.txt"
Output(s): Successfully stored 0 records in: "hdfs://localhost:9000/tmp/temp580182027/
tmp757878456"
Counters: Total records written : 0 Total bytes written : 0 Spillable Memory Manager
spill count : 0Total bags proactively spilled: 0 Total records proactively spilled: 0
Job DAG: job_1443519499159_0004
2015-10-01 15:06:28,403 [main]
INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLau ncher - Success!
2015-10-01 15:06:28,441 [main] INFO org.apache.pig.data.SchemaTupleBackend -
Key [pig.schematuple] was not set... will not generate code.
2015-10-01 15:06:28,485 [main]
INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths
to process : 1
2015-10-01 15:06:28,485 [main]
INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths
to process : 1
(1,Rajiv,Reddy,9848022337,Hyderabad)
(2,siddarth,Battacharya,9848022338,Kolkata)
(3,Rajesh,Khanna,9848022339,Delhi)
(4,Preethi,Agarwal,9848022330,Pune)
(5,Trupthi,Mohanthy,9848022336,Bhuwaneshwar)
(6,Archana,Mishra,9848022335,Chennai)
網(wǎng)頁題目:創(chuàng)新互聯(lián)ApachePig教程:ApachePigDiagnostic運(yùn)算符
標(biāo)題鏈接:http://www.dlmjj.cn/article/cciigei.html


咨詢
建站咨詢
