| Author |
Message |
![]() ![]() ![]() ![]()
Gandhiguevara
Legend Username: Gandhiguevara
Post Number: 38303 Registered: 10-2009 Posted From: 98.194.214.250
Rating: N/A Votes: 0 (Vote!) | | Posted on Monday, April 15, 2013 - 06:52 pm: |
![]() ![]() ![]() ![]() ![]() |
Marocharitra:
--lines comments annatlu just use the lines below input = load 'sample' as (line); words = foreach input generate flatten(TOKENIZE(line)) as word; grpd = group words by word; cntd = foreach grpd generate group, COUNT(words); dump cntd; |
![]() ![]() ![]() ![]()
Gandhiguevara
Legend Username: Gandhiguevara
Post Number: 38302 Registered: 10-2009 Posted From: 98.194.214.250
Rating: N/A Votes: 0 (Vote!) | | Posted on Monday, April 15, 2013 - 06:13 pm: |
![]() ![]() ![]() ![]() ![]() |
Marocharitra:Do we get any sample data on net to practice this? Like Persons/Customer/Employee data files ec specifically for Hadoop....
any data is good...to start with edanna text file like 'sample' lo 'GandhiGuevara is great GandhiGuevara topu GandhiGuevara turumu' ani raasi daanni copyFromLocal use chesi HDFS loki move chesi yee kindi vidham gaa cheyyi $ Pig $ grunt> -- Load input from the file named Sample, and call the single -- field in the record 'line'. input = load 'sample' as (line); -- TOKENIZE splits the line into a field for each word. -- flatten will take the collection of records returned by -- TOKENIZE and produce a separate record for each one, calling the single -- field in the record word. words = foreach input generate flatten(TOKENIZE(line)) as word; -- Now group them together by each word. grpd = group words by word; -- Count them. cntd = foreach grpd generate group, COUNT(words); -- Print out the results. dump cntd; |
![]() ![]() ![]() ![]()
Marocharitra
Comedian Username: Marocharitra
Post Number: 1082 Registered: 05-2008 Posted From: 66.241.32.158
Rating: N/A Votes: 0 (Vote!) | | Posted on Monday, April 15, 2013 - 01:55 pm: |
![]() ![]() ![]() ![]() ![]() |
Gandhiguevara:practice data getting in and out of HDFS and then let me know when you are ready to try out our cute PIG
Do we get any sample data on net to practice this? Like Persons/Customer/Employee data files ec specifically for Hadoop.... JP_Rocks to OT:send babu face chuste seppachu parama corrupted ani, siggu lekunda nuvvu support seyatledu? Neekenduku evathi corrupt aite? Nuvvemanna jp supporter va |
![]() ![]() ![]() ![]()
Gandhiguevara
Legend Username: Gandhiguevara
Post Number: 38300 Registered: 10-2009 Posted From: 98.194.214.250
Rating: N/A Votes: 0 (Vote!) | | Posted on Monday, April 15, 2013 - 12:54 pm: |
![]() ![]() ![]() ![]() ![]() |
Marocharitra:ayindhi annai.....working with other commands.
practice data getting in and out of HDFS and then let me know when you are ready to try out our cute PIG |
![]() ![]() ![]() ![]()
Marocharitra
Comedian Username: Marocharitra
Post Number: 1081 Registered: 05-2008 Posted From: 66.241.32.158
Rating: N/A Votes: 0 (Vote!) | | Posted on Monday, April 15, 2013 - 09:01 am: |
![]() ![]() ![]() ![]() ![]() |
Gandhiguevara:
ayindhi annai.....working with other commands.  JP_Rocks to OT:send babu face chuste seppachu parama corrupted ani, siggu lekunda nuvvu support seyatledu? Neekenduku evathi corrupt aite? Nuvvemanna jp supporter va |
![]() ![]() ![]() ![]()
Gandhiguevara
Legend Username: Gandhiguevara
Post Number: 38292 Registered: 10-2009 Posted From: 98.194.214.250
Rating: N/A Votes: 0 (Vote!) | | Posted on Sunday, April 14, 2013 - 11:39 am: |
![]() ![]() ![]() ![]() ![]() |
Marocharitra:Am I doing correct? These r like unix cmds
yes...eggzaatly...dir create ayyindhaa? |
![]() ![]() ![]() ![]()
Marocharitra
Comedian Username: Marocharitra
Post Number: 1080 Registered: 05-2008 Posted From: 108.196.8.133
Rating: N/A Votes: 0 (Vote!) | | Posted on Sunday, April 14, 2013 - 09:52 am: |
![]() ![]() ![]() ![]() ![]() |
Gandhiguevara:
I started Applications --> Systemo Tools --> TERMINAL and practising the commands from there. Am I doing correct? These r like unix cmds  JP_Rocks to OT:send babu face chuste seppachu parama corrupted ani, siggu lekunda nuvvu support seyatledu? Neekenduku evathi corrupt aite? Nuvvemanna jp supporter va |
![]() ![]() ![]() ![]()
Gandhiguevara
Legend Username: Gandhiguevara
Post Number: 38282 Registered: 10-2009 Posted From: 98.194.214.250
Rating: N/A Votes: 0 (Vote!) | | Posted on Saturday, April 13, 2013 - 11:20 am: |
![]() ![]() ![]() ![]() ![]() |
Marocharitra:couldn't start FS. Pls explain how to start & where to type in the commands .
makes sense kadhaa...yours is fresh installation aka blank slate... so try this hadoop fs -mkdir input hadoop fs -ls |
![]() ![]() ![]() ![]()
Marocharitra
Comedian Username: Marocharitra
Post Number: 1079 Registered: 05-2008 Posted From: 108.196.8.133
Rating: N/A Votes: 0 (Vote!) | | Posted on Saturday, April 13, 2013 - 10:49 am: |
![]() ![]() ![]() ![]() ![]() |
Gandhiguevara:
couldn't start FS. Pls explain how to start & where to type in the commands . JP_Rocks to OT:send babu face chuste seppachu parama corrupted ani, siggu lekunda nuvvu support seyatledu? Neekenduku evathi corrupt aite? Nuvvemanna jp supporter va |
![]() ![]() ![]() ![]()
Gandhiguevara
Legend Username: Gandhiguevara
Post Number: 38278 Registered: 10-2009 Posted From: 98.194.214.250
Rating: N/A Votes: 0 (Vote!) | | Posted on Friday, April 12, 2013 - 06:37 pm: |
![]() ![]() ![]() ![]() ![]() |
Marocharitra:
good ...practice commands like copyFromLocal and copyToLocal |
![]() ![]() ![]() ![]()
Megapowerkkd
Comedian Username: Megapowerkkd
Post Number: 1148 Registered: 05-2008 Posted From: 98.28.149.223
Rating: N/A Votes: 0 (Vote!) | | Posted on Friday, April 12, 2013 - 02:11 pm: |
![]() ![]() ![]() ![]() ![]() |
posting from clodera virtual box.denamma chala slow ga vundhi. YSR 7 hills ni 2 hills restrict cheddam anukonnadu..mari Jagan ekanga devudi meeda dandayatra chesthada..kalamey samadhanam cheppali. |
![]() ![]() ![]() ![]()
Megapowerkkd
Comedian Username: Megapowerkkd
Post Number: 1147 Registered: 05-2008 Posted From: 98.28.149.223
Rating: N/A Votes: 0 (Vote!) | | Posted on Friday, April 12, 2013 - 10:40 am: |
![]() ![]() ![]() ![]() ![]() |
hadoop ni control cheyyadaniki zookeeper install avuthundhi YSR 7 hills ni 2 hills restrict cheddam anukonnadu..mari Jagan ekanga devudi meeda dandayatra chesthada..kalamey samadhanam cheppali. |
![]() ![]() ![]() ![]()
Megapowerkkd
Comedian Username: Megapowerkkd
Post Number: 1146 Registered: 05-2008 Posted From: 98.28.149.223
Rating: N/A Votes: 0 (Vote!) | | Posted on Friday, April 12, 2013 - 10:37 am: |
![]() ![]() ![]() ![]() ![]() |
Ippudey install chesthunna Virtual box cloudera..chala slow ga vundhi bujjidi.create sql schema daggara agindhi..let's see YSR 7 hills ni 2 hills restrict cheddam anukonnadu..mari Jagan ekanga devudi meeda dandayatra chesthada..kalamey samadhanam cheppali. |
![]() ![]() ![]() ![]()
Marocharitra
Comedian Username: Marocharitra
Post Number: 1070 Registered: 05-2008 Posted From: 108.196.8.133
Rating: N/A Votes: 0 (Vote!) | | Posted on Friday, April 12, 2013 - 07:47 am: |
![]() ![]() ![]() ![]() ![]() |
Gandhiguevara:http://hadoop.apache.org/docs/r0.18.3/hdfs_shell.html play around with these HDFS commands...kochens vunte post here
Thanks...will do that today  JP_Rocks to OT:send babu face chuste seppachu parama corrupted ani, siggu lekunda nuvvu support seyatledu? Neekenduku evathi corrupt aite? Nuvvemanna jp supporter va |
![]() ![]() ![]() ![]()
Marocharitra
Comedian Username: Marocharitra
Post Number: 1069 Registered: 05-2008 Posted From: 108.196.8.133
Rating: N/A Votes: 0 (Vote!) | | Posted on Friday, April 12, 2013 - 07:47 am: |
![]() ![]() ![]() ![]() ![]() |
Maverick:i want to give it a shot on 4gb..aa downloaded file unpack chesaka em cheyyali
U should see virtual machine (pre-configured), if u open the file with VMPlayer. JP_Rocks to OT:send babu face chuste seppachu parama corrupted ani, siggu lekunda nuvvu support seyatledu? Neekenduku evathi corrupt aite? Nuvvemanna jp supporter va |
![]() ![]() ![]() ![]()
Maverick
Legend Username: Maverick
Post Number: 44535 Registered: 01-2008 Posted From: 69.174.58.188
Rating: N/A Votes: 0 (Vote!) | | Posted on Thursday, April 11, 2013 - 10:51 pm: |
![]() ![]() ![]() ![]() ![]() |
i want to give it a shot on 4gb..aa downloaded file unpack chesaka em cheyyali Who is this DB member? nenu anumanapu mogudu laaga jrNTR seelanni sankinchina maata nijam BUT mugguru karudugattina only balayya fans (who watched badshah tho) matladaka they certified "maakemi anipinchaledhu" |
![]() ![]() ![]() ![]()
Gandhiguevara
Legend Username: Gandhiguevara
Post Number: 38276 Registered: 10-2009 Posted From: 98.194.214.250
Rating: N/A Votes: 0 (Vote!) | | Posted on Thursday, April 11, 2013 - 10:45 pm: |
![]() ![]() ![]() ![]() ![]() |
Marocharitra:
http://hadoop.apache.org/docs/r0.18.3/hdfs_shell.html play around with these HDFS commands...kochens vunte post here |
![]() ![]() ![]() ![]()
Marocharitra
Comedian Username: Marocharitra
Post Number: 1068 Registered: 05-2008 Posted From: 108.196.8.133
Rating: N/A Votes: 0 (Vote!) | | Posted on Thursday, April 11, 2013 - 10:24 pm: |
![]() ![]() ![]() ![]() ![]() |
Gg, Upgraded RAM to 8GB. VMplayer performance is much better & Posting from Cloudera CDH now . What next...? JP_Rocks to OT:send babu face chuste seppachu parama corrupted ani, siggu lekunda nuvvu support seyatledu? Neekenduku evathi corrupt aite? Nuvvemanna jp supporter va |
![]() ![]() ![]() ![]()
Gandhiguevara
Legend Username: Gandhiguevara
Post Number: 38194 Registered: 10-2009 Posted From: 98.194.214.250
Rating: N/A Votes: 0 (Vote!) | | Posted on Sunday, April 07, 2013 - 09:17 pm: |
![]() ![]() ![]() ![]() ![]() |
Next weekend nundi serious gaa start avudhaam anukune vallu DL it this week |
![]() ![]() ![]() ![]()
Rudraksha
Comedian Username: Rudraksha
Post Number: 1087 Registered: 07-2012 Posted From: 70.181.57.58
Rating: N/A Votes: 0 (Vote!) | | Posted on Sunday, April 07, 2013 - 09:18 pm: |
![]() ![]() ![]() ![]() ![]() |
Gandhiguevara:vallu DL it this week
 |
![]() ![]() ![]() ![]()
Rudraksha
Comedian Username: Rudraksha
Post Number: 1088 Registered: 07-2012 Posted From: 70.181.57.58
Rating: N/A Votes: 0 (Vote!) | | Posted on Sunday, April 07, 2013 - 09:19 pm: |
![]() ![]() ![]() ![]() ![]() |
Gandhiguevara:
idemi twist, posts taru mary ayyay. naa kallani nammalekapotunna rao garu |
![]() ![]() ![]() ![]()
Gandhiguevara
Legend Username: Gandhiguevara
Post Number: 38199 Registered: 10-2009 Posted From: 98.194.214.250
Rating: N/A Votes: 0 (Vote!) | | Posted on Sunday, April 07, 2013 - 09:26 pm: |
![]() ![]() ![]() ![]() ![]() |
http://www.cloudera.com/content/cloudera-content/cloudera-do cs/DemoVMs/3.13.2013/CDH4-Demo-VM/cdh4dvm_topic_3.html?scrol l=topic_3_unique_2 |
![]() ![]() ![]() ![]()
Gandhiguevara
Legend Username: Gandhiguevara
Post Number: 38200 Registered: 10-2009 Posted From: 98.194.214.250
Rating: N/A Votes: 0 (Vote!) | | Posted on Sunday, April 07, 2013 - 09:26 pm: |
![]() ![]() ![]() ![]() ![]() |
top down approach follow avuthunnam yeeda |
![]() ![]() ![]() ![]()
Sasibabu
Hero Username: Sasibabu
Post Number: 16227 Registered: 11-2009 Posted From: 76.185.191.220
Rating: N/A Votes: 0 (Vote!) | | Posted on Sunday, April 07, 2013 - 09:54 pm: |
![]() ![]() ![]() ![]() ![]() |
Gandhiguevara:
nee yenkamma Rakesh..... Oka dhaniki fix avvu.... Hadoop/ bugdata/ mongodb/ cloudera .... Itta rojukokkati seppi mammalni insult seyamaaku kikiki |
![]() ![]() ![]() ![]()
Goonda
Megastar Username: Goonda
Post Number: 23482 Registered: 02-2007 Posted From: 75.66.158.123
Rating: N/A Votes: 0 (Vote!) | | Posted on Sunday, April 07, 2013 - 09:59 pm: |
![]() ![]() ![]() ![]() ![]() |
Sasibabu:Hadoop/ bugdata/ mongodb/ cloudera
cloudera --> os hadoop --> implementation name mangodb --> no sql db big-data --? Sasibabu: If TDP loses next elechens, i will donate 10% of my salary to TDP Skywalker: Bala chiru type kadu.....narasimha swamy avataram etti posani gadi pegulu medalo esukuntadu |
![]() ![]() ![]() ![]()
Rudraksha
Comedian Username: Rudraksha
Post Number: 1089 Registered: 07-2012 Posted From: 70.181.57.58
Rating: N/A Votes: 0 (Vote!) | | Posted on Sunday, April 07, 2013 - 10:12 pm: |
![]() ![]() ![]() ![]() ![]() |
Goonda:cloudera --> os hadoop --> implementation name mangodb --> no sql db big-data --?
cloudera---company providing solutions hadoop: it is a file system mongodb: it is a nosql database big-data: new concept which is different from RDMS concepts and primarily uses file system based databases like mongodb, etc to handle big data. |
![]() ![]() ![]() ![]()
Marocharitra
Comedian Username: Marocharitra
Post Number: 1060 Registered: 05-2008 Posted From: 66.241.32.158
Rating: N/A Votes: 0 (Vote!) | | Posted on Monday, April 08, 2013 - 01:50 pm: |
![]() ![]() ![]() ![]() ![]() |
Gandhiguevara:
Gg, I downloaded the image and it was too slow when I tried to open it on my desktop through VMPlayer (RAM 4GB only ) Going to order addtional 4GB today, and will keep you guys posted. JP_Rocks to OT:send babu face chuste seppachu parama corrupted ani, siggu lekunda nuvvu support seyatledu? Neekenduku evathi corrupt aite? Nuvvemanna jp supporter va |
![]() ![]() ![]() ![]()
Maverick
Legend Username: Maverick
Post Number: 44345 Registered: 01-2008 Posted From: 70.39.176.116
Rating: N/A Votes: 0 (Vote!) | | Posted on Monday, April 08, 2013 - 04:35 pm: |
![]() ![]() ![]() ![]() ![]() |
downloading now 4gb ram laptop work avutunda? i5? Who is this DB member? nenu anumanapu mogudu laaga jrNTR seelanni sankinchina maata nijam BUT mugguru karudugattina only balayya fans (who watched badshah tho) matladaka they certified "maakemi anipinchaledhu" |
![]() ![]() ![]() ![]()
Gandhiguevara
Legend Username: Gandhiguevara
Post Number: 38206 Registered: 10-2009 Posted From: 98.194.214.250
Rating: N/A Votes: 0 (Vote!) | | Posted on Monday, April 08, 2013 - 06:29 pm: |
![]() ![]() ![]() ![]() ![]() |
Maverick:4gb ram laptop work avutunda? i5?
hmmm min 6GB RAM vunte better antunnadu vaade |