Topics | Search Log Out | Register | Edit Profile
Hide Clipart | Banned/Unbanned User Log | Moderator Login History | Thread Delete/Move Log | Last 30 mins | 1 | 2
Cloudera CDH4...

Chalanachithram.com DB » Big Data Discussions » Cloudera CDH4... « Previous Next »
Author Message
 

Gandhiguevara
Legend
Username: Gandhiguevara

Post Number: 38303
Registered: 10-2009
Posted From: 98.194.214.250

Rating: N/A
Votes: 0 (Vote!)

Posted on Monday, April 15, 2013 - 06:52 pm:       


Marocharitra:


--lines comments annatlu just use the lines below

input = load 'sample' as (line);
words = foreach input generate flatten(TOKENIZE(line)) as word;
grpd = group words by word;
cntd = foreach grpd generate group, COUNT(words);
dump cntd;
 

Gandhiguevara
Legend
Username: Gandhiguevara

Post Number: 38302
Registered: 10-2009
Posted From: 98.194.214.250

Rating: N/A
Votes: 0 (Vote!)

Posted on Monday, April 15, 2013 - 06:13 pm:       


Marocharitra:

Do we get any sample data on net to practice this? Like Persons/Customer/Employee data files ec specifically for Hadoop....


any data is good...to start with edanna text file like 'sample' lo 'GandhiGuevara is great GandhiGuevara topu GandhiGuevara turumu' ani raasi daanni copyFromLocal use chesi HDFS loki move chesi yee kindi vidham gaa cheyyi

$ Pig
$ grunt>
-- Load input from the file named Sample, and call the single
-- field in the record 'line'.
input = load 'sample' as (line);

-- TOKENIZE splits the line into a field for each word.
-- flatten will take the collection of records returned by
-- TOKENIZE and produce a separate record for each one, calling the single
-- field in the record word.
words = foreach input generate flatten(TOKENIZE(line)) as word;

-- Now group them together by each word.
grpd = group words by word;

-- Count them.
cntd = foreach grpd generate group, COUNT(words);
-- Print out the results.
dump cntd;
 

Marocharitra
Comedian
Username: Marocharitra

Post Number: 1082
Registered: 05-2008
Posted From: 66.241.32.158

Rating: N/A
Votes: 0 (Vote!)

Posted on Monday, April 15, 2013 - 01:55 pm:       


Gandhiguevara:

practice data getting in and out of HDFS and then let me know when you are ready to try out our cute PIG



Do we get any sample data on net to practice this? Like Persons/Customer/Employee data files ec specifically for Hadoop....
JP_Rocks to OT:send babu face chuste seppachu parama corrupted ani, siggu lekunda nuvvu support seyatledu? Neekenduku evathi corrupt aite? Nuvvemanna jp supporter va
 

Gandhiguevara
Legend
Username: Gandhiguevara

Post Number: 38300
Registered: 10-2009
Posted From: 98.194.214.250

Rating: N/A
Votes: 0 (Vote!)

Posted on Monday, April 15, 2013 - 12:54 pm:       


Marocharitra:

ayindhi annai.....working with other commands.


practice data getting in and out of HDFS and then let me know when you are ready to try out our cute PIG
 

Marocharitra
Comedian
Username: Marocharitra

Post Number: 1081
Registered: 05-2008
Posted From: 66.241.32.158

Rating: N/A
Votes: 0 (Vote!)

Posted on Monday, April 15, 2013 - 09:01 am:       


Gandhiguevara:



ayindhi annai.....working with other commands. :-)
JP_Rocks to OT:send babu face chuste seppachu parama corrupted ani, siggu lekunda nuvvu support seyatledu? Neekenduku evathi corrupt aite? Nuvvemanna jp supporter va
 

Gandhiguevara
Legend
Username: Gandhiguevara

Post Number: 38292
Registered: 10-2009
Posted From: 98.194.214.250

Rating: N/A
Votes: 0 (Vote!)

Posted on Sunday, April 14, 2013 - 11:39 am:       


Marocharitra:

Am I doing correct? These r like unix cmds


yes...eggzaatly...dir create ayyindhaa?
 

Marocharitra
Comedian
Username: Marocharitra

Post Number: 1080
Registered: 05-2008
Posted From: 108.196.8.133

Rating: N/A
Votes: 0 (Vote!)

Posted on Sunday, April 14, 2013 - 09:52 am:       


Gandhiguevara:



I started Applications --> Systemo Tools --> TERMINAL and practising the commands from there.
Am I doing correct? These r like unix cmds :-)
JP_Rocks to OT:send babu face chuste seppachu parama corrupted ani, siggu lekunda nuvvu support seyatledu? Neekenduku evathi corrupt aite? Nuvvemanna jp supporter va
 

Gandhiguevara
Legend
Username: Gandhiguevara

Post Number: 38282
Registered: 10-2009
Posted From: 98.194.214.250

Rating: N/A
Votes: 0 (Vote!)

Posted on Saturday, April 13, 2013 - 11:20 am:       


Marocharitra:

couldn't start FS. Pls explain how to start & where to type in the commands .


makes sense kadhaa...yours is fresh installation aka blank slate...

so try this

hadoop fs -mkdir input
hadoop fs -ls
 

Marocharitra
Comedian
Username: Marocharitra

Post Number: 1079
Registered: 05-2008
Posted From: 108.196.8.133

Rating: N/A
Votes: 0 (Vote!)

Posted on Saturday, April 13, 2013 - 10:49 am:       


Gandhiguevara:


couldn't start FS. Pls explain how to start & where to type in the commands :-(.
JP_Rocks to OT:send babu face chuste seppachu parama corrupted ani, siggu lekunda nuvvu support seyatledu? Neekenduku evathi corrupt aite? Nuvvemanna jp supporter va
 

Gandhiguevara
Legend
Username: Gandhiguevara

Post Number: 38278
Registered: 10-2009
Posted From: 98.194.214.250

Rating: N/A
Votes: 0 (Vote!)

Posted on Friday, April 12, 2013 - 06:37 pm:       


Marocharitra:


good ...practice commands like copyFromLocal and copyToLocal
 

Megapowerkkd
Comedian
Username: Megapowerkkd

Post Number: 1148
Registered: 05-2008
Posted From: 98.28.149.223

Rating: N/A
Votes: 0 (Vote!)

Posted on Friday, April 12, 2013 - 02:11 pm:       

posting from clodera virtual box.denamma chala slow ga vundhi.
YSR 7 hills ni 2 hills restrict cheddam anukonnadu..mari Jagan ekanga devudi meeda dandayatra chesthada..kalamey samadhanam cheppali.
 

Megapowerkkd
Comedian
Username: Megapowerkkd

Post Number: 1147
Registered: 05-2008
Posted From: 98.28.149.223

Rating: N/A
Votes: 0 (Vote!)

Posted on Friday, April 12, 2013 - 10:40 am:       

hadoop ni control cheyyadaniki zookeeper install avuthundhi
YSR 7 hills ni 2 hills restrict cheddam anukonnadu..mari Jagan ekanga devudi meeda dandayatra chesthada..kalamey samadhanam cheppali.
 

Megapowerkkd
Comedian
Username: Megapowerkkd

Post Number: 1146
Registered: 05-2008
Posted From: 98.28.149.223

Rating: N/A
Votes: 0 (Vote!)

Posted on Friday, April 12, 2013 - 10:37 am:       

Ippudey install chesthunna Virtual box cloudera..chala slow ga vundhi bujjidi.create sql schema daggara agindhi..let's see
YSR 7 hills ni 2 hills restrict cheddam anukonnadu..mari Jagan ekanga devudi meeda dandayatra chesthada..kalamey samadhanam cheppali.
 

Marocharitra
Comedian
Username: Marocharitra

Post Number: 1070
Registered: 05-2008
Posted From: 108.196.8.133

Rating: N/A
Votes: 0 (Vote!)

Posted on Friday, April 12, 2013 - 07:47 am:       


Gandhiguevara:

http://hadoop.apache.org/docs/r0.18.3/hdfs_shell.html

play around with these HDFS commands...kochens vunte post here



Thanks...will do that today :-)
JP_Rocks to OT:send babu face chuste seppachu parama corrupted ani, siggu lekunda nuvvu support seyatledu? Neekenduku evathi corrupt aite? Nuvvemanna jp supporter va
 

Marocharitra
Comedian
Username: Marocharitra

Post Number: 1069
Registered: 05-2008
Posted From: 108.196.8.133

Rating: N/A
Votes: 0 (Vote!)

Posted on Friday, April 12, 2013 - 07:47 am:       


Maverick:

i want to give it a shot on 4gb..aa downloaded file unpack chesaka em cheyyali



U should see virtual machine (pre-configured), if u open the file with VMPlayer.
JP_Rocks to OT:send babu face chuste seppachu parama corrupted ani, siggu lekunda nuvvu support seyatledu? Neekenduku evathi corrupt aite? Nuvvemanna jp supporter va
 

Maverick
Legend
Username: Maverick

Post Number: 44535
Registered: 01-2008
Posted From: 69.174.58.188

Rating: N/A
Votes: 0 (Vote!)

Posted on Thursday, April 11, 2013 - 10:51 pm:       

i want to give it a shot on 4gb..aa downloaded file unpack chesaka em cheyyali
Who is this DB member?

nenu anumanapu mogudu laaga jrNTR seelanni sankinchina maata nijam BUT mugguru karudugattina only balayya fans (who watched badshah tho) matladaka they certified "maakemi anipinchaledhu"
 

Gandhiguevara
Legend
Username: Gandhiguevara

Post Number: 38276
Registered: 10-2009
Posted From: 98.194.214.250

Rating: N/A
Votes: 0 (Vote!)

Posted on Thursday, April 11, 2013 - 10:45 pm:       


Marocharitra:


http://hadoop.apache.org/docs/r0.18.3/hdfs_shell.html

play around with these HDFS commands...kochens vunte post here
 

Marocharitra
Comedian
Username: Marocharitra

Post Number: 1068
Registered: 05-2008
Posted From: 108.196.8.133

Rating: N/A
Votes: 0 (Vote!)

Posted on Thursday, April 11, 2013 - 10:24 pm:       

Gg, Upgraded RAM to 8GB. VMplayer performance is much better & Posting from Cloudera CDH now :-). What next...?
JP_Rocks to OT:send babu face chuste seppachu parama corrupted ani, siggu lekunda nuvvu support seyatledu? Neekenduku evathi corrupt aite? Nuvvemanna jp supporter va
 

Gandhiguevara
Legend
Username: Gandhiguevara

Post Number: 38194
Registered: 10-2009
Posted From: 98.194.214.250

Rating: N/A
Votes: 0 (Vote!)

Posted on Sunday, April 07, 2013 - 09:17 pm:       

Next weekend nundi serious gaa start avudhaam anukune vallu DL it this week
 

Rudraksha
Comedian
Username: Rudraksha

Post Number: 1087
Registered: 07-2012
Posted From: 70.181.57.58

Rating: N/A
Votes: 0 (Vote!)

Posted on Sunday, April 07, 2013 - 09:18 pm:       


Gandhiguevara:

vallu DL it this week


 

Rudraksha
Comedian
Username: Rudraksha

Post Number: 1088
Registered: 07-2012
Posted From: 70.181.57.58

Rating: N/A
Votes: 0 (Vote!)

Posted on Sunday, April 07, 2013 - 09:19 pm:       


Gandhiguevara:


idemi twist, posts taru mary ayyay. naa kallani nammalekapotunna rao garu
 

Gandhiguevara
Legend
Username: Gandhiguevara

Post Number: 38199
Registered: 10-2009
Posted From: 98.194.214.250

Rating: N/A
Votes: 0 (Vote!)

Posted on Sunday, April 07, 2013 - 09:26 pm:       

http://www.cloudera.com/content/cloudera-content/cloudera-do cs/DemoVMs/3.13.2013/CDH4-Demo-VM/cdh4dvm_topic_3.html?scrol l=topic_3_unique_2
 

Gandhiguevara
Legend
Username: Gandhiguevara

Post Number: 38200
Registered: 10-2009
Posted From: 98.194.214.250

Rating: N/A
Votes: 0 (Vote!)

Posted on Sunday, April 07, 2013 - 09:26 pm:       

top down approach follow avuthunnam yeeda
 

Sasibabu
Hero
Username: Sasibabu

Post Number: 16227
Registered: 11-2009
Posted From: 76.185.191.220

Rating: N/A
Votes: 0 (Vote!)

Posted on Sunday, April 07, 2013 - 09:54 pm:       


Gandhiguevara:


nee yenkamma Rakesh..... Oka dhaniki fix avvu.... Hadoop/ bugdata/ mongodb/ cloudera .... Itta rojukokkati seppi mammalni insult seyamaaku
kikiki
 

Goonda
Megastar
Username: Goonda

Post Number: 23482
Registered: 02-2007
Posted From: 75.66.158.123

Rating: N/A
Votes: 0 (Vote!)

Posted on Sunday, April 07, 2013 - 09:59 pm:       


Sasibabu:

Hadoop/ bugdata/ mongodb/ cloudera



cloudera --> os
hadoop --> implementation name
mangodb --> no sql db
big-data --?
Sasibabu: If TDP loses next elechens, i will donate 10% of my salary to TDP

Skywalker: Bala chiru type kadu.....narasimha swamy avataram etti posani gadi pegulu medalo esukuntadu
 

Rudraksha
Comedian
Username: Rudraksha

Post Number: 1089
Registered: 07-2012
Posted From: 70.181.57.58

Rating: N/A
Votes: 0 (Vote!)

Posted on Sunday, April 07, 2013 - 10:12 pm:       


Goonda:

cloudera --> os
hadoop --> implementation name
mangodb --> no sql db
big-data --?



cloudera---company providing solutions
hadoop: it is a file system
mongodb: it is a nosql database
big-data: new concept which is different from RDMS concepts and primarily uses file system based databases like mongodb, etc to handle big data.
 

Marocharitra
Comedian
Username: Marocharitra

Post Number: 1060
Registered: 05-2008
Posted From: 66.241.32.158

Rating: N/A
Votes: 0 (Vote!)

Posted on Monday, April 08, 2013 - 01:50 pm:       


Gandhiguevara:


Gg, I downloaded the image and it was too slow when I tried to open it on my desktop through VMPlayer (RAM 4GB only :-( )
Going to order addtional 4GB today, and will keep you guys posted.
JP_Rocks to OT:send babu face chuste seppachu parama corrupted ani, siggu lekunda nuvvu support seyatledu? Neekenduku evathi corrupt aite? Nuvvemanna jp supporter va
 

Maverick
Legend
Username: Maverick

Post Number: 44345
Registered: 01-2008
Posted From: 70.39.176.116

Rating: N/A
Votes: 0 (Vote!)

Posted on Monday, April 08, 2013 - 04:35 pm:       

downloading now

4gb ram laptop work avutunda? i5?
Who is this DB member?

nenu anumanapu mogudu laaga jrNTR seelanni sankinchina maata nijam BUT mugguru karudugattina only balayya fans (who watched badshah tho) matladaka they certified "maakemi anipinchaledhu"
 

Gandhiguevara
Legend
Username: Gandhiguevara

Post Number: 38206
Registered: 10-2009
Posted From: 98.194.214.250

Rating: N/A
Votes: 0 (Vote!)

Posted on Monday, April 08, 2013 - 06:29 pm:       


Maverick:

4gb ram laptop work avutunda? i5?


hmmm min 6GB RAM vunte better antunnadu vaade

Add Your Message Here
Post:
Bold text Italics Underline Create a hyperlink Insert a clipart image HASH(0xd97ef8){Movie Clipart}
Show / hide regular icons selection options

Click on following links to open cliparts by Alphabetical Order

 A   B   C   D   E   F   G   H   I   J   K   L   M  

N   O   P   Q   R   S   T   U   V   W   X   Y   Z  

Show / Hide Filmy icons selection options

Click on following links to open cliparts by Alphabetical Order

  A   B   C   D   E   F   G   H   I   J   K   L   M  

N   O   P   Q   R   S   T   U   V   W   X   Y   Z  

Username: Posting Information:
This is a private posting area. Only registered users and moderators may post messages here.
Password:
Options: Enable HTML code in message
Automatically activate URLs in message
Action: