Topics | Search Log Out | Register | Edit Profile
Hide Clipart | Banned/Unbanned User Log | Moderator Login History | Thread Delete/Move Log | Last 30 mins | 1 | 2
Learning Big data and Hadoop

Chalanachithram.com DB » New TF Industry Related » Archive through May 10, 2017 » Learning Big data and Hadoop « Previous Next »
Author Message
 

Viswamitra
Junior Artist
Username: Viswamitra

Post Number: 87
Registered: 09-2015
Posted From: 2.30.30.99

Rating: N/A
Votes: 0 (Vote!)

Posted on Wednesday, May 10, 2017 - 05:53 pm:       

I have been working on Pyspark for 2 years now..
If you want to choose Datascientist as your path, this is the way I can suggest
Learn python or scala. I prefer python.
Get yourself familiar with pandas, scikit, numpy etc.,
Understand Mapreduce.
Start with spark.
Pick few datasets and try to cleanse them and convert them into dataframes and start playing with them.
Get hands on working with raw data in csv, Excel, Jason, parquet etc.,
Start with Mlib. Try to apply regression and other models.
There are hundreds of complimentary tools to do different jobs, don't start with them you will be lost.
Understand what is hive and finally get grip over one no sql db.
Try to pick as many use cases as possible and start solving them using above Mlib and other techniques you learn above..

You basically need cloudera sample env to play. Learn Linux commands and is important as spark usually runs on Linux servers. Almost all edge and data nodes will have Linux OS. At least those I know.
 

Mental_sachinodu
Hero
Username: Mental_sachinodu

Post Number: 19978
Registered: 10-2008
Posted From: 50.241.19.41

Rating: N/A
Votes: 0 (Vote!)

Posted on Wednesday, May 10, 2017 - 09:33 am:       


Gtk:


Agree with what you said.... But... Old generation (GC & EAD) has expertise in only one thing but present generation has along with expertise in one area.. they also have idea of other areas too...




its a natural progression. knowledge and skill are two different things. typically younger generation has skills, and limited expertise. older generation has expertise.

Machine learning has been alive in the fringes of comp science since 60s, glad to see its getting main stream. this is one my primary research areas.
 

Vijay_neninthe
Junior Artist
Username: Vijay_neninthe

Post Number: 51
Registered: 05-2017
Posted From: 157.48.2.90

Rating: N/A
Votes: 0 (Vote!)

Posted on Wednesday, May 10, 2017 - 01:05 am:       

Dinemma em course looko... Manchiga gvrmnt job kottukuni prashantanga chesukobuddi avtundi.. Kaani package lu emo itu tempting ga untai... Yeti sesedhii
 

Gtk
Side Hero
Username: Gtk

Post Number: 2335
Registered: 06-2015
Posted From: 175.101.137.12

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:58 pm:       


Emc2:

unless we are writing algorithms institutes lo vallu cheppedi emuntadi

if we are using API's koncham exp unte easy ga grasp cheyochu

better do some research and watch youtube videos before joing any courses..




Its a new tech and you need to start from some where right?

Those institutes atleast provide placement assistance... Musigma, etc are frequent recruiters there...
 

Gtk
Side Hero
Username: Gtk

Post Number: 2334
Registered: 06-2015
Posted From: 175.101.137.12

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:56 pm:       


Andhravodu:

nenu antaku minchi unnaaa, Indian h1b lu anta copy rayudu batch. pitta konchem koota ghanam, idi naa experience




I agree... which was the result of old batch greed... started from body shops and to joining the dumb wife's too into the organization... what else you expect from the freshers.. who needs a team of min 8 years experience for SAP implementation... seriously..even for testing, Associates, ???

Even though H1 batch are copy rayudus... they were miles ahead of where the present GC & EAD & Seniors had started their career....
 

Emc2
Legend
Username: Emc2

Post Number: 53789
Registered: 03-2008
Posted From: 71.126.165.28

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:53 pm:       


Gtk:

Course work is maiNly on ML...




unless we are writing algorithms institutes lo vallu cheppedi emuntadi

if we are using API's koncham exp unte easy ga grasp cheyochu

better do some research and watch youtube videos before joing any courses..
 

Gtk
Side Hero
Username: Gtk

Post Number: 2333
Registered: 06-2015
Posted From: 175.101.137.12

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:51 pm:       

.

Vjawarrior:

bro...hyd lo oka top notch institue undi....70k anta ...IIT's train chestunnaru....data scientist ane program anta deeni peru...best to get trained there....3 months program anukunta idi.....phd's also there....who are training




Insofe?

Good institute with weekend program.. Course work is maiNly on ML...

Other good institutes are Aegis & Praxis.. other than this.. rest are waste....especially, Ameerpet institutes, Naresh, Kelly, etc... if you got contacts.. better to join in these institutes.. or else.. better to join in colleges..
 

Gtk
Side Hero
Username: Gtk

Post Number: 2332
Registered: 06-2015
Posted From: 175.101.137.12

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:45 pm:       


Emc2:




Agree with what you said.... But... Old generation (GC & EAD) has expertise in only one thing but present generation has along with expertise in one area.. they also have idea of other areas too...
 

Andhravodu
Moderator
Username: Andhravodu

Post Number: 8875
Registered: 07-2015

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:43 pm:       


Gtk:


btw, typing at 120 wpm is a software qualification?

data entry operator ni pettukunnava? even then, open challenge, I type faster than you or anybody you can bring. And my online typing score is around 90wpm basically
 

Gtk
Side Hero
Username: Gtk

Post Number: 2331
Registered: 06-2015
Posted From: 175.101.137.12

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:41 pm:       


Mamamiya786:




No...Data Analyst come in only at middle layer (Data Analyst = Who Analyze Data Sets extracted from a data base) .. A Data scientist primary role is to create models with variables (Say linear equations X+Y = A)....for that he need to be well aware of linear algebra, stats, etc...

Data Sets created by Data analyst will be used by the end user/Data Analyst along with the models with variables created by Data scientist to predict the results...


But the course work in many institutes are projecting Data Analyst role too under data science....
 

Andhravodu
Moderator
Username: Andhravodu

Post Number: 8874
Registered: 07-2015

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:39 pm:       


Gtk:


nenu antaku minchi unnaaa, Indian h1b lu anta copy rayudu batch. pitta konchem koota ghanam, idi naa experience
 

Vjawarrior
Megastar
Username: Vjawarrior

Post Number: 29923
Registered: 02-2014
Posted From: 68.53.21.199

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:35 pm:       


Mamamiya786:


real analystics develop cheyalante statistics baga ravalai ..ma office lo data science ante andaru phd lu ... spark programming chestu ...edo chestuntaru .


bro...hyd lo oka top notch institue undi....70k anta ...IIT's train chestunnaru....data scientist ane program anta deeni peru...best to get trained there....3 months program anukunta idi.....phd's also there....who are training
 

Emc2
Legend
Username: Emc2

Post Number: 53785
Registered: 03-2008
Posted From: 71.126.165.28

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:34 pm:       


Gtk:

dont know about Simple Internet protocols, Network settings, etc... all they know is to how to take advantage of other's situation..




okadiki technology brain untadi,okadiki political brain,okadiki business brain

anni kalisthene organization,

don't everybody should do protocols and net working..

evadi talent ni patti vadu game play chesthadu..
 

Gtk
Side Hero
Username: Gtk

Post Number: 2330
Registered: 06-2015
Posted From: 175.101.137.12

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:31 pm:       


Andhravodu:




Especially present GC & Citizen candidates (people who entered US 15-20 years back)... they got into US when there was dearth of resources in even a tech like QA (Dont ask about SAP) .. Even now, after 15 years into IT.. they cant even type @120 WPM, dont know about Simple Internet protocols, Network settings, etc... all they know is to how to take advantage of other's situation....
 

Mamamiya786
Megastar
Username: Mamamiya786

Post Number: 20036
Registered: 06-2008
Posted From: 69.109.128.225

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:31 pm:       

data scintist ...kinda chala vastai ...data analyst ni kuda scitists antunnaru ..spark programmer and hive programmer too ...

It is still evolving..

real analystics develop cheyalante statistics baga ravalai ..ma office lo data science ante andaru phd lu ... spark programming chestu ...edo chestuntaru ....
Sensation(About Bala):He can win in atleast half of the segments in Rayalaseema. Emi matladutunnavo neeku telusa. He can contest any where in coastal and rayalaseema districts. I personally feel he should contest from Srikakulam dt.

Jagan|Modi|
 

Emc2
Legend
Username: Emc2

Post Number: 53784
Registered: 03-2008
Posted From: 71.126.165.28

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:30 pm:       


Andhravodu:




bongu nuvvu ikkada evaro create chesina Db lo posts veyadam ledu,

adedo nee sontham ga DB create chesi posts esthunattu

ellehe

 

Gtk
Side Hero
Username: Gtk

Post Number: 2329
Registered: 06-2015
Posted From: 175.101.137.12

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:24 pm:       


Andhravodu:




Yup... I stayed in US for 3 years.. and thats what is my experience....there may be exceptions always..
 

Andhravodu
Moderator
Username: Andhravodu

Post Number: 8873
Registered: 07-2015

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:21 pm:       


Emc2:

Java lo API unnayi

Unless you are writing algorithms it's same as regular programming


evaro chesindi vadestava brain takkuva, baggage fellow :-)
 

Emc2
Legend
Username: Emc2

Post Number: 53783
Registered: 03-2008
Posted From: 71.126.165.28

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:18 pm:       

AI and machine learning lo manam podichesedi emi ledu

Java lo API unnayi

Unless you are writing algorithms it's same as regular programming
 

Andhravodu
Moderator
Username: Andhravodu

Post Number: 8872
Registered: 07-2015

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:10 pm:       


Gtk:

GC's, EAD candidates..they cannt risk and dont have that much brain to learn those


 

Maverick
Legend
Username: Maverick

Post Number: 64350
Registered: 01-2008
Posted From: 108.171.130.187

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:09 pm:       

https://www.linkedin.com/pulse/why-i-left-my-masters-program -charles-pensig-1
Happy Vizag
 

Gtk
Side Hero
Username: Gtk

Post Number: 2328
Registered: 06-2015
Posted From: 175.101.137.12

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 11:08 pm:       

Future is with ML & AI which are areas of Data science.. get into those with proper base (Math, Stats, Electronics)... if you are starting your career..then no need to worry for at-least for 20 years...
 

Gtk
Side Hero
Username: Gtk

Post Number: 2327
Registered: 06-2015
Posted From: 175.101.137.12

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 10:59 pm:       


Telugodu:




Not an easy task bro....but possible in 8-10 months....

NPTEL... register into Math courses... 1 to 4 sem... hardly...3 to 4 months.... (even if courses are not live... there are courses which are already finished... you can follow them.... so that you can get hold of math part... Get the crux/concept... you are not attempting for a Btech certificate or semester exams... just get deep into the concept....

Apart...get soME moocS on R, Python from course era, etc. free courses, (Optional: on top of it if you add Big Data, Hadoop, etc)....at-least for 15-20 years you are set...H1,GC ni chetelo pedtaru... there are no resources as of now.. and GC's, EAD candidates..they cannt risk and dont have that much brain to learn those.....considering their family baggage too...

Its best plan for a fresher or who is ready to take a risk and shift career... but had to fully devote at-least 6-8 months time..ATB
 

Telugodu
Junior Artist
Username: Telugodu

Post Number: 615
Registered: 06-2014
Posted From: 24.92.137.222

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 10:48 pm:       


Mamamiya786:

basics ga , hive , sqoop , flume ,kafka anni ravali ..spark kanukua vaste you are good.
Hbase , hdfs anni touch cheyandi oka sari




Iventi bhayya inni unnayi pallinpotlam laga...thanks for the info..someone gave course on udemy as a starter...thx..
 

Telugodu
Junior Artist
Username: Telugodu

Post Number: 613
Registered: 06-2014
Posted From: 24.92.137.222

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 10:45 pm:       


Gtk:

So, its better to get into Data science



Oka 1 year kinda deeni gurinchi alochincha..but as usual ga vadilesa edo teliyani bhayam tho..I am not that great at math..andukemo..

But will sure rethink About it now...edanna college join avvala? What options do we have? Ade chetho suggestions ivvandi bro
 

Telugodu
Junior Artist
Username: Telugodu

Post Number: 612
Registered: 06-2014
Posted From: 24.92.137.222

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 10:41 pm:       


Ferrari:



Thanks for the info bro..nuvve live example kada bro.. course chesi support chestunnav..good job :-)
 

Gtk
Side Hero
Username: Gtk

Post Number: 2326
Registered: 06-2015
Posted From: 175.101.137.12

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 10:34 pm:       

leave every technology out there.... if you want to get into the bandwagon of next 10-20 years....get into Data science...

Big data, Hadoop, etc... (data analysis side)..there are many resources already available and are getting into the tech, rapidly than SAP....

So, its better to get into Data science..with specialization in AI and ML.... But the subject is tough and its right time to take some time and get expertise....

Its a golden era for EEE, EIE and ECE guys....
 

Mamamiya786
Megastar
Username: Mamamiya786

Post Number: 20034
Registered: 06-2008
Posted From: 69.109.128.225

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 10:06 pm:       


Ferrari:

but ikkada desi consultancies ki client tho antha grip undadhu kadha..




project nadustunte ... ...relation tho sambandham emundi thokka...

oka sari job lo padithe years years lagistaru janalu ...
Sensation(About Bala):He can win in atleast half of the segments in Rayalaseema. Emi matladutunnavo neeku telusa. He can contest any where in coastal and rayalaseema districts. I personally feel he should contest from Srikakulam dt.

Jagan|Modi|
 

Mamamiya786
Megastar
Username: Mamamiya786

Post Number: 20033
Registered: 06-2008
Posted From: 69.109.128.225

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 10:04 pm:       


Ferrari:

aku inkka ardham kani vishayam enti ante itta chinna chinna courses chesi real time experience lekunda interviews ela crack chestharo..project lo ela gadipestharo teluvadhu.




ei prasna nuvvu inthaku mundu kuda vesinattunnav ...

any way 1, 2 interviews attendd aithe ade vastadi...
Sensation(About Bala):He can win in atleast half of the segments in Rayalaseema. Emi matladutunnavo neeku telusa. He can contest any where in coastal and rayalaseema districts. I personally feel he should contest from Srikakulam dt.

Jagan|Modi|
 

Andhravodu
Moderator
Username: Andhravodu

Post Number: 8868
Registered: 07-2015

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 10:01 pm:       


Ferrari:

client tho manchi relation valla edho oka maata cheppi nadipistaru bhayya


client relation unte emaina cheyochu anna maata

project mottaniki oka 2-3 good members ni pettedi, rest 2 weeks training. idi good relation
 

Ferrari
Hero
Username: Ferrari

Post Number: 12178
Registered: 10-2008
Posted From: 108.171.131.188

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 09:44 pm:       


Andhravodu:

witch companies 2 weeks training ichi 3 years expert antaru. idi kooda ante


witch companies aithe client tho manchi relation valla edho oka maata cheppi nadipistaru bhayya...but ikkada desi consultancies ki client tho antha grip undadhu kadha..
 

Andhravodu
Moderator
Username: Andhravodu

Post Number: 8865
Registered: 07-2015

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 09:38 pm:       


Ferrari:


witch companies 2 weeks training ichi 3 years expert antaru. idi kooda ante
 

Ferrari
Hero
Username: Ferrari

Post Number: 12177
Registered: 10-2008
Posted From: 108.171.131.188

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 09:32 pm:       


Telugodu:


nerchukunte interesting gane untadhi bhayya..nenu aithe Edureka course complete chesa..presently working on Hadoop support project..nenu nerchukundhi okati..ikkada chesedhi okati..:D..naku inkka ardham kani vishayam enti ante itta chinna chinna courses chesi real time experience lekunda interviews ela crack chestharo..project lo ela gadipestharo teluvadhu...:D
 

Ruj
Megastar
Username: Ruj

Post Number: 21256
Registered: 03-2007
Posted From: 24.118.19.194

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 09:22 pm:       


Pepsi:

ya he posted in DB, he is spending $1mil to get GC in eb5, it is in process..

baaga success ayyadu, india lo kuda companies peduthunnadu




woww....awesome..
 

Pepsi
Comedian
Username: Pepsi

Post Number: 1122
Registered: 04-2015
Posted From: 98.159.111.68

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 09:11 pm:       


Ruj:




ya he posted in DB, he is spending $1mil to get GC in eb5, it is in process..

baaga success ayyadu, india lo kuda companies peduthunnadu
 

Ruj
Megastar
Username: Ruj

Post Number: 21255
Registered: 03-2007
Posted From: 24.118.19.194

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 08:54 pm:       


Pepsi:

Contact gandhi guvera,H1 meeda undi hadoop lo job chesi consulting petti millions sampadinchadu


He is actively placing candidates




gagu ki intha backgrnd undha..
 

Pepsi
Comedian
Username: Pepsi

Post Number: 1120
Registered: 04-2015
Posted From: 98.159.111.68

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 08:47 pm:       

Contact gandhi guvera,H1 meeda undi hadoop lo job chesi consulting petti millions sampadinchadu


He is actively placing candidates
 

Mamamiya786
Megastar
Username: Mamamiya786

Post Number: 20020
Registered: 06-2008
Posted From: 69.109.128.225

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 08:41 pm:       

ETL guys ki good back ground kinda lekka.

Bigdata course edureka lo 250 ki vutnundi aid cheyandi...
idea vastundi ...then start from there.

basics ga , hive , sqoop , flume ,kafka anni ravali ..spark kanukua vaste you are good.
Hbase , hdfs anni touch cheyandi oka sari .

Big data manchi candidates leru ...interview kanuka cheya galigite ... guarantee job.
makret vuntundi billing matuku 60 to 90.
Sensation(About Bala):He can win in atleast half of the segments in Rayalaseema. Emi matladutunnavo neeku telusa. He can contest any where in coastal and rayalaseema districts. I personally feel he should contest from Srikakulam dt.

Jagan|Modi|
 

Gochi
Side Hero
Username: Gochi

Post Number: 2835
Registered: 12-2006
Posted From: 64.121.67.210

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 08:38 pm:       

Adoka ocean saami...evadu enduku em peekuthunnaaro vaallake theliyadhu...just do google and start reading abt it.....after a few readings neekey clarity ochhuddhi nobody knows anything ani...aaa naalugu buzz words nuvvu koodaa maattaadu, king vaipothaav...i am not kidding..l
 

Twitter
Legend
Username: Twitter

Post Number: 52227
Registered: 10-2009
Posted From: 136.56.39.203

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 08:10 pm:       

Buzz chesinantha market emi kanapadaledhu naku anduke nerchukoni kooda marchipoya
 

Telugodu
Junior Artist
Username: Telugodu

Post Number: 611
Registered: 06-2014
Posted From: 24.92.137.222

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 08:01 pm:       

Enti bhayyas ila thokkestunnaru ee thread ni
 

Telugodu
Junior Artist
Username: Telugodu

Post Number: 610
Registered: 06-2014
Posted From: 174.232.134.127

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 02:25 pm:       

Bump
 

Telugodu
Junior Artist
Username: Telugodu

Post Number: 609
Registered: 06-2014
Posted From: 174.232.134.127

Rating: N/A
Votes: 0 (Vote!)

Posted on Tuesday, May 09, 2017 - 12:52 pm:       

Hi folks, etl background undi..java ala ala chadavagalanu...likh nahi sakta.

Bigdata and hadoop buzzwords vini vini chevulu chillulu paddayi...kaani ipudu nerchukoka tapatledu...consulting world lo unna.

Dayachesi maanchi material ekkadanna unte share cheyandi..how to start n where to start no idea...pls advice.thanks

Add Your Message Here
Post:
Bold text Italics Underline Create a hyperlink Insert a clipart image HASH(0x954184c){Movie Clipart}
Show / hide regular icons selection options

Click on following links to open cliparts by Alphabetical Order

 A   B   C   D   E   F   G   H   I   J   K   L   M  

N   O   P   Q   R   S   T   U   V   W   X   Y   Z  

Show / Hide Filmy icons selection options

Click on following links to open cliparts by Alphabetical Order

  A   B   C   D   E   F   G   H   I   J   K   L   M  

N   O   P   Q   R   S   T   U   V   W   X   Y   Z  

Username: Posting Information:
This is a public posting area. Enter your username and password if you have an account. Otherwise, enter your full name as your username and leave the password blank. Your e-mail address is optional.
Password:
E-mail:
Options: Enable HTML code in message
Automatically activate URLs in message
Action: