Leveling chirongwa chekuwana iyo profession Data mainjiniya

Kwemakore masere apfuura ndanga ndichishanda semaneja weprojekiti (ini handinyore kodeti kubasa), izvo zvinongokanganisa zvinokanganisa yangu tekinoroji backend. Ndakafunga kuvhara gap rangu retekinoroji nditore hunyanzvi hweData engineer. Hunyanzvi hwepakati hweData Injiniya kugona kugadzira, kuvaka, uye kuchengetedza matura edata.

Ndakaita chirongwa chekudzidzisa, ndinofunga kuti chichabatsira kwete ini chete. Hurongwa uhu hwakanangana nezvidzidzo zvekuzvidzidza wega. Kunyanya kupihwa kune makosi emahara muRussia.

Zvikamu:

• Algorithms uye data zvimiro. Chikamu chinokosha. Dzidza uye zvimwe zvese zvichashanda zvakare. Izvo zvakakosha kuti uise maoko ako pane kodhi uye shandisa zvakakosha zvimiro uye algorithms.
• Databases uye data warehouses, Bhizinesi Intelligence. Isu tiri kufamba kubva kualgorithms kuenda kukuchengetedza data uye kugadzirisa.
• Hadoop uye Big Data. Kana iyo dhatabhesi isingabatanidzwe pane hard drive, kana iyo data painoda kuongororwa, asi Excel haichakwanise kuaisa, data hombe inotanga. Mukuona kwangu, zvakakosha kuenderera kune chikamu ichi chete mushure mekudzidza kwakadzama kwezviviri zvakapfuura.

Algorithms uye data zvimiro

Muchirongwa changu, ndakasanganisira kudzidza Python, kudzokorora izvo zvekutanga zvemasvomhu uye algorithmization.

• Kuronga muPython
• Python: Basics uye Applications
• Linear algebra
• Likbez pa discrete mathematics
• Algorithms: dzidziso uye maitiro. Nzira
• Algorithms: dzidziso uye maitiro. Data Structures

Databases uye data warehouses, Bhizinesi Intelligence

• Bhuku: Martin Kleppman - Yakanyanya kurodha zvikumbiro. Kuronga, kuyera, kutsigirwa. Iri bhuku rinotsanangura mashandisirwo emhando dzakasiyana dze data, kuita kwavo kubva mukati, zvisingakwanisi uye sarudzo zvichienderana nebasa.
• Nhanganyaya kune databases
• Dzvanya muDBMS
• Nhanganyaya kune dzisiri dzehukama dhatabhesi

Misoro ine chekuita nekuvaka matura edatha, ETL, OLAP cubes inotsamira zvakanyanya pamaturusi, saka ini handipe zvinongedzo kumakosi ari mugwaro iri. Zvinokurudzirwa kudzidza masisitimu akadaro paunenge uchishanda pane imwe purojekiti mune imwe kambani. Kuti uzive neETL, unogona kuedza Talend kana wokufema.

Sekuona kwangu, zvakakosha kuti udzidze yemazuva ano Data Vault dhizaini nzira link 1, link 2. Uye nzira yakanakisa yekuidzidza ndeyekuitora nekuishandisa nemuenzaniso wakapfava. Kune akati wandei Data Vault kuita mienzaniso paGitHub ссылка. The Modern Data Warehouse Book: Kuenzanisira iyo Agile Data Warehouse neData Vault naHans Hultgren.

Kuti ujairane neBusiness Intelligence maturusi evashandisi vekupedzisira, unogona kushandisa yemahara dhizaini yemishumo, madhibhodhi, mini data warehouse Power BI Desktop. Zvishandiso zvekudzidzisa: link 1, link 2.

Hadoop uye Big Data

• Iwe unofanirwa kutanga nekuita kwakazvimirira kweMepuReduce pasina echitatu-bato raibhurari. Izvi zvinobvumira kunzwisiswa kuri nani kwema multithreaded kuitiswa mune ramangwana. Muenzaniso wakanakisa muPython unotsanangurwa pano.
• Hadoop. Sisitimu yekugadzira yakawanda data.
• Nhanganyaya kuBig Data Engineering

mhedziso

Hazvisi zvese zvaunodzidza zvinogona kushandiswa kubasa. Naizvozvo, iwe unoda chirongwa chekupedza kudzidza umo iwe uchaedza kushandisa ruzivo rutsva.

Iko hakuna misoro ine chekuita nekuongororwa kwedata uye Kudzidza kweMuchina muchirongwa. izvi zvinoshanda zvakanyanya kune iyo Data Scientist profession. Iko hakuna zvakare misoro ine chekuita neAWS makore, Azure. madingindira aya anoenderana zvakanyanya nesarudzo yepuratifomu.

Mibvunzo kunharaunda:
Hurongwa hwangu hwekuyera hwakakwana zvakadii? Chii chokubvisa kana kuwedzera?
Ndechipi chirongwa chaungakurudzira sechinyorwa?

Source: www.habr.com