Kab lus no hais txog qhov yooj yim tshaj plaws thiab ceev tshaj plaws nrhiav cov ntaub ntawv, cov haujlwm uas koj pom ntawm KDPV. Interestingly, whale yog tsim los tuav ntawm lub chaw taws teeb git server. Paub meej hauv qab txiav.
Yuav ua li cas Airbnb's Data Discovery Tool hloov kuv lub neej
Hauv kuv txoj haujlwm, kuv tau txaus siab ua haujlwm ntawm qee qhov teeb meem lom zem: Kuv kawm lej lej thaum ua kuv daim ntawv kawm tiav ntawm MIT, ua haujlwm ntawm cov qauv ntxiv, thiab nrog rau qhov qhib qhov project ntawm Wayfair, thiab tau siv lub hom phiaj homepage tshiab thiab kev txhim kho CUPED ntawm Airbnb. Tab sis tag nrho cov hauj lwm no yeej tsis yog qhov zoo tshaj plaws - qhov tseeb, kuv feem ntau siv kuv lub sij hawm los tshawb nrhiav, tshawb nrhiav, thiab txheeb xyuas cov ntaub ntawv. Txawm hais tias qhov no yog lub xeev tas li ntawm kev ua haujlwm, nws tsis tshwm sim rau kuv tias qhov no yog qhov teeb meem txog thaum kuv tau mus rau Airbnb qhov chaw nws tau daws nrog cov ntaub ntawv tshawb pom - .
Kuv tuaj yeem nrhiav tau {{data}} qhov twg? dataportal.
Kab lus no txhais li cas? dataportal.
Hnub no {{metric}} ua li cas? dataportal.
Kev xav ntawm lub neej yog dab tsi? IN dataportal, tej zaum.
Okay, koj tau nthuav tawm daim duab. Nrhiav cov ntaub ntawv thiab nkag siab tias nws txhais li cas, nws tau tsim li cas thiab siv nws li cas yuav siv sijhawm li ob peb feeb xwb, tsis yog teev. Kuv tuaj yeem siv kuv lub sijhawm los kos cov lus xaus yooj yim, lossis cov algorithms tshiab, (β¦ lossis teb cov lus nug random txog cov ntaub ntawv), tsis yog khawb los ntawm kev sau ntawv, sau cov lus nug SQL rov ua dua, thiab hais txog cov npoj yaig ntawm Slack sim thiab rov tsim cov ntsiab lus. muaj.
Qhov teeb meem yog dab tsi?
Kuv pom tau hais tias feem ntau ntawm kuv cov phooj ywg tsis tau nkag mus rau cov cuab yeej zoo li no. Ob peb lub tuam txhab txaus siab muab cov peev txheej loj los tsim thiab tswj hwm lub platform zoo li Dataportal. Thiab thaum muaj ob peb qhov kev daws teeb meem, lawv zoo li tsim los ntsuas, ua rau nws nyuaj rau kev teeb tsa thiab tswj tsis tau tus kws tshaj lij DevOps. Yog li kuv txiav txim siab los tsim ib yam dab tsi tshiab.
Whale: Ib qho yooj yim stupidly cov ntaub ntawv nrhiav pom
Thiab yog, los ntawm stupidly yooj yim kuv txhais tau tias stupidly yooj yim. Lub whale tsuas muaj ob yam:
- Lub tsev qiv ntawv Python uas sau cov metadata thiab tsim nws hauv MarkDown.
- Rust hais kom ua kab interface rau kev tshawb nrhiav los ntawm cov ntaub ntawv no.
Los ntawm qhov kev pom ntawm cov txheej txheem sab hauv rau kev saib xyuas, tsuas muaj ntau cov ntawv nyeem thiab ib qho kev pab cuam uas hloov kho cov ntawv nyeem. Qhov ntawd yog nws, yog li hosting ntawm git server zoo li Github yog qhov tsis tseem ceeb. Tsis muaj lus nug tshiab los kawm, tsis muaj kev tswj hwm kev tswj hwm, tsis muaj thaub qab. Txhua tus paub Git, yog li kev sib koom ua ke thiab kev sib koom tes yog dawb. Cia peb saib ze dua ntawm qhov ua haujlwm .
Tag nrho featured git-based GUI
Whale yog tsim los ua luam dej hauv dej hiav txwv ntawm chaw taws teeb git server. Nws configurable: txhais qee qhov kev sib txuas, luam cov ntawv Github Actions (lossis sau ib qho rau koj xaiv CI / CD platform) thiab koj yuav muaj cov ntaub ntawv tshawb pom lub vev xaib tam sim ntawd. Koj tuaj yeem tshawb nrhiav, saib, sau ntawv thiab qhia koj cov ntawv tshaj tawm ncaj qha ntawm Github.
Ib qho piv txwv ntawm cov lus stub tsim siv Github Actions. Ua haujlwm tag nrho demo .
xob laim ceev CLI tshawb rau koj lub chaw cia khoom
Whale nyob thiab ua pa ntawm kab hais kom ua, muab lub zog, millisecond lookups thoob plaws koj lub rooj. Txawm hais tias muaj ntau lab lub rooj, peb tau tswj xyuas kom whale ua tau zoo kawg nkaus los ntawm kev siv qee cov cuab yeej ntse caching thiab tseem los ntawm kev tsim kho lub backend hauv Rust. Koj yuav tsis pom muaj kev tshawb nrhiav ncua [nyob zoo Google DS].
Whale demo, lab lub rooj nrhiav.
Tsis siv neeg suav ntawm metrics [hauv beta]
Ib yam uas kuv nyiam tshaj plaws raws li tus kws tshawb fawb cov ntaub ntawv tab tom khiav tib cov lus nug ntau zaus tsuas yog los xyuas qhov zoo ntawm cov ntaub ntawv siv. Whale txhawb nqa lub peev xwm los txhais cov metrics hauv SQL dawb uas yuav teem caij khiav nrog koj cov metadata ntxuav cov kav dej. Txhais lub YAML metrics thaiv nyob rau hauv lub stub rooj, thiab Whale yuav cia li khiav ntawm lub sij hawm thiab khiav queries nested nyob rau hauv metrics.
```metrics
metric-name:
sql: |
select count(*) from table
```
Ua ke nrog Github, txoj hauv kev no txhais tau tias whale tuaj yeem ua qhov yooj yim hauv nruab nrab ntawm qhov tseeb rau cov ntsiab lus metric. Whale txawm txuag cov nqi nrog rau lub sij hawm nyob rau hauv lub "~/ . whale / metrics" yog tias koj xav ua qee daim duab lossis ntau qhov kev tshawb fawb tob.
Yav tom ntej
Tom qab tham nrog cov neeg siv ntawm peb qhov kev tso tawm ua ntej ntawm whale, peb pom tau tias tib neeg xav tau kev ua haujlwm ntau dua. Vim li cas ib lub rooj nrhiav cov cuab yeej? Vim li cas ho tsis yog metrics search tool? Vim li cas ho tsis saib xyuas? Vim li cas ho tsis yog SQL query execution tool? Thaum whale v1 yog thawj zaug xeeb los ua ib qho yooj yim CLI tus khub cuab yeej Dataportal/Amundsen, nws twb tau hloov zuj zus mus rau hauv lub platform uas muaj qhov tshwj xeeb nyob ib leeg, thiab peb cia siab tias nws yuav dhau los ua ib feem tseem ceeb ntawm Cov Ntaub Ntawv Tshawb Fawb cov cuab yeej.
Yog tias muaj qee yam koj xav pom hauv txoj kev txhim kho, koom nrog peb , qhib Issues ntawm lossis txawm hu ncaj qha . Peb twb muaj ib tug xov tooj ntawm cov yam ntxwv txias - Jinja templates, bookmarks, nrhiav cov ntxaij lim dej, Slack ceeb toom, Jupyter kev koom ua ke, txawm ib tug CLI dashboard rau metrics - tab sis peb xav hlub koj cov tswv yim.
xaus
Whale yog tsim thiab tswj hwm los ntawm Dataframe, kev pib ua haujlwm uas kuv nyuam qhuav muaj kev txaus siab ntawm kev koom tes nrog lwm tus neeg. Thaum whale yog tsim rau cov kws tshawb fawb cov ntaub ntawv, Dataframe yog tsim rau cov kws tshawb fawb cov ntaub ntawv. Rau cov neeg ntawm koj uas xav koom tes nrog ntau dua, xav tias dawb rau peb yuav ntxiv koj rau daim ntawv tos.
Thiab los ntawm promo code HABR, koj tuaj yeem tau txais 10% ntxiv rau qhov luv nqi qhia ntawm tus chij.
Cov chav kawm ntxiv
Cov ntsiab lus tshwj xeeb
Tau qhov twg los: www.hab.com