Ƙwarewa shigar Apache Airflow akan Windows 10

Preamble: bisa ga kaddara, daga duniyar kimiyyar ilimi (maganin magani) na tsinci kaina a duniyar fasahar sadarwa, inda dole ne in yi amfani da ilimina na hanyar gina gwaji da dabarun nazarin bayanan gwaji, duk da haka, a yi amfani da su. tarin fasaha da ke sabo a gare ni. A cikin tsarin sarrafa waɗannan fasahohin, na gamu da matsaloli da dama, waɗanda, abin farin ciki, an shawo kan su. Wataƙila wannan sakon zai zama da amfani ga waɗanda suma suna fara aiki tare da ayyukan Apache.

Don haka, zuwa ga ma'ana. Ilham labarin Yuri Emelyanov game da damar Apache Airflow a fagen sarrafa kansa na hanyoyin nazari, Ina so in fara amfani da tsarin da aka tsara na ɗakunan karatu a cikin aikina. Wadanda har yanzu ba su saba da Apache Airflow ba na iya sha'awar taƙaitaccen bayani labarin a yanar gizo na National Library. N.E. Bauman.

Tun da umarnin da aka saba don gudanar da Airflow ba ze yin aiki a cikin yanayin Windows, yi amfani da wannan don magance wannan matsalar docker a cikin al'amarina zai zama m, Na fara neman wasu mafita. Abin farin ciki a gare ni, ba ni ne na farko a kan wannan hanya ba, don haka na sami damar samun abin ban mamaki umarnin bidiyo Yadda ake shigar Apache Airflow akan Windows 10 ba tare da amfani da Docker ba. Amma, kamar yadda sau da yawa yakan faru, lokacin bin matakan da aka ba da shawarar, matsaloli suna tasowa, kuma, na yi imani, ba kawai a gare ni ba. Saboda haka, Ina so in yi magana game da gwaninta na shigar da Apache Airflow, watakila zai ceci wani ɗan lokaci kaɗan.

Bari mu shiga cikin matakan umarnin (masu ɓarna - komai ya tafi lafiya a mataki na 5):

1. Shigar da Windows Subsystem don Linux don shigarwa na rarraba Linux na gaba

Wannan shi ne kadan daga cikin matsalolin, kamar yadda suke cewa:

Sarrafa Sarrafa → Shirye-shirye → Shirye-shirye da Features → Kunna ko kashe fasalin Windows → Tsarin Windows don Linux

2. Shigar da rarraba Linux ɗin da kuka zaɓa

Na yi amfani da aikace-aikacen Ubuntu.

3. Shigarwa da sabunta pip

sudo apt-get install software-properties-common
sudo apt-add-repository universe
sudo apt-get update
sudo apt-get install python-pip

4. Sanya Apache Airflow

export SLUGIFY_USES_TEXT_UNIDECODE=yes
pip install apache-airflow

5. Farawa Database

Kuma a nan ne ƙananan matsalolina suka fara. Umarnin yana buƙatar ka shigar da umarnin airflow initdb kuma muci gaba zuwa mataki na gaba. Duk da haka, koyaushe ina samun amsa airflow: command not found. Yana da ma'ana a ɗauka cewa matsaloli sun taso yayin shigarwa na Apache Airflow kuma fayilolin da ake buƙata kawai ba su samuwa. Bayan tabbatar da cewa duk abin da ya kamata ya kasance, sai na yanke shawarar gwada cikakken hanyar zuwa fayil ɗin iska (ya kamata yayi kama da haka: Полный/путь/до/файла/airflow initdb). Amma abin al'ajabi bai faru ba kuma amsar daya ce airflow: command not found. Na gwada amfani da hanyar dangi zuwa fayil ɗin (./.local/bin/airflow initdb), wanda ya haifar da sabon kuskure ModuleNotFoundError: No module named json'wanda za a iya shawo kan ta ta hanyar sabunta ɗakin karatu kayan aiki (a cikin akwati na har zuwa sigar 0.15.4):

pip install werkzeug==0.15.4

Kuna iya karanta ƙarin game da werkzeug a nan.

Bayan wannan sauƙin sarrafa umarnin ./.local/bin/airflow initdb an kammala shi cikin nasara.

6. Ƙaddamar da uwar garken Airflow

Wannan ba ƙarshen wahalhalun ba ne tare da samun iskar iska. Gudun umarni ./.local/bin/airflow webserver -p 8080 ya haifar da kuskure No such file or directory. Wataƙila, ƙwararren mai amfani da Ubuntu zai yi ƙoƙarin shawo kan irin waɗannan matsalolin nan da nan tare da samun damar fayil ta amfani da umarnin export PATH=$PATH:~/.local/bin/ (watau ƙara /.local/bin/ zuwa hanyar bincike na PATH mai gudana), amma wannan post ɗin an yi niyya ne ga waɗanda ke aiki da Windows da farko kuma ƙila ba za su yi tunanin wannan bayani a bayyane yake ba.

Bayan magudin da aka bayyana a sama, umarnin ./.local/bin/airflow webserver -p 8080 an yi nasarar kammala shi.

7.URL: Localhost: 8080 /

Idan komai ya yi kyau a matakan da suka gabata, to kuna shirye don cin nasara kan kololuwar nazari.

Ina fatan cewa kwarewar da aka bayyana a sama a shigar da Apache Airflow akan Windows 10 zai zama da amfani ga masu amfani da novice kuma zai hanzarta shigar su cikin sararin samaniya na kayan aikin nazari na zamani.

Lokaci na gaba zan so in ci gaba da batun kuma in yi magana game da ƙwarewar amfani da Apache Airflow a fagen nazarin halayen masu amfani na aikace-aikacen hannu.

source: www.habr.com