🥇Habrastatistics: kusanthula ndemanga za owerenga

Hello Habr. MU gawo lapitalo Kutchuka kwa zigawo zosiyanasiyana za malowa kunawunikidwa, ndipo panthawi imodzimodziyo funso linabuka - ndi deta yanji yomwe ingachotsedwe kuchokera ku ndemanga pa zolemba. Ndinkafunanso kuyesa lingaliro limodzi, lomwe ndikambirana pansipa.

Detayo idakhala yosangalatsa kwambiri; tidakwanitsanso kupanga "mini-rating" ya oyankha. Anapitiriza pansi odulidwa.

Kusonkhanitsa deta

Kuti tiwunike, tidzagwiritsa ntchito deta ya chaka chino, 2019, makamaka popeza ndalandira kale mndandanda wazolemba mu mawonekedwe a csv. Zonse zomwe zatsala ndikuchotsa ndemanga m'nkhani iliyonse;

Kuti muwunikire ndemanga kuchokera m'nkhani, nambala yotsatirayi ndiyokwanira:

r = requests.get("https://habr.com/ru/post/467453/")
data_html = r.text
comments = data_html.split('<div class="comment" id=')

comments_list = []
for comment in comments:
    body = Str(comment).find_between('<div class="comment__message', '<div class="comment__footer"').find_between('>', '</div>')# .replace('n', '-')
    if len(body) < 4: continue

    body = body.translate(str.maketrans(dict.fromkeys("tnrvf")))
    body = body.replace('"', "'").replace(',', " ").replace('<br>', ' ').replace('<p>', '').replace('</p>', '').replace('  ', ' ')

    user = Str(comment).find_between('data-user-login', '>').find_between('"', '"')
    date_str = Str(comment).find_between('<time class="comment__date-time comment__date-time_published', 'time>').find_between('>', '<')
    vote = Str(comment).find_between('<div class="voting-wjt', '</div>').find_between('<span', 'span>').find_between('>', '<')
    date = dateparser.parse(date_str)

    csv_data = "{},{},{},{}".format(user, date, vote, body)
    comments_list.append(csv_data)

Izi zimatipatsa mwayi wopeza ndemanga zomwe zimawoneka ngati izi (mazina amachotsedwa pazifukwa zachinsinsi):

xxxxxxx,2019-02-06 11:50:00,0,А можно пример как именно? xxxxxxx-02-24 16:15:00,+1,Побольше читайте независимые официальные источники чтобы таких вопросов не было. xxxxxxx,2019-02-23 20:15:00,–5,А не важно главное в итоге в плюсе оказаться

Monga mukuonera, pa ndemanga iliyonse titha kupeza dzina, tsiku, mlingo, ndi malemba enieni. Tiyeni tiwone zomwe tingapeze kuchokera ku izi.

Mwa njira, poyambirira, lingaliro la kusonkhanitsa mavoti linali losiyana pang'ono - kuwona zomwe ogwiritsa ntchito amapereka. Mwachitsanzo, mutha kuyang'ana pa YouTube - ngakhale vidiyo yabwino kwambiri, ngakhale kanema yomwe ilibe chidziwitso chilichonse, chongofotokoza kapena kutulutsa nkhani, imapezabe zochepa. Lingaliro linali lakuti pali ogwiritsa ntchito omwe, mwachidziwitso, sakonda chirichonse, mwinamwake serotonin sichimapangidwa mu ubongo kapena china. Mwinamwake munthu sakufunikanso kukhala pa Habré, koma kuti athetse kuvutika maganizo ... Koma monga momwe zinakhalira, sindingathe kuyang'ana izi apa, chifukwa ... mndandanda wa omwe adapereka mavoti sunasungidwe mu ndemanga kapena nkhani. Chabwino, ndiye kuti, tidzagwira ntchito ndi zomwe zilipo. Zotsatira zake ndi "zosintha" - mutha kuwona zomwe _receive_ ndi ogwiritsa ntchito. Zomwe, kwenikweni, ndizosangalatsa.

Processing

Poyamba, chodzikanira chamwambo. Chiyembekezo ichi, monga ena onse am'mbuyomu, sichovomerezeka. Sindikutsimikizira kuti sindinalakwitse kulikonse. Kwa iwo omwe ali ndi chidwi ndi zambiri zaukadaulo, ma code atsatanetsatane amaperekedwa mu gawo lapitalo.

Choncho tiyeni tiyambe. Ndemanga za chaka chino, 2019 (zomwe sizinathebe), zidatengedwa kuti ziwunikidwe. Pa nthawi yolemba, ogwiritsa ntchito adalemba Ndemanga za 448533, kukula kwa fayilo ya csv ndi 288 MB. Zamphamvu, zochititsa chidwi.

Nthawi yolemba

Tiyeni tigawane ndemanga pa ola, tikugawa masiku a sabata ndi kumapeto kwa sabata mosiyana.

Pano sitili ndi chidwi ndi mfundo zenizeni, koma zachibale. Ngati mungoyang'ana "monga momwe ziliri", ndiye kuti zimakhala chonchoоNdemanga zambiri zinalembedwa panthawi yogwira ntchito kuyambira 10 mpaka 18 😉 Kumbali inayi, madera a nthawi sakuganiziridwa pano, kotero funso liri lotseguka.

Tiyeni tiwone kugawidwa kwa ndemanga chaka chonse:

Ndipo komabe imazungulira; kuthamanga kumawoneka bwino mkati mwa sabata - nthawi ya sabata imawoneka bwino, kotero titha kunena ndi chidaliro chachikulu kuti anthu akuwerenga ndikuyankha pa Habr kuchokera kuntchito (koma izi sizotsimikizika).

Mwa njira, panali lingaliro loyesa kulingalira ngati chiwerengero cha minuses kapena ma pluses omwe adalandira amasiyana ndi tsiku kapena nthawi ya tsiku, koma sikunali kotheka kupeza ubale - nthawi yomwe chiwerengerocho chinaperekedwa sichinapulumutsidwe, ndipo palibe kugwirizana kwachindunji ndi nthawi ya ndemanga.

Ogwiritsa ntchito

Inde, sindikudziwa chiwerengero chenicheni cha ogwiritsa ntchito patsamba. Koma omwe adasiya ndemanga imodzi chaka chino adakhala pafupifupi Anthu a 25000.

Chithunzi cha kuchuluka kwa mauthenga osiyidwa ndi ogwiritsa ntchito chikuwoneka chosangalatsa kwambiri:

Poyamba sindinakhulupirire ndekha, koma zinkawoneka kuti palibe cholakwika. 5% ya ogwiritsa ntchito amasiya 60% ya mauthenga. 10% - 74% ya mauthenga onse (omwe, ndiroleni ndikukumbutseni, chaka chino, 450 zikwi). Ambiri amangowerenga malowa, kusiya ndemanga kawirikawiri, kapena osawasiya konse (iwo, mwachibadwa, sanaphatikizidwe pamndandanda wanga).

Zotsatira

Tiyeni tipitirire ku gawo lomaliza komanso losangalatsa la ziwerengero - mavoti. Pazifukwa zachinsinsi, sindipereka mayina athunthu a ogwiritsa ntchito;

Ndi chiwerengero cha ndemanga kwa chaka chino, 5 apamwamba ali ndi VoXXXX (3377 ndemanga), 0xdXXXXX (3286 ndemanga), strXXXX (3043 ndemanga), AmXXXX (2897 ndemanga) ndi khXXXX (2748 ndemanga).

Ndi kuchuluka kwa mapindu omwe adalandira. +5 /-1395) ndi amaXXXX (3231 ndemanga, mlingo +309/-1544).

Ndi Mtheradi positive mlingo (palibe aliyense negatively rated comment) pamwamba pamwamba pamakhala Milfgard и Boomrum. Monga kuchotsera, ndimapereka mayina awo onse, ndikuganiza kuti akuyenera.

The downsides nawonso chidwi. Pamwamba pa kuchuluka kwa minuses kusonkhanitsidwa kwa chaka chino ndi siXX (473 pluses, 699 minuses), khXX (1915 pluses, 573 minuses) ndi nicXXXXX (456 pluses, 487 minuses). Koma monga mukuwonera, ogwiritsa ntchitowa ali ndi ndemanga zokwanira zokwanira. Koma malinga ndi mtheradi kuchotsera The antitopic ikuphatikizapo vladXXXX (55 ndemanga, 84 minuses, 0 pluses), ekoXXXX (77 ndemanga, 92 minuses, 1 kuphatikiza) ndi iMXXXX (225 ndemanga, 205 minuses, 12 pluses).

Pomaliza

Sindinathe kuwerengera zonse zomwe zidakonzedwa, koma ndikuyembekeza kuti zinali zosangalatsa.

Monga mukuonera, ngakhale deta yomwe ili ndi chiwerengero chochepa cha minda ikhoza kupereka deta yosangalatsa yowunikira. Palinso zambiri zomwe ziyenera kukumba, kuyambira kumanga "mtambo wa mawu" mpaka kusanthula malemba. Ngati zotsatira zilizonse zosangalatsa zituluka, zidzasindikizidwa.

Source: www.habr.com

Habrastatistics: kusanthula ndemanga za owerenga