{"id":37955,"date":"2019-10-31T22:20:47","date_gmt":"2019-10-31T19:20:47","guid":{"rendered":"https:\/\/prohoster.info\/blog\/linejnaya-regressiya-i-metody-eyo-vosstanovleniya\/"},"modified":"2019-10-31T22:20:47","modified_gmt":"2019-10-31T19:20:47","slug":"linejnaya-regressiya-i-metody-eyo-vosstanovleniya","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/linejnaya-regressiya-i-metody-eyo-vosstanovleniya","title":{"rendered":"Regresioni linear dhe metodat e tij t\u00eb rikuperimit","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p><img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/60ca67872405e9f15b151e958f04260d.png\" style=\"display:block;margin: 0 auto;\" \/><br \/>\n<i>Burimi: <noindex><a rel=\"nofollow\" href=\"https:\/\/xkcd.com\/1725\/\">xkcd<\/a><\/noindex><\/i><\/p>\n<p>Regresioni linear \u00ebsht\u00eb nj\u00eb nga algoritmet themelore p\u00ebr shum\u00eb fusha q\u00eb lidhen me analiz\u00ebn e t\u00eb dh\u00ebnave. Arsyeja p\u00ebr k\u00ebt\u00eb \u00ebsht\u00eb e qart\u00eb. \u00cbsht\u00eb nj\u00eb algorit\u00ebm shum\u00eb i thjesht\u00eb dhe i kuptuesh\u00ebm, q\u00eb kontribuon n\u00eb p\u00ebrdorimin e tij t\u00eb gjer\u00eb p\u00ebr shum\u00eb dekada, n\u00ebse jo p\u00ebr shekuj. Ideja \u00ebsht\u00eb q\u00eb ne supozojm\u00eb nj\u00eb var\u00ebsi lineare t\u00eb nj\u00eb variabli nga nj\u00eb grup variablash t\u00eb tjer\u00eb, dhe m\u00eb pas p\u00ebrpiqemi ta rikonstruktojm\u00eb k\u00ebt\u00eb var\u00ebsi.<\/p>\n<p>Por n\u00eb k\u00ebt\u00eb artikull nuk do t\u00eb flasim p\u00ebr p\u00ebrdorimin e regresionit linear p\u00ebr zgjidhjen e problemeve praktike. K\u00ebtu do t\u00eb shqyrtohen karakteristikat interesante t\u00eb implementimit t\u00eb algoritmeve t\u00eb shp\u00ebrndara p\u00ebr rikonstruksionin e tij, me t\u00eb cilat ne u p\u00ebrball\u00ebm gjat\u00eb shkruajtjes s\u00eb modulit t\u00eb m\u00ebsimit t\u00eb makinerive n\u00eb <noindex><a rel=\"nofollow\" href=\"https:\/\/ignite.apache.org\/\">Apache Ignite<\/a><\/noindex>. Pak matematik\u00eb themelore, bazat e m\u00ebsimit t\u00eb makinerive dhe t\u00eb dh\u00ebnat e shp\u00ebrndara do t\u00eb ndihmojn\u00eb t\u00eb kuptojm\u00eb se si t\u00eb rikonstruktojm\u00eb regresionin linear, edhe n\u00ebse t\u00eb dh\u00ebnat jan\u00eb t\u00eb shp\u00ebrndara mes mij\u00ebra nyjash.<br \/>\n<noindex><a rel=\"nofollow\" name=\"habracut\"><\/a><\/noindex><\/p>\n<h3>\u00c7far\u00eb \u00ebsht\u00eb n\u00eb bised\u00eb?<\/h3>\n<p>\nNa pritet nj\u00eb detyr\u00eb p\u00ebr rikonstruktimin e var\u00ebsis\u00eb lineare. Si t\u00eb dh\u00ebna hyr\u00ebse jepen shum\u00eb vektor\u00ebsh variablash t\u00eb supozuar si t\u00eb pavarur, t\u00eb cil\u00ebve \u00e7do prej tyre i korrespondon nj\u00eb vler\u00eb e caktuar e variablit t\u00eb varur. K\u00ebto t\u00eb dh\u00ebna mund t\u00eb paraqiten n\u00eb form\u00ebn e dy matricave:<\/p>\n<p><img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/2ffbdd09fdc5efaf287fbb4935033302.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>\nTani, pasi q\u00eb supozohet nj\u00eb var\u00ebsi, dhe madje edhe lineare, do ta shkruajm\u00eb supozimin ton\u00eb n\u00eb form\u00ebn e nj\u00eb producti matricash (p\u00ebr thjesht\u00ebsim, k\u00ebtu dhe m\u00eb tej supozohet q\u00eb pjesa e lir\u00eb e ekuacionit fshihet pas <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/21e90cb829e0bc2e12c836f7810c1b1a.png\" style=\"display:block;margin: 0 auto;\" \/>, dhe kolon\u00eb e fundit e matric\u00ebs <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/25c0af2e153ae371e71588efe3bc2ee2.png\" style=\"display:block;margin: 0 auto;\" \/> p\u00ebrmban nj\u00ebsi):<\/p>\n<p><img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/b1c3c8d2332ae27eedeef675178dee4f.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>\nShum\u00eb e ngjashme me nj\u00eb sistem ekuacionesh lineare, apo jo? Ngjan, por ka t\u00eb ngjar\u00eb q\u00eb ky sistem ekuacionesh t\u00eb mos ket\u00eb zgjidhje. Arsyeja p\u00ebr k\u00ebt\u00eb \u00ebsht\u00eb zhurma, e cila \u00ebsht\u00eb e pranishme praktikisht n\u00eb t\u00eb dh\u00ebnat reale. Nj\u00eb tjet\u00ebr arsye mund t\u00eb jet\u00eb mungesa e var\u00ebsis\u00eb lineare si e till\u00eb, me t\u00eb cil\u00ebn mund t\u00eb p\u00ebrpiqemi t\u00eb p\u00ebrballojm\u00eb duke futur variablat shtes\u00eb, q\u00eb varen n\u00eb m\u00ebnyr\u00eb jo lineare nga t\u00eb dh\u00ebnat fillestare. Le t\u00eb shqyrtojm\u00eb shembullin e m\u00ebposht\u00ebm:<br \/>\n<img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/d449b8f931e91cc7b33634ee8d4a4329.png\" style=\"display:block;margin: 0 auto;\" \/><br \/>\n<i>Burimi: <noindex><a rel=\"nofollow\" href=\"https:\/\/en.wikipedia.org\/wiki\/Linear_regression\">Wikipedia<\/a><\/noindex><\/i><\/p>\n<p>Ky \u00ebsht\u00eb nj\u00eb shembull i thjesht\u00eb i regresionit linear, i cili demonstruar var\u00ebsin\u00eb e nj\u00eb variabli (n\u00eb boshtin <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/fdea97dff413fb13444d7fd8ab65ca0b.png\" style=\"display:block;margin: 0 auto;\" \/>) nga variabli tjet\u00ebr (n\u00eb boshtin <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/edf9cb265e4e4655cd84fb8739843952.png\" style=\"display:block;margin: 0 auto;\" \/>). P\u00ebr t\u00eb pasur nj\u00eb sistem linjar ekuacionesh n\u00eb p\u00ebrputhje me k\u00ebt\u00eb shembull, t\u00eb gjith\u00eb pikat duhet t\u00eb bien sakt\u00ebsisht n\u00eb nj\u00eb vij\u00eb. Por nuk \u00ebsht\u00eb k\u00ebshtu. Ato nuk bien n\u00eb nj\u00eb vij\u00eb pik\u00ebrisht p\u00ebr shkak t\u00eb zhurm\u00ebs (apo p\u00ebr shkak se supozimi i pranish\u00ebm i var\u00ebsis\u00eb linjare ishte i gabuar). Pra, p\u00ebr t\u00eb rikuperuar var\u00ebsin\u00eb linjare nga t\u00eb dh\u00ebnat reale zakonisht k\u00ebrkohet t\u00eb futet nj\u00eb supozim tjet\u00ebr: t\u00eb dh\u00ebnat p\u00ebrmbajn\u00eb zhurm\u00eb dhe kjo zhurm\u00eb ka <noindex><a rel=\"nofollow\" href=\"https:\/\/en.wikipedia.org\/wiki\/Normal_distribution\">shp\u00ebrndarje normale<\/a><\/noindex>. Mund t\u00eb b\u00ebhen supozime dhe p\u00ebr tipe t\u00eb tjera shp\u00ebrndarjesh zhurme, por n\u00eb shumic\u00ebn d\u00ebrrmuese t\u00eb rasteve shqyrtohet pik\u00ebrisht shp\u00ebrndarja normale, p\u00ebr t\u00eb cil\u00ebn do t\u00eb flitet m\u00eb tej.<\/p>\n<h3>Metoda e maksimumit t\u00eb mund\u00ebsive<\/h3>\n<p>\nPra, ne supozuam prani t\u00eb zhurm\u00ebs rast\u00ebsore me shp\u00ebrndarje normale. \u00c7far\u00eb t\u00eb b\u00ebjm\u00eb n\u00eb nj\u00eb situat\u00eb t\u00eb till\u00eb? P\u00ebr k\u00ebt\u00eb rast, n\u00eb matematik\u00eb ekziston dhe p\u00ebrdoret gjer\u00ebsisht <noindex><a rel=\"nofollow\" href=\"https:\/\/en.wikipedia.org\/wiki\/Maximum_likelihood_estimation\">metod\u00ebn e maksimalit t\u00eb mund\u00ebsis\u00eb<\/a><\/noindex>. N\u00ebse e p\u00ebrmbledhim, thelbi i tij \u00ebsht\u00eb zgjedhja <noindex><a rel=\"nofollow\" href=\"https:\/\/en.wikipedia.org\/wiki\/Likelihood_function\">funksionit t\u00eb mund\u00ebsive<\/a><\/noindex> dhe maksimizimi i saj t\u00eb m\u00ebtejsh\u00ebm.<\/p>\n<p>Kthehemi n\u00eb rikuperimin e var\u00ebsis\u00eb linjare nga t\u00eb dh\u00ebnat me zhurm\u00eb normale. V\u00ebrejm\u00eb se var\u00ebsia linjare e supozuar \u00ebsht\u00eb nj\u00eb pr \u043e\u0436\u0438\u0434\u0430\u043d\u0438\u0435 matematikore <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/73cd24a6605bce1a4f38339ee8c61613.png\" style=\"display:block;margin: 0 auto;\" \/> e shp\u00ebrndarjes normale t\u00eb pranishme. N\u00eb t\u00eb nj\u00ebjt\u00ebn koh\u00eb, probabiliteti q\u00eb <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/caaf32b1af58d748244acbab640bbab8.png\" style=\"display:block;margin: 0 auto;\" \/> merr vler\u00ebn e caktuar, ndonj\u00ebher\u00eb n\u00eb kushtet e pranis\u00eb s\u00eb observimeve <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/9cda87721bba4812b7cec96f204ff5f6.png\" style=\"display:block;margin: 0 auto;\" \/>, duket si m\u00eb posht\u00eb:<\/p>\n<p><img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/7acbd6bff263d52773617904d3249a96.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>\nTani le t\u00eb vendosim n\u00eb vend t\u00eb <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/d5a167a87fa416e938678b2a80b353dc.png\" style=\"display:block;margin: 0 auto;\" \/> dhe <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/330ad17be2629a5159b513ba95a96c72.png\" style=\"display:block;margin: 0 auto;\" \/> variablat q\u00eb na duhen:<\/p>\n<p><img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/57531f93ee0d0050b1fbfc64419f44ad.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>\nVazhdon t\u00eb mbetet vet\u00ebm t\u00eb gjejm\u00eb vektorin <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/801ebcd43ae0bc0cf54bc0f68bdc21da.png\" style=\"display:block;margin: 0 auto;\" \/>, p\u00ebr t\u00eb cilin ky probabilitet \u00ebsht\u00eb maksimal. P\u00ebr t\u00eb maksimizuar nj\u00eb funksion t\u00eb till\u00eb, \u00ebsht\u00eb e p\u00ebrshtatshme s\u00eb pari ta prologarit\u00ebsh at\u00eb (logaritemi i funksionit do t\u00eb arrij\u00eb maksimumin n\u00eb t\u00eb nj\u00ebjtin pik\u00eb si vet\u00eb funksioni):<\/p>\n<p><img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/7485448a44f8ee201254fea4208deb54.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>\n\u00c7ka, nga ana tjet\u00ebr, reduktonet n\u00eb minimizimin e funksionit t\u00eb m\u00ebposht\u00ebm:<\/p>\n<p><img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/0957864e5dfbfc1147c24784df67af20.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>\nDuket, kjo quhet metoda <noindex><a rel=\"nofollow\" href=\"https:\/\/en.wikipedia.org\/wiki\/Linear_least_squares\">e katror\u00ebve t\u00eb vegj\u00ebl<\/a><\/noindex>. Shpesh t\u00eb gjitha k\u00ebto konsiderata t\u00eb m\u00ebsip\u00ebrme kalohen dhe p\u00ebrdoren thjesht kjo metod\u00eb.<\/p>\n<h3>QR dekompozimi<\/h3>\n<p>\nMinimalen e funksionit t\u00eb m\u00ebsip\u00ebrm mund ta gjejm\u00eb, n\u00ebse gjejm\u00eb pik\u00ebn ku gradienti i k\u00ebtij funksioni \u00ebsht\u00eb zero. Dhe gradienti do t\u00eb regjistrohet n\u00eb k\u00ebt\u00eb m\u00ebnyr\u00eb:<\/p>\n<p><img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/1581c46f8fa625826ae2f76ec561dc3f.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>\n<noindex><a rel=\"nofollow\" href=\"https:\/\/en.wikipedia.org\/wiki\/QR_decomposition\">QR dekompozimi<\/a><\/noindex> \u00ebsht\u00eb nj\u00eb metod\u00eb matricore p\u00ebr zgjidhjen e problemit t\u00eb minimizimit t\u00eb p\u00ebrdorur n\u00eb metod\u00ebn e katror\u00ebve t\u00eb vegj\u00ebl. P\u00ebr k\u00ebt\u00eb arsye, le t\u00eb shkruajm\u00eb ekuacionin n\u00eb form\u00eb matricore:<\/p>\n<p><img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/4ee809a96550577df855fbd57049a41c.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>\nPra, ne po ndajm\u00eb matric\u00ebn <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/2fa2b32bef5246132da5b3b9bc713ab5.png\" style=\"display:block;margin: 0 auto;\" \/> n\u00eb matrica <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/fd8c620c602ae49e8d6e39ef8b551d0b.png\" style=\"display:block;margin: 0 auto;\" \/> dhe <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/32804631a9a2f8bff35d0bcf7c29bfc6.png\" style=\"display:block;margin: 0 auto;\" \/> dhe kryejm\u00eb nj\u00eb s\u00ebr\u00eb transformimesh (algoritmi i QR dekompozitimit nuk do t\u00eb diskutohet k\u00ebtu, vet\u00ebm p\u00ebrdorimi i tij n\u00eb lidhje me problemin e caktuar):<\/p>\n<p><img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/56cfb4ed9126e632cba51940c0d9afe6.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>\nMatrica <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/106bb4d6704eb9f42078555c662a8b97.png\" style=\"display:block;margin: 0 auto;\" \/> \u00ebsht\u00eb ortogonale. Kjo na lejon t\u00eb heqim dor\u00eb nga produkti <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/618077c012f7b81f23756b9c1e54eb73.png\" style=\"display:block;margin: 0 auto;\" \/>:<\/p>\n<p><img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/1715fb2e77d8be75e68e4791997aaa44.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>\nDhe n\u00ebse z\u00ebvend\u00ebsojm\u00eb <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/926c51120ec8608bf81dc8f36fcc3ef4.png\" style=\"display:block;margin: 0 auto;\" \/> n\u00eb <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/9e578153ea2dc36d0eb86be4eedf4899.png\" style=\"display:block;margin: 0 auto;\" \/>, do t\u00eb rezultoj\u00eb n\u00eb <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/8cd914db7317c01dc5449c70b36dba73.png\" style=\"display:block;margin: 0 auto;\" \/>. Duke marr\u00eb parasysh se <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/88fa4e81fc2bedf16e41e90e320a5647.png\" style=\"display:block;margin: 0 auto;\" \/> \u00ebsht\u00eb nj\u00eb matric\u00eb e sip\u00ebrme triangulare, kjo duket k\u00ebshtu:<\/p>\n<p><img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/689eaaece2a497c5bd02582e3e672a41.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>\nKjo mund t\u00eb zgjidhet me metod\u00ebn e z\u00ebvend\u00ebsimit. Elementi <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/e163597c97a539238731c31ca5ce011b.png\" style=\"display:block;margin: 0 auto;\" \/> ndodhet si <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/211d86418c9a38f164f490b1a7b5fb71.png\" style=\"display:block;margin: 0 auto;\" \/>, elementi i m\u00ebparsh\u00ebm <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/ed3742b3a7cfb14bad801485a8cf01df.png\" style=\"display:block;margin: 0 auto;\" \/> ndodhet si <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/b3e582f565e1060b47af4008a98c3524.png\" style=\"display:block;margin: 0 auto;\" \/> dhe k\u00ebshtu me radh\u00eb.<\/p>\n<p>K\u00ebtu duhet t\u00eb theksojm\u00eb se kompleksiteti i algoritmit t\u00eb fituar p\u00ebr shkak t\u00eb p\u00ebrdorimit t\u00eb QR dekompozitimit \u00ebsht\u00eb i barabart\u00eb me <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/c5c20145b7b165120d9979c2e2ca4711.png\" style=\"display:block;margin: 0 auto;\" \/>. Nd\u00ebrkoh\u00eb, pavar\u00ebsisht se operacioni i shumzimit t\u00eb matricave mund t\u00eb paralelizohet mir\u00eb, nuk duket e mundur t\u00eb shkruhen nj\u00eb version efektiv i distribuar i k\u00ebtij algoritmi.<\/p>\n<h3>Zbritja gradiente<\/h3>\n<p>\nDuke folur p\u00ebr minimizimin e nj\u00eb funksioni t\u00eb caktuar, gjithmon\u00eb ia vlen t\u00eb p\u00ebrmendet metoda e (stohastik) gradienteve t\u00eb zbritjes. Kjo \u00ebsht\u00eb nj\u00eb metod\u00eb e thjesht\u00eb dhe efektive e minimizimit, e bazuar n\u00eb llogaritjen iteruese t\u00eb gradientit t\u00eb funksionit n\u00eb nj\u00eb pik\u00eb dhe l\u00ebvizjen e m\u00ebpasshme n\u00eb drejtimin e kund\u00ebrt t\u00eb gradientit. \u00c7do hap i till\u00eb afrohet zgjidhjes n\u00eb minimum. Gradienti n\u00eb k\u00ebt\u00eb rast duket ende k\u00ebshtu:<\/p>\n<p><img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/d195806787197323312be7c0b9d8b240.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>Gjithashtu, kjo metod\u00eb paralelizohet dhe shp\u00ebrndahet mir\u00eb p\u00ebr shkak t\u00eb pronave lineare t\u00eb operatorit t\u00eb gradientit. V\u00ebrejm\u00eb se n\u00eb formul\u00ebn e m\u00ebsip\u00ebrme n\u00ebn shenj\u00ebn e shum\u00ebs jan\u00eb terma t\u00eb pavarur. Me fjal\u00eb t\u00eb tjera, ne mund t\u00eb llogarisim gradientin n\u00eb m\u00ebnyr\u00eb t\u00eb pavarur p\u00ebr t\u00eb gjitha indeksat <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/0c10d574f70b318b6562fb444e460fa7.png\" style=\"display:block;margin: 0 auto;\" \/> nga i pari deri te <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/c9b39d76c5f724af137b5db3053e1a60.png\" style=\"display:block;margin: 0 auto;\" \/>, nd\u00ebrkoh\u00eb q\u00eb paralelisht llogarisim gradientin p\u00ebr indeksat nga <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/1a9407fcb4ec67a171463d36dca30a80.png\" style=\"display:block;margin: 0 auto;\" \/> n\u00eb <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/f1e29c5b16d68d6377108f53803a9cd0.png\" style=\"display:block;margin: 0 auto;\" \/>. Pastaj, do t\u00eb mbledhim gradient\u00ebt e marra. Rezultati i mbledhjes do t\u00eb jet\u00eb i nj\u00ebjt\u00eb me at\u00eb n\u00ebse do t\u00eb llogarisnim menj\u00ebher\u00eb gradientin p\u00ebr indeksat nga i pari deri te <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/c5ec5004c59a5343f22894ef676606e3.png\" style=\"display:block;margin: 0 auto;\" \/>. K\u00ebshtu, n\u00ebse t\u00eb dh\u00ebnat jan\u00eb t\u00eb shp\u00ebrndara midis disa pjes\u00ebve t\u00eb dh\u00ebnash, gradienti mund t\u00eb llogaritet n\u00eb m\u00ebnyr\u00eb t\u00eb pavarur n\u00eb secil\u00ebn pjes\u00eb, e m\u00eb pas rezultatet e k\u00ebtyre llogaritjeve mund t\u00eb mbledhen p\u00ebr t\u00eb marr\u00eb rezultatin p\u00ebrfundimtar:<\/p>\n<p><img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/073ce5e3a6688e3a1ae7774aaff1a843.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>Nga pik\u00ebpamja e implementimit, kjo p\u00ebrputhet me paradigm\u00ebn <noindex><a rel=\"nofollow\" href=\"https:\/\/en.wikipedia.org\/wiki\/MapReduce\">MapReduce<\/a><\/noindex>N\u00eb \u00e7do hap t\u00eb gradientes s\u00eb zbritjes, nj\u00eb detyr\u00eb p\u00ebr t\u00eb llogaritur gradientin d\u00ebrgohet n\u00eb \u00e7do nyje t\u00eb dh\u00ebnash, m\u00eb pas gradientet e llogaritura mblidhen s\u00eb bashku, dhe rezultati i mbledhjes s\u00eb tyre p\u00ebrdoret p\u00ebr t\u00eb p\u00ebrmir\u00ebsuar rezultatin.<\/p>\n<p>Pavar\u00ebsisht thjesht\u00ebsis\u00eb s\u00eb zbatimit dhe mund\u00ebsis\u00eb s\u00eb ekzekutimit n\u00eb paradigm\u00ebn MapReduce, gradient descent ka gjithashtu disavantazhet e tij. N\u00eb ve\u00e7anti, numri i hapave t\u00eb nevojsh\u00ebm p\u00ebr t\u00eb arritur konvergjenc\u00ebn \u00ebsht\u00eb ndjesh\u00ebm m\u00eb i lart\u00eb krahasuar me metodat e tjera m\u00eb t\u00eb specializuara.<\/p>\n<h3>LSQR<\/h3>\n<p>\n<noindex><a rel=\"nofollow\" href=\"https:\/\/web.stanford.edu\/group\/SOL\/software\/lsqr\/\">LSQR<\/a><\/noindex> \u2014 nj\u00eb tjet\u00ebr metod\u00eb zgjidhje e cila \u00ebsht\u00eb e p\u00ebrshtatshme si p\u00ebr rikonstruktimin e regresionit linear, ashtu edhe p\u00ebr zgjidhjen e sistemeve t\u00eb ekuacioneve lineare. Karakteristika e saj kryesore \u00ebsht\u00eb se kombinon avantazhet e metodave matricore dhe t\u00eb qasjes iteruese. Implementimet e k\u00ebsaj metode mund t\u00eb gjenden si n\u00eb bibliotekat <noindex><a rel=\"nofollow\" href=\"https:\/\/docs.scipy.org\/doc\/scipy-0.14.0\/reference\/generated\/scipy.sparse.linalg.lsqr.html\">SciPy<\/a><\/noindex>, ashtu edhe n\u00eb <noindex><a rel=\"nofollow\" href=\"http:\/\/matlab.izmiran.ru\/help\/techdoc\/ref\/lsqr.html\">MATLAB<\/a><\/noindex>. P\u00ebrshkrimi i k\u00ebsaj metode nuk do t\u00eb jepet k\u00ebtu (mund ta gjeni n\u00eb artikullin <noindex><a rel=\"nofollow\" href=\"https:\/\/web.stanford.edu\/group\/SOL\/software\/lsqr\/lsqr-toms82a.pdf\">LSQR: An algorithm for sparse linear equations and sparse least squares<\/a><\/noindex>). N\u00eb vend t\u00eb k\u00ebsaj do t\u00eb demonstrohet nj\u00eb qasje q\u00eb lejon adaptimin e LSQR p\u00ebr t\u00eb funksionuar n\u00eb nj\u00eb ambient t\u00eb shp\u00ebrndar\u00eb.<\/p>\n<p>Baza e metod\u00ebs LSQR \u00ebsht\u00eb <noindex><a rel=\"nofollow\" href=\"http:\/\/www.netlib.org\/utk\/people\/JackDongarra\/etemplates\/node198.html\">procedura e bidiagonalizimit<\/a><\/noindex>. Kjo \u00ebsht\u00eb nj\u00eb procedur\u00eb iteruese, ku \u00e7do iteracion p\u00ebrb\u00ebhet nga hapat e m\u00ebposht\u00ebm:<br \/>\n<img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/3c2f7b5c6f57830e9b522023a8e72a48.png\" style=\"display:block;margin: 0 auto;\" \/><br \/>\n<br \/>\nPor n\u00ebse merret parasysh se matrica <img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/e86c3c422629b78bc574f66db8a6139d.png\" style=\"display:block;margin: 0 auto;\" \/> \u00ebsht\u00eb e particionuar horizontalisht, \u00e7do iteracion mund t\u00eb paraqitet si dy hapa MapReduce. N\u00eb k\u00ebt\u00eb m\u00ebnyr\u00eb minimizohen d\u00ebrgesat e t\u00eb dh\u00ebnave gjat\u00eb \u00e7do iteracioni (vet\u00ebm vektor\u00eb me nj\u00eb gjat\u00ebsi t\u00eb barabart\u00eb me numrin e t\u00eb panjohurave):<\/p>\n<p><img decoding=\"async\" alt=\"Regresioni linear dhe metodat e tij t\u00eb rikuperimit\" src=\"\/wp-content\/uploads\/2019\/09\/6b67654b29ed24283c4b04d66c05ea5c.png\" style=\"display:block;margin: 0 auto;\" \/><br \/>\n<br \/>\nKjo qasje p\u00ebrdoret p\u00ebr implementimin e regresionit linear n\u00eb <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/apache\/ignite\/blob\/master\/modules\/ml\/src\/main\/java\/org\/apache\/ignite\/ml\/math\/isolve\/lsqr\/AbstractLSQR.java\">Apache Ignite ML<\/a><\/noindex>.<\/p>\n<h3>P\u00ebrfundim<\/h3>\n<p>\nEkzistojn\u00eb shum\u00eb algoritma p\u00ebr rikonstruktimin e regresionit linear, por jo t\u00eb gjith\u00eb mund t\u00eb aplikohen n\u00eb \u00e7do kushte. K\u00ebshtu, decompozimi QR \u00ebsht\u00eb shum\u00eb i p\u00ebrshtatsh\u00ebm p\u00ebr zgjidhje t\u00eb sakta n\u00eb grupe t\u00eb vogla t\u00eb dh\u00ebnash. Gradient descent \u00ebsht\u00eb leht\u00ebsisht i implementuesh\u00ebm dhe lejon t\u00eb gjejm\u00eb shpejt nj\u00eb zgjidhje t\u00eb p\u00ebraf\u00ebrt. Nd\u00ebrsa LSQR kombinon vetit\u00eb m\u00eb t\u00eb mira t\u00eb dy algoritmeve t\u00eb m\u00ebparshme, pasi mund t\u00eb shp\u00ebrndahet, konvergon m\u00eb shpejt krahasuar me gradient descent, si dhe lejon ndalimin e hersh\u00ebm t\u00eb algoritmit n\u00eb krahasim me decompozimin QR p\u00ebr t\u00eb gjetur nj\u00eb zgjidhje t\u00eb p\u00ebraf\u00ebrt.<br \/>\n<br \/>Burimi: <a content=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/post\/465743\/\">habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u0418\u0441\u0442\u043e\u0447\u043d\u0438\u043a: xkcd \u041b\u0438\u043d\u0435\u0439\u043d\u0430\u044f \u0440\u0435\u0433\u0440\u0435\u0441\u0441\u0438\u044f \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043e\u0434\u043d\u0438\u043c \u0438\u0437 \u0431\u0430\u0437\u043e\u0432\u044b\u0445 \u0430\u043b\u0433\u043e\u0440\u0438\u0442\u043c\u043e\u0432 \u0434\u043b\u044f \u043c\u043d\u043e\u0433\u0438\u0445 \u043e\u0431\u043b\u0430\u0441\u0442\u0435\u0439, \u0441\u0432\u044f\u0437\u0430\u043d\u043d\u044b\u0445 \u0441 \u0430\u043d\u0430\u043b\u0438\u0437\u043e\u043c \u0434\u0430\u043d\u043d\u044b\u0445. \u041f\u0440\u0438\u0447\u0438\u043d\u0430 \u044d\u0442\u043e\u043c\u0443 \u043e\u0447\u0435\u0432\u0438\u0434\u043d\u0430. \u042d\u0442\u043e \u043e\u0447\u0435\u043d\u044c \u043f\u0440\u043e\u0441\u0442\u043e\u0439 \u0438 \u043f\u043e\u043d\u044f\u0442\u043d\u044b\u0439 \u0430\u043b\u0433\u043e\u0440\u0438\u0442\u043c, \u0447\u0442\u043e \u0441\u043f\u043e\u0441\u043e\u0431\u0441\u0442\u0432\u0443\u0435\u0442 \u0435\u0433\u043e \u0448\u0438\u0440\u043e\u043a\u043e\u043c\u0443 \u043f\u0440\u0438\u043c\u0435\u043d\u0435\u043d\u0438\u044e \u0443\u0436\u0435 \u043c\u043d\u043e\u0433\u0438\u0435 \u0434\u0435\u0441\u044f\u0442\u043a\u0438, \u0435\u0441\u043b\u0438 \u043d\u0435 \u0441\u043e\u0442\u043d\u0438, \u043b\u0435\u0442. \u0418\u0434\u0435\u044f \u0437\u0430\u043a\u043b\u044e\u0447\u0430\u0435\u0442\u0441\u044f \u0432 \u0442\u043e\u043c, \u0447\u0442\u043e \u043c\u044b \u043f\u0440\u0435\u0434\u043f\u043e\u043b\u0430\u0433\u0430\u0435\u043c \u043b\u0438\u043d\u0435\u0439\u043d\u0443\u044e \u0437\u0430\u0432\u0438\u0441\u0438\u043c\u043e\u0441\u0442\u044c \u043e\u0434\u043d\u043e\u0439 \u043f\u0435\u0440\u0435\u043c\u0435\u043d\u043d\u043e\u0439 \u043e\u0442 \u043d\u0430\u0431\u043e\u0440\u0430 \u0434\u0440\u0443\u0433\u0438\u0445 \u043f\u0435\u0440\u0435\u043c\u0435\u043d\u043d\u044b\u0445, \u0430 \u043f\u043e\u0442\u043e\u043c \u043f\u044b\u0442\u0430\u0435\u043c\u0441\u044f [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":28483,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-37955","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.2.1 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u0418\u0441\u0442\u043e\u0447\u043d\u0438\u043a:\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/linejnaya-regressiya-i-metody-eyo-vosstanovleniya\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.2.1\" \/>\n\t\t<meta property=\"og:locale\" content=\"sq_AL\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u041b\u0438\u043d\u0435\u0439\u043d\u0430\u044f \u0440\u0435\u0433\u0440\u0435\u0441\u0441\u0438\u044f \u0438 \u043c\u0435\u0442\u043e\u0434\u044b \u0435\u0451 \u0432\u043e\u0441\u0441\u0442\u0430\u043d\u043e\u0432\u043b\u0435\u043d\u0438\u044f | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u0418\u0441\u0442\u043e\u0447\u043d\u0438\u043a:\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/linejnaya-regressiya-i-metody-eyo-vosstanovleniya\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2019-10-31T19:20:47+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2019-10-31T19:20:47+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Regresioni linear dhe metodat e rikonstruktimit t\u00eb tij | ProHoster","description":"Burimi:","canonical_url":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/linejnaya-regressiya-i-metody-eyo-vosstanovleniya","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sq_AL","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041b\u0438\u043d\u0435\u0439\u043d\u0430\u044f \u0440\u0435\u0433\u0440\u0435\u0441\u0441\u0438\u044f \u0438 \u043c\u0435\u0442\u043e\u0434\u044b \u0435\u0451 \u0432\u043e\u0441\u0441\u0442\u0430\u043d\u043e\u0432\u043b\u0435\u043d\u0438\u044f | ProHoster","og:description":"\u0418\u0441\u0442\u043e\u0447\u043d\u0438\u043a:","og:url":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/linejnaya-regressiya-i-metody-eyo-vosstanovleniya","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-10-31T19:20:47+00:00","article:modified_time":"2019-10-31T19:20:47+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"37955","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-01-23 19:55:19","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-03-01 01:17:23","updated":"2026-01-23 19:55:19","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/37955","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/comments?post=37955"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/37955\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media\/28483"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media?parent=37955"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/categories?post=37955"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/tags?post=37955"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}