Ukukhishwa kwenjini yokugcina ye-TileDB 2.0

Kushicilelwe ku indawo yokugcina I-TileDB 2.0, elungiselelwe ukugcina ama-multidimensional arrays kanye nedatha esetshenziswa ezibalweni zesayensi. Amasistimu ahlukahlukene okucubungula ulwazi lofuzo, idatha yendawo kanye nezezimali ishiwo njengezindawo zokufaka izicelo ze-TileDB, i.e. izinhlelo zokusebenza kancane noma ama-multidimensional agcwele ngokuqhubekayo. I-TileDB inikeza umtapo wezincwadi we-C++ wokukhipha ngokusobala ukufinyelela kwedatha nemethadatha ezinhlelweni zokusebenza, ukunakekela wonke umsebenzi osezingeni eliphansi ukuze ugcinwe kahle. Ikhodi yephrojekthi ibhalwe ku-C++ futhi isatshalaliswa ngu ngaphansi kwelayisense ye-MIT. Isekela umsebenzi ku-Linux, macOS kanye neWindows.

Izici eziyinhloko ze-TileDB:

  • Izindlela ezisebenzayo zokugcina amalungu afanayo ayinqamule, idatha lapho ingaqhubeki; amalungu afanayo agcwaliswa izingcezu futhi izinto eziningi zihlala zingenalutho noma zithatha inani elifanayo.
  • Ikhono lokufinyelela idatha ngefomethi yenani elingukhiye noma amasethi ekholomu (IdathaFrame);

    Ukukhishwa kwenjini yokugcina ye-TileDB 2.0

  • Isekela ukuhlanganiswa nesitoreji samafu i-AWS S3, i-Google Cloud Storage kanye ne-Azure Blob Storage;
  • Ukusekelwa kwama-tile (block) arrays;
  • Ikhono lokusebenzisa ukucindezelwa kwedatha okuhlukile kanye nama-algorithms wokubethela;
  • Ukusekelwa kokuhlolwa kobuqotho kusetshenziswa amasheke;
  • Sebenza ngemodi enezintambo eziningi ngokufaka/okuphumayo okufanayo;
  • Ukusekelwa kwenguqulo yedatha egciniwe, okuhlanganisa ukubuyisa isimo endaweni ethile esikhathini esidlule noma izibuyekezo ze-athomu zawo wonke amasethi amakhulu.
  • Ikhono lokuxhuma imethadatha;
  • Ukusekelwa kokuqoqwa kwedatha;
  • Amamojula okuhlanganisa azosetshenziswa njengenjini yokugcina izinga eliphansi ku-Spark, Dask, MariaDB, GDAL, PDAL, Rasterio, gVCF kanye ne-PrestoDB;
  • Imitapo yolwazi ebophezelayo ye-C++ API ye-Python, R, Java ne-Go.

Ukukhishwa okungu-2.0 kuyaphawuleka ngokusekela kwakho umqondo we-β€œDataFrame”, ovumela idatha ukuthi igcinwe ngendlela yamakholomu wamanani wobude obungalingani, eboshelwe kuzici ezithile. Isitoreji siphinde sithuthukiswe ukuze kucutshungulwe ama-array ayincwajana osayizi abahlukahlukene (amaseli angagcina idatha yezinhlobo ezihlukene futhi angenza imisebenzi yokuhlanganisa kumakholomu ezinhlobo ezahlukene, isibonelo, lawo agcina igama, isikhathi kanye nentengo). Kwengezwe usekelo lwamakholomu anedatha yeyunithi yezinhlamvu. Kungezwe amamojula okuhlanganiswa ne-Google Cloud Storage kanye ne-Azure Blob Storage. I-API yolimi lwe-R isiklanywe kabusha.

Source: opennet.ru

Engeza amazwana