Tso tawm TileDB 2.0 cia cav

Luam tawm rau repository TileDB 2.0, optimized rau khaws cia multidimensional arrays thiab cov ntaub ntawv siv nyob rau hauv scientific xam. Ntau lub tshuab rau kev ua cov ntaub ntawv genetic, spatial thiab nyiaj txiag cov ntaub ntawv tau hais raws li thaj chaw ntawm daim ntawv thov rau TileDB, i.e. kev khiav hauj lwm systems nyias los yog tsis tu ncua puv multidimensional arrays. TileDB muaj lub tsev qiv ntawv C ++ rau pob tshab nkag mus rau cov ntaub ntawv thiab cov ntaub ntawv metadata hauv cov ntawv thov, saib xyuas txhua qhov haujlwm qis rau kev khaws cia zoo. Qhov project code yog sau hauv C ++ thiab faib los ntawm nyob rau hauv MIT daim ntawv tso cai. Txhawb kev ua haujlwm ntawm Linux, macOS thiab Windows.

Cov yam ntxwv tseem ceeb ntawm TileDB:

  • Txoj kev ua tau zoo rau kev khaws cia sparse arrays, cov ntaub ntawv uas tsis tas mus li; cov array tau ntim nrog cov khoom tawg thiab feem ntau ntawm cov ntsiab lus tseem khoob lossis coj tus nqi qub.
  • Muaj peev xwm nkag tau cov ntaub ntawv hauv cov ntawv tseem ceeb lossis kab ke kab (DataFrame);

    Tso tawm TileDB 2.0 cia cav

  • Txhawb kev koom ua ke nrog huab cia AWS S3, Google Cloud Storage thiab Azure Blob Storage;
  • Kev them nyiaj yug rau pobzeb (thaiv) arrays;
  • Muaj peev xwm siv cov ntaub ntawv sib txawv compression thiab encryption algorithms;
  • Kev them nyiaj yug rau kev kuaj xyuas kev ncaj ncees siv cov checksums;
  • Ua hauj lwm nyob rau hauv multi-threaded hom nrog parallel input / output;
  • Kev them nyiaj yug rau kev hloov kho cov ntaub ntawv khaws tseg, suav nrog rau kev rov qab los ntawm lub xeev ntawm qee qhov taw qhia yav dhau los lossis kev hloov kho atomic ntawm tag nrho cov teeb tsa loj.
  • Muaj peev xwm txuas metadata;
  • Kev them nyiaj yug rau cov ntaub ntawv pab pawg;
  • Kev koom ua ke modules siv los ua lub cav qis qis hauv Spark, Dask, MariaDB, GDAL, PDAL, Rasterio, gVCF thiab PrestoDB;
  • Kev khi cov tsev qiv ntawv rau C ++ API rau Python, R, Java thiab Go.

Tso tawm 2.0 yog qhov tseem ceeb rau nws txoj kev txhawb nqa rau "DataFrame" lub tswv yim, uas tso cai rau cov ntaub ntawv khaws cia rau hauv daim ntawv ntawm kab ntawm qhov tseem ceeb ntawm qhov ntev ntev, khi rau qee yam cwj pwm. Qhov chaw cia kuj tseem ua kom zoo rau kev ua cov khoom sib txawv ntawm ntau qhov sib txawv (cov cell tuaj yeem khaws cov ntaub ntawv ntawm ntau hom thiab tuaj yeem ua haujlwm sib koom ua ke ntawm txhua hom sib txawv, piv txwv li, cov npe khaws cia, sijhawm thiab nqi). Ntxiv kev txhawb nqa rau kab nrog cov ntaub ntawv hlua. Ntxiv cov qauv rau kev koom ua ke nrog Google Cloud Storage thiab Azure Blob Storage. API rau R hom tau raug kho dua tshiab.

Tau qhov twg los: opennet.ru

Ntxiv ib saib