Kev tshuaj xyuas ntawm cov cuab yeej pub dawb SQLIndexManager

Raws li koj paub, indexes ua lub luag haujlwm tseem ceeb hauv DBMS, muab kev tshawb nrhiav ceev rau cov ntaub ntawv xav tau. Tias yog vim li cas nws tseem ceeb heev rau kev pab lawv raws sijhawm. Muaj ntau cov ntaub ntawv tau sau txog kev tshuaj xyuas thiab kev ua kom zoo, suav nrog hauv Internet. Piv txwv li, lub ntsiab lus no tsis ntev los no tau tshuaj xyuas hauv daim ntawv no.

Muaj ntau yam kev them nyiaj thiab kev daws teeb meem dawb rau qhov no. Piv txwv li, muaj ib qho npaj txhij qhov kev txiav txim siab, raws li ib qho kev hloov kho index optimization txoj kev.

Tom ntej no, cia peb saib cov khoom siv dawb SQLIndexManager, sau los ntawm AlanDenton.

Lub ntsiab kev sib txawv ntawm SQLIndexManager thiab ib tug xov tooj ntawm lwm yam analogues yog muab los ntawm tus sau nws tus kheej no и no.

Hauv tsab xov xwm no, peb yuav saib sab nraud ntawm qhov project thiab lub peev xwm ua haujlwm ntawm qhov kev daws teeb meem software no.

Sib tham txog kev siv hluav taws xob no no.
Nyob rau tib lub sijhawm, feem ntau ntawm cov lus pom thiab kab laum raug kho.

Yog li, cia peb tam sim no txav mus rau SQLIndexManager qhov hluav taws xob nws tus kheej.

Daim ntawv thov yog sau rau hauv C# .NET Framework 4.5 hauv Visual Studio 2017 thiab siv DevExpress rau cov ntawv:

thiab zoo li no:

Txhua qhov kev thov raug tsim tawm hauv cov ntaub ntawv hauv qab no:

1. Index
2. Lus nug
3. QueryEngine
4. ServerInfo

Thaum txuas rau lub database thiab xa cov lus nug mus rau DBMS, daim ntawv thov raug kos npe raws li hauv qab no:

ApplicationName=”SQLIndexManager”

Thaum koj tso daim ntawv thov, lub qhov rais modal yuav qhib ntxiv rau kev sib txuas:

Ntawm no, loading ib daim ntawv teev tag nrho ntawm MS SQL neeg rau zaub mov piv txwv nkag tau rau hauv zos tes hauj lwm tseem tsis tau ua hauj lwm.

Koj tseem tuaj yeem ntxiv qhov kev sib txuas uas siv lub pob laug kawg ntawm cov ntawv qhia zaub mov tseem ceeb:

Tom ntej no, cov lus nug hauv qab no rau DBMS yuav pib:

1. Tau txais cov ntaub ntawv hais txog DBMS

   SELECT ProductLevel  = SERVERPROPERTY('ProductLevel')
        , Edition       = SERVERPROPERTY('Edition')
        , ServerVersion = SERVERPROPERTY('ProductVersion')
        , IsSysAdmin    = CAST(IS_SRVROLEMEMBER('sysadmin') AS BIT)
   

2. Tau txais ib daim ntawv teev cov databases muaj nrog lawv cov khoom luv luv

   SELECT DatabaseName = t.[name]
        , d.DataSize
        , DataUsedSize  = CAST(NULL AS BIGINT)
        , d.LogSize
        , LogUsedSize   = CAST(NULL AS BIGINT)
        , RecoveryModel = t.recovery_model_desc
        , LogReuseWait  = t.log_reuse_wait_desc
   FROM sys.databases t WITH(NOLOCK)
   LEFT JOIN (
       SELECT [database_id]
            , DataSize = SUM(CASE WHEN [type] = 0 THEN CAST(size AS BIGINT) END)
            , LogSize  = SUM(CASE WHEN [type] = 1 THEN CAST(size AS BIGINT) END)
       FROM sys.master_files WITH(NOLOCK)
       GROUP BY [database_id]
   ) d ON d.[database_id] = t.[database_id]
   WHERE t.[state] = 0
       AND t.[database_id] != 2
       AND ISNULL(HAS_DBACCESS(t.[name]), 1) = 1
   

Tom qab ua tiav cov ntawv sau saum toj no, lub qhov rais yuav tshwm sim uas muaj cov ntaub ntawv luv luv txog cov ntaub ntawv ntawm qhov kev xaiv ntawm MS SQL Server:

Nws yog tsim nyog sau cia tias cov ntaub ntawv txuas ntxiv yog qhia raws li cov cai. Yog muaj sysadmin, ces koj tuaj yeem xaiv cov ntaub ntawv los ntawm kev saib sys.master_files. Yog tias tsis muaj cov cai li no, cov ntaub ntawv tsawg dua tsuas yog rov qab los kom tsis txhob ua kom qeeb ntawm qhov kev thov.

Ntawm no koj yuav tsum xaiv cov databases ntawm kev txaus siab thiab nyem rau ntawm "OK" khawm.

Tom ntej no, tsab ntawv hauv qab no yuav raug tua rau txhua qhov chaw khaws ntaub ntawv xaiv los txheeb xyuas lub xeev ntawm cov indexes:

Index xwm txheej tsom xam

declare @Fragmentation float=15;
declare @MinIndexSize bigint=768;
declare @MaxIndexSize bigint=1048576;
declare @PreDescribeSize bigint=32768;
SET NOCOUNT ON
SET ARITHABORT ON
SET NUMERIC_ROUNDABORT OFF
IF OBJECT_ID('tempdb.dbo.#AllocationUnits') IS NOT NULL
DROP TABLE #AllocationUnits
CREATE TABLE #AllocationUnits (
ContainerID   BIGINT PRIMARY KEY
, ReservedPages BIGINT NOT NULL
, UsedPages     BIGINT NOT NULL
)
INSERT INTO #AllocationUnits (ContainerID, ReservedPages, UsedPages)
SELECT [container_id]
, SUM([total_pages])
, SUM([used_pages])
FROM sys.allocation_units WITH(NOLOCK)
GROUP BY [container_id]
HAVING SUM([total_pages]) BETWEEN @MinIndexSize AND @MaxIndexSize
IF OBJECT_ID('tempdb.dbo.#ExcludeList') IS NOT NULL
DROP TABLE #ExcludeList
CREATE TABLE #ExcludeList (ID INT PRIMARY KEY)
INSERT INTO #ExcludeList
SELECT [object_id]
FROM sys.objects WITH(NOLOCK)
WHERE [type] IN ('V', 'U')
AND ( [is_ms_shipped] = 1 )
IF OBJECT_ID('tempdb.dbo.#Partitions') IS NOT NULL
DROP TABLE #Partitions
SELECT [object_id]
, [index_id]
, [partition_id]
, [partition_number]
, [rows]
, [data_compression]
INTO #Partitions
FROM sys.partitions WITH(NOLOCK)
WHERE [object_id] > 255
AND [rows] > 0
AND [object_id] NOT IN (SELECT * FROM #ExcludeList)
IF OBJECT_ID('tempdb.dbo.#Indexes') IS NOT NULL
DROP TABLE #Indexes
CREATE TABLE #Indexes (
ObjectID         INT NOT NULL
, IndexID          INT NOT NULL
, IndexName        SYSNAME NULL
, PagesCount       BIGINT NOT NULL
, UnusedPagesCount BIGINT NOT NULL
, PartitionNumber  INT NOT NULL
, RowsCount        BIGINT NOT NULL
, IndexType        TINYINT NOT NULL
, IsAllowPageLocks BIT NOT NULL
, DataSpaceID      INT NOT NULL
, DataCompression  TINYINT NOT NULL
, IsUnique         BIT NOT NULL
, IsPK             BIT NOT NULL
, FillFactorValue  INT NOT NULL
, IsFiltered       BIT NOT NULL
, PRIMARY KEY (ObjectID, IndexID, PartitionNumber)
)
INSERT INTO #Indexes
SELECT ObjectID         = i.[object_id]
, IndexID          = i.index_id
, IndexName        = i.[name]
, PagesCount       = a.ReservedPages
, UnusedPagesCount = CASE WHEN ABS(a.ReservedPages - a.UsedPages) > 32 THEN a.ReservedPages - a.UsedPages ELSE 0 END
, PartitionNumber  = p.[partition_number]
, RowsCount        = ISNULL(p.[rows], 0)
, IndexType        = i.[type]
, IsAllowPageLocks = i.[allow_page_locks]
, DataSpaceID      = i.[data_space_id]
, DataCompression  = p.[data_compression]
, IsUnique         = i.[is_unique]
, IsPK             = i.[is_primary_key]
, FillFactorValue  = i.[fill_factor]
, IsFiltered       = i.[has_filter]
FROM #AllocationUnits a
JOIN #Partitions p ON a.ContainerID = p.[partition_id]
JOIN sys.indexes i WITH(NOLOCK) ON i.[object_id] = p.[object_id] AND p.[index_id] = i.[index_id] 
WHERE i.[type] IN (0, 1, 2, 5, 6)
AND i.[object_id] > 255
DECLARE @files TABLE (ID INT PRIMARY KEY)
INSERT INTO @files
SELECT DISTINCT [data_space_id]
FROM sys.database_files WITH(NOLOCK)
WHERE [state] != 0
AND [type] = 0
IF @@ROWCOUNT > 0 BEGIN
DELETE FROM i
FROM #Indexes i
LEFT JOIN sys.destination_data_spaces dds WITH(NOLOCK) ON i.DataSpaceID = dds.[partition_scheme_id] AND i.PartitionNumber = dds.[destination_id]
WHERE ISNULL(dds.[data_space_id], i.DataSpaceID) IN (SELECT * FROM @files)
END
DECLARE @DBID   INT
, @DBNAME SYSNAME
SET @DBNAME = DB_NAME()
SELECT @DBID = [database_id]
FROM sys.databases WITH(NOLOCK)
WHERE [name] = @DBNAME
IF OBJECT_ID('tempdb.dbo.#Fragmentation') IS NOT NULL
DROP TABLE #Fragmentation
CREATE TABLE #Fragmentation (
ObjectID         INT NOT NULL
, IndexID          INT NOT NULL
, PartitionNumber  INT NOT NULL
, Fragmentation    FLOAT NOT NULL
, PRIMARY KEY (ObjectID, IndexID, PartitionNumber)
)
INSERT INTO #Fragmentation (ObjectID, IndexID, PartitionNumber, Fragmentation)
SELECT i.ObjectID
, i.IndexID
, i.PartitionNumber
, r.[avg_fragmentation_in_percent]
FROM #Indexes i
CROSS APPLY sys.dm_db_index_physical_stats(@DBID, i.ObjectID, i.IndexID, i.PartitionNumber, 'LIMITED') r
WHERE i.PagesCount <= @PreDescribeSize
AND r.[index_level] = 0
AND r.[alloc_unit_type_desc] = 'IN_ROW_DATA'
AND i.IndexType IN (0, 1, 2)
IF OBJECT_ID('tempdb.dbo.#Columns') IS NOT NULL
DROP TABLE #Columns
CREATE TABLE #Columns (
ObjectID     INT NOT NULL
, ColumnID     INT NOT NULL
, ColumnName   SYSNAME NULL
, SystemTypeID TINYINT NULL
, IsSparse     BIT
, IsColumnSet  BIT
, MaxLen       INT
, PRIMARY KEY (ObjectID, ColumnID)
)
INSERT INTO #Columns
SELECT ObjectID     = [object_id]
, ColumnID     = [column_id]
, ColumnName   = [name]
, SystemTypeID = [system_type_id]
, IsSparse     = [is_sparse]
, IsColumnSet  = [is_column_set]
, MaxLen       = [max_length]
FROM sys.columns WITH(NOLOCK)
WHERE [object_id] IN (SELECT DISTINCT i.ObjectID FROM #Indexes i)
IF OBJECT_ID('tempdb.dbo.#IndexColumns') IS NOT NULL
DROP TABLE #IndexColumns
CREATE TABLE #IndexColumns (
ObjectID   INT NOT NULL
, IndexID    INT NOT NULL
, OrderID    INT NOT NULL
, ColumnID   INT NOT NULL
, IsIncluded BIT NOT NULL
, PRIMARY KEY (ObjectID, IndexID, ColumnID)
)
INSERT INTO #IndexColumns
SELECT ObjectID   = [object_id]
, IndexID    = [index_id]
, OrderID    = CASE WHEN [is_included_column] = 0 THEN [key_ordinal] ELSE [index_column_id] END
, ColumnID   = [column_id]
, IsIncluded = ISNULL([is_included_column], 0)
FROM sys.index_columns ic WITH(NOLOCK)
WHERE EXISTS(
SELECT *
FROM #Indexes i
WHERE i.ObjectID = ic.[object_id]
AND i.IndexID = ic.[index_id]
AND i.IndexType IN (1, 2)
)
IF OBJECT_ID('tempdb.dbo.#Lob') IS NOT NULL
DROP TABLE #Lob
CREATE TABLE #Lob (
ObjectID    INT NOT NULL
, IndexID     INT NOT NULL
, IsLobLegacy BIT
, IsLob       BIT
, PRIMARY KEY (ObjectID, IndexID)
)
INSERT INTO #Lob (ObjectID, IndexID, IsLobLegacy, IsLob)
SELECT c.ObjectID
, IndexID     = ISNULL(i.IndexID, 1)
, IsLobLegacy = MAX(CASE WHEN c.SystemTypeID IN (34, 35, 99) THEN 1 END)
, IsLob       = 0
FROM #Columns c
LEFT JOIN #IndexColumns i ON c.ObjectID = i.ObjectID AND c.ColumnID = i.ColumnID
WHERE c.SystemTypeID IN (34, 35, 99)
GROUP BY c.ObjectID
, i.IndexID
IF OBJECT_ID('tempdb.dbo.#Sparse') IS NOT NULL
DROP TABLE #Sparse
CREATE TABLE #Sparse (ObjectID INT PRIMARY KEY)
INSERT INTO #Sparse
SELECT DISTINCT ObjectID
FROM #Columns
WHERE IsSparse = 1
OR IsColumnSet = 1
IF OBJECT_ID('tempdb.dbo.#AggColumns') IS NOT NULL
DROP TABLE #AggColumns
CREATE TABLE #AggColumns (
ObjectID        INT NOT NULL
, IndexID         INT NOT NULL
, IndexColumns    NVARCHAR(MAX)
, IncludedColumns NVARCHAR(MAX)
, PRIMARY KEY (ObjectID, IndexID)
)
INSERT INTO #AggColumns
SELECT t.ObjectID
, t.IndexID
, IndexColumns = STUFF((
SELECT ', [' + c.ColumnName + ']'
FROM #IndexColumns i
JOIN #Columns c ON i.ObjectID = c.ObjectID AND i.ColumnID = c.ColumnID
WHERE i.ObjectID = t.ObjectID
AND i.IndexID = t.IndexID
AND i.IsIncluded = 0
ORDER BY i.OrderID
FOR XML PATH(''), TYPE).value('(./text())[1]', 'NVARCHAR(MAX)'), 1, 2, '')
, IncludedColumns = STUFF((
SELECT ', [' + c.ColumnName + ']'
FROM #IndexColumns i
JOIN #Columns c ON i.ObjectID = c.ObjectID AND i.ColumnID = c.ColumnID
WHERE i.ObjectID = t.ObjectID
AND i.IndexID = t.IndexID
AND i.IsIncluded = 1
ORDER BY i.OrderID
FOR XML PATH(''), TYPE).value('(./text())[1]', 'NVARCHAR(MAX)'), 1, 2, '')
FROM (
SELECT DISTINCT ObjectID, IndexID
FROM #Indexes
WHERE IndexType IN (1, 2)
) t
SELECT i.ObjectID
, i.IndexID
, i.IndexName
, ObjectName       = o.[name]
, SchemaName       = s.[name]
, i.PagesCount
, i.UnusedPagesCount
, i.PartitionNumber
, i.RowsCount
, i.IndexType
, i.IsAllowPageLocks
, u.TotalWrites
, u.TotalReads
, u.TotalSeeks
, u.TotalScans
, u.TotalLookups
, u.LastUsage
, i.DataCompression
, f.Fragmentation
, IndexStats       = STATS_DATE(i.ObjectID, i.IndexID)
, IsLobLegacy      = ISNULL(lob.IsLobLegacy, 0)
, IsLob            = ISNULL(lob.IsLob, 0)
, IsSparse         = CAST(CASE WHEN p.ObjectID IS NULL THEN 0 ELSE 1 END AS BIT)
, IsPartitioned    = CAST(CASE WHEN dds.[data_space_id] IS NOT NULL THEN 1 ELSE 0 END AS BIT)
, FileGroupName    = fg.[name]
, i.IsUnique
, i.IsPK
, i.FillFactorValue
, i.IsFiltered
, a.IndexColumns
, a.IncludedColumns
FROM #Indexes i
JOIN sys.objects o WITH(NOLOCK) ON o.[object_id] = i.ObjectID
JOIN sys.schemas s WITH(NOLOCK) ON s.[schema_id] = o.[schema_id]
LEFT JOIN #AggColumns a ON a.ObjectID = i.ObjectID AND a.IndexID = i.IndexID
LEFT JOIN #Sparse p ON p.ObjectID = i.ObjectID
LEFT JOIN #Fragmentation f ON f.ObjectID = i.ObjectID AND f.IndexID = i.IndexID AND f.PartitionNumber = i.PartitionNumber
LEFT JOIN (
SELECT ObjectID      = [object_id]
, IndexID       = [index_id]
, TotalWrites   = NULLIF([user_updates], 0)
, TotalReads    = NULLIF([user_seeks] + [user_scans] + [user_lookups], 0)
, TotalSeeks    = NULLIF([user_seeks], 0)
, TotalScans    = NULLIF([user_scans], 0)
, TotalLookups  = NULLIF([user_lookups], 0)
, LastUsage     = (
SELECT MAX(dt)
FROM (
VALUES ([last_user_seek])
, ([last_user_scan])
, ([last_user_lookup])
, ([last_user_update])
) t(dt)
)
FROM sys.dm_db_index_usage_stats WITH(NOLOCK)
WHERE [database_id] = @DBID
) u ON i.ObjectID = u.ObjectID AND i.IndexID = u.IndexID
LEFT JOIN #Lob lob ON lob.ObjectID = i.ObjectID AND lob.IndexID = i.IndexID
LEFT JOIN sys.destination_data_spaces dds WITH(NOLOCK) ON i.DataSpaceID = dds.[partition_scheme_id] AND i.PartitionNumber = dds.[destination_id]
JOIN sys.filegroups fg WITH(NOLOCK) ON ISNULL(dds.[data_space_id], i.DataSpaceID) = fg.[data_space_id] 
WHERE o.[type] IN ('V', 'U')
AND (
f.Fragmentation >= @Fragmentation
OR
i.PagesCount > @PreDescribeSize
OR
i.IndexType IN (5, 6)
)

Raws li tuaj yeem pom los ntawm cov lus nug lawv tus kheej, cov ntxhuav ib ntus tau siv ntau zaus. Qhov no yog ua kom tsis muaj recompilations, thiab nyob rau hauv cov ntaub ntawv ntawm ib tug loj lub tswv yim, lub tswv yim yuav tsum generated nyob rau hauv parallel thaum inserting cov ntaub ntawv, txij li thaum inserting rooj variables yog ua tau tsuas yog nyob rau hauv ib tug xov.

Tom qab ua tiav cov ntawv sau saum toj no, lub qhov rais nrog lub rooj ntsuas ntsuas yuav tshwm sim:

Koj tuaj yeem tso saib lwm cov ncauj lus kom ntxaws ntawm no, xws li:

1. database
2. tus naj npawb ntawm ntu
3. hnub thiab lub sijhawm hu xovtooj kawg
4. nyem
5. pawg ntaub ntawv

thiab ua li ntawd.
Cov neeg hais lus lawv tus kheej tuaj yeem hloov kho:

Hauv cov hlwb ntawm Kho kab ke, koj tuaj yeem xaiv qhov kev txiav txim yuav ua thaum ua kom zoo. Tsis tas li ntawd, thaum lub scan ua tiav, ib qho kev ua haujlwm raug xaiv raws li cov kev xaiv xaiv:

Koj yuav tsum xaiv qhov xav tau indexes rau kev ua.

Siv cov ntawv qhia zaub mov tseem ceeb, koj tuaj yeem txuag tau tsab ntawv ( tib lub pob pib qhov txheej txheem kev ua kom zoo dua nws tus kheej):

thiab txuag lub rooj nyob rau hauv ntau hom ntawv (ib lub pob tso cai rau koj qhib cov ncauj lus kom ntxaws kev ntsuam xyuas thiab optimizing indexes):

Koj tuaj yeem hloov kho cov ntaub ntawv los ntawm nyem rau ntawm lub pob thib peb ntawm sab laug hauv cov ntawv qhia zaub mov tseem ceeb ntawm lub iav magnifying.

Lub pob nrog lub iav loj tso cai rau koj xaiv cov ntaub ntawv xav tau rau kev txiav txim siab.

Tam sim no tsis muaj kev pab cuam dav dav. Yog li ntawd, nias lub pob "?" yuav tsuas ua rau lub qhov rais modal tshwm sim uas muaj cov ntaub ntawv yooj yim txog cov khoom siv software:

Ntxiv rau txhua yam uas tau piav saum toj no, cov ntawv qhia zaub mov tseem ceeb muaj qhov tshawb nrhiav:

Thaum pib cov txheej txheem index optimization:

Koj tseem tuaj yeem saib lub cav ntawm kev ua tau zoo nyob hauv qab ntawm lub qhov rais:

Nyob rau hauv cov ncauj lus kom ntxaws qhov rais rau kev ntsuas ntsuas thiab optimization, koj tuaj yeem teeb tsa cov kev xaiv hloov maj mam:

Thov rau daim ntawv thov:

1. ua kom nws muaj peev xwm xaiv hloov kho cov txheeb cais tsis yog tsuas yog rau indexes thiab kuj nyob rau hauv ntau txoj kev (tag nrho hloov tshiab los yog ib nrab)
2. ua kom nws ua tsis tau tsuas yog xaiv ib lub database, tab sis kuj txawv servers (qhov no yooj yim heev thaum muaj ntau zaus ntawm MS SQL Server)
3. Txhawm rau siv tau yooj yim dua, nws tau hais kom qhwv cov lus txib hauv cov tsev qiv ntawv thiab tso tawm rau PowerShell cov lus txib, raws li tau ua tiav, piv txwv li, ntawm no:
4. dbatools.io/cov
5. ua kom nws tuaj yeem txuag thiab hloov chaw tus kheej ob qho tib si rau tag nrho daim ntawv thov thiab, yog tias tsim nyog, rau txhua qhov piv txwv ntawm MS SQL Server thiab txhua lub database
6. Los ntawm cov ntsiab lus 2 thiab 4, nws ua raws li koj xav tsim pab pawg los ntawm databases thiab pab pawg los ntawm MS SQL Server piv txwv, uas cov chaw yog tib yam.
7. tshawb nrhiav duplicate indexes (ua kom tiav thiab tsis tiav, uas yog me ntsis txawv los yog txawv tsuas yog nyob rau hauv cov kab ke)
8. Txij li thaum SQLIndexManager tsuas yog siv rau MS SQL Server DBMS, nws yog qhov tsim nyog los cuam tshuam qhov no hauv lub npe, piv txwv li, raws li hauv qab no: SQLIndexManager rau MS SQL Server
9. Txav tag nrho cov tsis-GUI qhov chaw ntawm daim ntawv thov mus rau hauv cov modules cais thiab rov sau lawv hauv .NET Core 2.1

Thaum lub sijhawm sau ntawv, nqe lus 6 ntawm qhov kev xav tau tab tom tsim thiab muaj kev txhawb nqa nyob rau hauv daim ntawv ntawm kev tshawb nrhiav kom tiav thiab zoo sib xws:

Cov chaw

• adaptive index optimization txoj kev
• SQLIndexManager utility
• luv luv technical txheej txheem cej luam ntawm SQLIndexManager utility
• kev sib tham ntawm SQLIndexManager utility
• SQL Index Manager - Dawb GUI Tool rau Index Maintenance ntawm SQL Server thiab Azure
• SQL Server Index Analysis thiab Optimization

Tau qhov twg los: www.hab.com