Tinjauan alat gratis SQLIndexManager

Sakumaha anjeun terang, indéks maénkeun peran anu penting dina DBMS, nyayogikeun panéangan gancang kana rékaman anu diperyogikeun. Éta sababna penting pisan pikeun ngalayanan aranjeunna dina waktosna. Cukup seueur bahan anu ditulis ngeunaan analisa sareng optimasi, kalebet dina Internét. Salaku conto, topik ieu nembe diulas dina ieu publikasi.

Aya seueur solusi anu mayar sareng gratis pikeun ieu. Contona, aya hiji siap-dijieun solusi, dumasar kana métode optimasi indéks adaptif.

Salajengna, hayu urang tingali utilitas gratis SQLIndexManager, dikarang ku AlanDenton.

Beda téknis utama antara SQLIndexManager sareng sajumlah analog sanésna dipasihkeun ku panulis nyalira di dieu и di dieu.

Dina tulisan ieu, urang bakal ningali kaluar proyék sareng kamampuan operasional tina solusi parangkat lunak ieu.

Ngabahas utiliti ieu di dieu.
Kana waktosna, seueur koméntar sareng bug dilereskeun.

Janten, hayu urang teraskeun kana utilitas SQLIndexManager sorangan.

Aplikasina ditulis dina C# .NET Framework 4.5 dina Visual Studio 2017 sareng nganggo DevExpress pikeun bentuk:

sareng siga kieu:

Kabéh requests dihasilkeun dina file handap:

1. daptar eusi
2. nyangsikeun
3. QueryEngine
4. ServerInfo

Nalika nyambung ka database sareng ngirim patarosan ka DBMS, aplikasina ditandatanganan sapertos kieu:

ApplicationName=”SQLIndexManager”

Nalika anjeun ngaluncurkeun aplikasi, jandela modal bakal dibuka pikeun nambihan sambungan:

Di dieu, loading daptar lengkep sadaya instansi MS SQL Server diaksés ngaliwatan jaringan lokal teu acan jalan.

Anjeun ogé tiasa nambihan sambungan nganggo tombol pangkénca dina ménu utama:

Salajengna, patarosan di handap ieu ka DBMS bakal diluncurkeun:

1. Kéngingkeun inpormasi ngeunaan DBMS

   SELECT ProductLevel  = SERVERPROPERTY('ProductLevel')
        , Edition       = SERVERPROPERTY('Edition')
        , ServerVersion = SERVERPROPERTY('ProductVersion')
        , IsSysAdmin    = CAST(IS_SRVROLEMEMBER('sysadmin') AS BIT)
   

2. Kéngingkeun daptar pangkalan data anu sayogi sareng pasipatan ringkesna

   SELECT DatabaseName = t.[name]
        , d.DataSize
        , DataUsedSize  = CAST(NULL AS BIGINT)
        , d.LogSize
        , LogUsedSize   = CAST(NULL AS BIGINT)
        , RecoveryModel = t.recovery_model_desc
        , LogReuseWait  = t.log_reuse_wait_desc
   FROM sys.databases t WITH(NOLOCK)
   LEFT JOIN (
       SELECT [database_id]
            , DataSize = SUM(CASE WHEN [type] = 0 THEN CAST(size AS BIGINT) END)
            , LogSize  = SUM(CASE WHEN [type] = 1 THEN CAST(size AS BIGINT) END)
       FROM sys.master_files WITH(NOLOCK)
       GROUP BY [database_id]
   ) d ON d.[database_id] = t.[database_id]
   WHERE t.[state] = 0
       AND t.[database_id] != 2
       AND ISNULL(HAS_DBACCESS(t.[name]), 1) = 1
   

Saatos ngaéksekusi skrip di luhur, jandela bakal muncul anu ngandung inpormasi ringkes ngeunaan pangkalan data tina conto MS SQL Server anu dipilih:

Eta sia noting yén informasi nambahan ditémbongkeun dumasar kana hak. Lamun aya sysadmin, teras anjeun tiasa milih data tina tampilan sys.master_files. Upami teu aya hak sapertos kitu, maka kirang data dipulangkeun supados henteu ngalambatkeun pamundut.

Di dieu anjeun kedah milih pangkalan data anu dipikaresep sareng klik tombol "OK".

Salajengna, skrip di handap ieu bakal dieksekusi pikeun unggal pangkalan data anu dipilih pikeun nganalisis kaayaan indéks:

Analisis status indéks

declare @Fragmentation float=15;
declare @MinIndexSize bigint=768;
declare @MaxIndexSize bigint=1048576;
declare @PreDescribeSize bigint=32768;
SET NOCOUNT ON
SET ARITHABORT ON
SET NUMERIC_ROUNDABORT OFF
IF OBJECT_ID('tempdb.dbo.#AllocationUnits') IS NOT NULL
DROP TABLE #AllocationUnits
CREATE TABLE #AllocationUnits (
ContainerID   BIGINT PRIMARY KEY
, ReservedPages BIGINT NOT NULL
, UsedPages     BIGINT NOT NULL
)
INSERT INTO #AllocationUnits (ContainerID, ReservedPages, UsedPages)
SELECT [container_id]
, SUM([total_pages])
, SUM([used_pages])
FROM sys.allocation_units WITH(NOLOCK)
GROUP BY [container_id]
HAVING SUM([total_pages]) BETWEEN @MinIndexSize AND @MaxIndexSize
IF OBJECT_ID('tempdb.dbo.#ExcludeList') IS NOT NULL
DROP TABLE #ExcludeList
CREATE TABLE #ExcludeList (ID INT PRIMARY KEY)
INSERT INTO #ExcludeList
SELECT [object_id]
FROM sys.objects WITH(NOLOCK)
WHERE [type] IN ('V', 'U')
AND ( [is_ms_shipped] = 1 )
IF OBJECT_ID('tempdb.dbo.#Partitions') IS NOT NULL
DROP TABLE #Partitions
SELECT [object_id]
, [index_id]
, [partition_id]
, [partition_number]
, [rows]
, [data_compression]
INTO #Partitions
FROM sys.partitions WITH(NOLOCK)
WHERE [object_id] > 255
AND [rows] > 0
AND [object_id] NOT IN (SELECT * FROM #ExcludeList)
IF OBJECT_ID('tempdb.dbo.#Indexes') IS NOT NULL
DROP TABLE #Indexes
CREATE TABLE #Indexes (
ObjectID         INT NOT NULL
, IndexID          INT NOT NULL
, IndexName        SYSNAME NULL
, PagesCount       BIGINT NOT NULL
, UnusedPagesCount BIGINT NOT NULL
, PartitionNumber  INT NOT NULL
, RowsCount        BIGINT NOT NULL
, IndexType        TINYINT NOT NULL
, IsAllowPageLocks BIT NOT NULL
, DataSpaceID      INT NOT NULL
, DataCompression  TINYINT NOT NULL
, IsUnique         BIT NOT NULL
, IsPK             BIT NOT NULL
, FillFactorValue  INT NOT NULL
, IsFiltered       BIT NOT NULL
, PRIMARY KEY (ObjectID, IndexID, PartitionNumber)
)
INSERT INTO #Indexes
SELECT ObjectID         = i.[object_id]
, IndexID          = i.index_id
, IndexName        = i.[name]
, PagesCount       = a.ReservedPages
, UnusedPagesCount = CASE WHEN ABS(a.ReservedPages - a.UsedPages) > 32 THEN a.ReservedPages - a.UsedPages ELSE 0 END
, PartitionNumber  = p.[partition_number]
, RowsCount        = ISNULL(p.[rows], 0)
, IndexType        = i.[type]
, IsAllowPageLocks = i.[allow_page_locks]
, DataSpaceID      = i.[data_space_id]
, DataCompression  = p.[data_compression]
, IsUnique         = i.[is_unique]
, IsPK             = i.[is_primary_key]
, FillFactorValue  = i.[fill_factor]
, IsFiltered       = i.[has_filter]
FROM #AllocationUnits a
JOIN #Partitions p ON a.ContainerID = p.[partition_id]
JOIN sys.indexes i WITH(NOLOCK) ON i.[object_id] = p.[object_id] AND p.[index_id] = i.[index_id] 
WHERE i.[type] IN (0, 1, 2, 5, 6)
AND i.[object_id] > 255
DECLARE @files TABLE (ID INT PRIMARY KEY)
INSERT INTO @files
SELECT DISTINCT [data_space_id]
FROM sys.database_files WITH(NOLOCK)
WHERE [state] != 0
AND [type] = 0
IF @@ROWCOUNT > 0 BEGIN
DELETE FROM i
FROM #Indexes i
LEFT JOIN sys.destination_data_spaces dds WITH(NOLOCK) ON i.DataSpaceID = dds.[partition_scheme_id] AND i.PartitionNumber = dds.[destination_id]
WHERE ISNULL(dds.[data_space_id], i.DataSpaceID) IN (SELECT * FROM @files)
END
DECLARE @DBID   INT
, @DBNAME SYSNAME
SET @DBNAME = DB_NAME()
SELECT @DBID = [database_id]
FROM sys.databases WITH(NOLOCK)
WHERE [name] = @DBNAME
IF OBJECT_ID('tempdb.dbo.#Fragmentation') IS NOT NULL
DROP TABLE #Fragmentation
CREATE TABLE #Fragmentation (
ObjectID         INT NOT NULL
, IndexID          INT NOT NULL
, PartitionNumber  INT NOT NULL
, Fragmentation    FLOAT NOT NULL
, PRIMARY KEY (ObjectID, IndexID, PartitionNumber)
)
INSERT INTO #Fragmentation (ObjectID, IndexID, PartitionNumber, Fragmentation)
SELECT i.ObjectID
, i.IndexID
, i.PartitionNumber
, r.[avg_fragmentation_in_percent]
FROM #Indexes i
CROSS APPLY sys.dm_db_index_physical_stats(@DBID, i.ObjectID, i.IndexID, i.PartitionNumber, 'LIMITED') r
WHERE i.PagesCount <= @PreDescribeSize
AND r.[index_level] = 0
AND r.[alloc_unit_type_desc] = 'IN_ROW_DATA'
AND i.IndexType IN (0, 1, 2)
IF OBJECT_ID('tempdb.dbo.#Columns') IS NOT NULL
DROP TABLE #Columns
CREATE TABLE #Columns (
ObjectID     INT NOT NULL
, ColumnID     INT NOT NULL
, ColumnName   SYSNAME NULL
, SystemTypeID TINYINT NULL
, IsSparse     BIT
, IsColumnSet  BIT
, MaxLen       INT
, PRIMARY KEY (ObjectID, ColumnID)
)
INSERT INTO #Columns
SELECT ObjectID     = [object_id]
, ColumnID     = [column_id]
, ColumnName   = [name]
, SystemTypeID = [system_type_id]
, IsSparse     = [is_sparse]
, IsColumnSet  = [is_column_set]
, MaxLen       = [max_length]
FROM sys.columns WITH(NOLOCK)
WHERE [object_id] IN (SELECT DISTINCT i.ObjectID FROM #Indexes i)
IF OBJECT_ID('tempdb.dbo.#IndexColumns') IS NOT NULL
DROP TABLE #IndexColumns
CREATE TABLE #IndexColumns (
ObjectID   INT NOT NULL
, IndexID    INT NOT NULL
, OrderID    INT NOT NULL
, ColumnID   INT NOT NULL
, IsIncluded BIT NOT NULL
, PRIMARY KEY (ObjectID, IndexID, ColumnID)
)
INSERT INTO #IndexColumns
SELECT ObjectID   = [object_id]
, IndexID    = [index_id]
, OrderID    = CASE WHEN [is_included_column] = 0 THEN [key_ordinal] ELSE [index_column_id] END
, ColumnID   = [column_id]
, IsIncluded = ISNULL([is_included_column], 0)
FROM sys.index_columns ic WITH(NOLOCK)
WHERE EXISTS(
SELECT *
FROM #Indexes i
WHERE i.ObjectID = ic.[object_id]
AND i.IndexID = ic.[index_id]
AND i.IndexType IN (1, 2)
)
IF OBJECT_ID('tempdb.dbo.#Lob') IS NOT NULL
DROP TABLE #Lob
CREATE TABLE #Lob (
ObjectID    INT NOT NULL
, IndexID     INT NOT NULL
, IsLobLegacy BIT
, IsLob       BIT
, PRIMARY KEY (ObjectID, IndexID)
)
INSERT INTO #Lob (ObjectID, IndexID, IsLobLegacy, IsLob)
SELECT c.ObjectID
, IndexID     = ISNULL(i.IndexID, 1)
, IsLobLegacy = MAX(CASE WHEN c.SystemTypeID IN (34, 35, 99) THEN 1 END)
, IsLob       = 0
FROM #Columns c
LEFT JOIN #IndexColumns i ON c.ObjectID = i.ObjectID AND c.ColumnID = i.ColumnID
WHERE c.SystemTypeID IN (34, 35, 99)
GROUP BY c.ObjectID
, i.IndexID
IF OBJECT_ID('tempdb.dbo.#Sparse') IS NOT NULL
DROP TABLE #Sparse
CREATE TABLE #Sparse (ObjectID INT PRIMARY KEY)
INSERT INTO #Sparse
SELECT DISTINCT ObjectID
FROM #Columns
WHERE IsSparse = 1
OR IsColumnSet = 1
IF OBJECT_ID('tempdb.dbo.#AggColumns') IS NOT NULL
DROP TABLE #AggColumns
CREATE TABLE #AggColumns (
ObjectID        INT NOT NULL
, IndexID         INT NOT NULL
, IndexColumns    NVARCHAR(MAX)
, IncludedColumns NVARCHAR(MAX)
, PRIMARY KEY (ObjectID, IndexID)
)
INSERT INTO #AggColumns
SELECT t.ObjectID
, t.IndexID
, IndexColumns = STUFF((
SELECT ', [' + c.ColumnName + ']'
FROM #IndexColumns i
JOIN #Columns c ON i.ObjectID = c.ObjectID AND i.ColumnID = c.ColumnID
WHERE i.ObjectID = t.ObjectID
AND i.IndexID = t.IndexID
AND i.IsIncluded = 0
ORDER BY i.OrderID
FOR XML PATH(''), TYPE).value('(./text())[1]', 'NVARCHAR(MAX)'), 1, 2, '')
, IncludedColumns = STUFF((
SELECT ', [' + c.ColumnName + ']'
FROM #IndexColumns i
JOIN #Columns c ON i.ObjectID = c.ObjectID AND i.ColumnID = c.ColumnID
WHERE i.ObjectID = t.ObjectID
AND i.IndexID = t.IndexID
AND i.IsIncluded = 1
ORDER BY i.OrderID
FOR XML PATH(''), TYPE).value('(./text())[1]', 'NVARCHAR(MAX)'), 1, 2, '')
FROM (
SELECT DISTINCT ObjectID, IndexID
FROM #Indexes
WHERE IndexType IN (1, 2)
) t
SELECT i.ObjectID
, i.IndexID
, i.IndexName
, ObjectName       = o.[name]
, SchemaName       = s.[name]
, i.PagesCount
, i.UnusedPagesCount
, i.PartitionNumber
, i.RowsCount
, i.IndexType
, i.IsAllowPageLocks
, u.TotalWrites
, u.TotalReads
, u.TotalSeeks
, u.TotalScans
, u.TotalLookups
, u.LastUsage
, i.DataCompression
, f.Fragmentation
, IndexStats       = STATS_DATE(i.ObjectID, i.IndexID)
, IsLobLegacy      = ISNULL(lob.IsLobLegacy, 0)
, IsLob            = ISNULL(lob.IsLob, 0)
, IsSparse         = CAST(CASE WHEN p.ObjectID IS NULL THEN 0 ELSE 1 END AS BIT)
, IsPartitioned    = CAST(CASE WHEN dds.[data_space_id] IS NOT NULL THEN 1 ELSE 0 END AS BIT)
, FileGroupName    = fg.[name]
, i.IsUnique
, i.IsPK
, i.FillFactorValue
, i.IsFiltered
, a.IndexColumns
, a.IncludedColumns
FROM #Indexes i
JOIN sys.objects o WITH(NOLOCK) ON o.[object_id] = i.ObjectID
JOIN sys.schemas s WITH(NOLOCK) ON s.[schema_id] = o.[schema_id]
LEFT JOIN #AggColumns a ON a.ObjectID = i.ObjectID AND a.IndexID = i.IndexID
LEFT JOIN #Sparse p ON p.ObjectID = i.ObjectID
LEFT JOIN #Fragmentation f ON f.ObjectID = i.ObjectID AND f.IndexID = i.IndexID AND f.PartitionNumber = i.PartitionNumber
LEFT JOIN (
SELECT ObjectID      = [object_id]
, IndexID       = [index_id]
, TotalWrites   = NULLIF([user_updates], 0)
, TotalReads    = NULLIF([user_seeks] + [user_scans] + [user_lookups], 0)
, TotalSeeks    = NULLIF([user_seeks], 0)
, TotalScans    = NULLIF([user_scans], 0)
, TotalLookups  = NULLIF([user_lookups], 0)
, LastUsage     = (
SELECT MAX(dt)
FROM (
VALUES ([last_user_seek])
, ([last_user_scan])
, ([last_user_lookup])
, ([last_user_update])
) t(dt)
)
FROM sys.dm_db_index_usage_stats WITH(NOLOCK)
WHERE [database_id] = @DBID
) u ON i.ObjectID = u.ObjectID AND i.IndexID = u.IndexID
LEFT JOIN #Lob lob ON lob.ObjectID = i.ObjectID AND lob.IndexID = i.IndexID
LEFT JOIN sys.destination_data_spaces dds WITH(NOLOCK) ON i.DataSpaceID = dds.[partition_scheme_id] AND i.PartitionNumber = dds.[destination_id]
JOIN sys.filegroups fg WITH(NOLOCK) ON ISNULL(dds.[data_space_id], i.DataSpaceID) = fg.[data_space_id] 
WHERE o.[type] IN ('V', 'U')
AND (
f.Fragmentation >= @Fragmentation
OR
i.PagesCount > @PreDescribeSize
OR
i.IndexType IN (5, 6)
)

Salaku bisa ditempo ti queries sorangan, tabel samentara dipaké rada mindeng. Hal ieu dilakukeun ku kituna teu aya recompilations, sarta dina kasus skéma badag rencana bisa dihasilkeun dina paralel nalika inserting data, saprak inserting variabel tabel ngan mungkin dina hiji thread.

Saatos ngalaksanakeun skrip di luhur, jandela sareng tabel indéks bakal muncul:

Anjeun ogé tiasa ningalikeun inpormasi lengkep anu sanés di dieu, sapertos:

1. pangkalan data
2. jumlah bagian
3. tanggal jeung waktu panggero panungtungan
4. mencet
5. filegroup

na t. d.
Speaker sorangan bisa ngaropéa:

Dina sél kolom Fix, anjeun tiasa milih tindakan naon anu bakal dilakukeun nalika optimasi. Ogé, nalika scan parantos réngsé, tindakan standar dipilih dumasar kana setélan anu dipilih:

Anjeun kedah milih indéks anu dipikahoyong pikeun diolah.

Nganggo ménu utama, anjeun tiasa nyimpen naskah (tombol anu sami ngamimitian prosés optimasi indéks sorangan):

sareng simpen tabel dina format anu béda (tombol anu sami ngamungkinkeun anjeun muka setélan lengkep pikeun nganalisa sareng ngaoptimalkeun indéks):

Anjeun oge bisa ngamutahirkeun informasi ku ngaklik on tombol katilu dina kénca dina ménu utama gigireun kaca pembesar.

Tombol kalawan kaca pembesar ngidinan Anjeun pikeun milih database nu dipikahoyong pikeun tinimbangan.

Ayeuna teu aya sistem pitulung anu lengkep. Ku alatan éta, pencét tombol "?" ngan saukur bakal ngakibatkeun jandela modal pikeun nembongan ngandung émbaran dasar ngeunaan produk software:

Salian sadayana anu dijelaskeun di luhur, ménu utama ngagaduhan bar teang:

Nalika ngamimitian prosés optimasi indéks:

Anjeun ogé tiasa ningali log tindakan anu dilakukeun di handapeun jandela:

Dina jandéla setélan lengkep pikeun analisa indéks sareng optimasi, anjeun tiasa ngonpigurasikeun pilihan anu langkung halus:

Paménta pikeun aplikasi:

1. ngamungkinkeun sacara selektif ngamutahirkeun statistik henteu ngan ukur pikeun indéks sareng ogé ku cara anu béda (ngapdet pinuh atanapi sawaréh)
2. ngamungkinkeun henteu ngan ukur milih pangkalan data, tapi ogé server anu béda-béda (ieu cocog pisan nalika aya seueur conto MS SQL Server)
3. Pikeun kalenturan anu langkung ageung dianggo, disarankeun pikeun mungkus paréntah di perpustakaan sareng kaluarkeun kana paréntah PowerShell, sapertos anu dilakukeun, contona, di dieu:
4. dbatools.io/commands
5. ngamungkinkeun pikeun nyimpen sareng ngarobih setélan pribadi pikeun sakabéh aplikasi sareng, upami diperyogikeun, pikeun unggal conto MS SQL Server sareng unggal pangkalan data
6. Tina titik 2 sareng 4, anjeun badé nyiptakeun grup dumasar kana pangkalan data sareng grup ku instansi MS SQL Server, anu setélanna sami.
7. milarian indéks duplikat (lengkep sareng teu lengkep, anu rada béda atanapi ngan ukur béda dina kolom anu kalebet)
8. Kusabab SQLIndexManager dipaké ngan pikeun MS SQL Server DBMS, perlu pikeun ngagambarkeun ieu dina ngaran, contona, saperti kieu: SQLIndexManager pikeun MS SQL Server
9. Pindahkeun sadaya bagian non-GUI tina aplikasi kana modul anu misah sareng tuliskeun deui dina .NET Core 2.1

Dina waktos nyerat, item 6 tina kahayang keur aktip dimekarkeun tur geus aya rojongan dina wangun néangan duplikat lengkep jeung sarupa:

sumber

• métode optimasi indéks adaptif
• Utiliti SQLIndexManager
• Tinjauan teknis ringkes ngeunaan utilitas SQLIndexManager
• sawala ngeunaan utiliti SQLIndexManager
• Manajer Indéks SQL - Alat GUI Gratis pikeun Pangropéa Indéks dina SQL Server sareng Azure
• Analisis Indéks SQL Server sareng Optimasi

sumber: www.habr.com