-
Notifications
You must be signed in to change notification settings - Fork 28
/
Copy pathqq群社工库处理.txt
71 lines (54 loc) · 2.31 KB
/
qq群社工库处理.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
为什么不花些时间都放在同一张表里,这样更方便啊
INSERT INTO NewDB.dbo.Newtable(.......) SELECT (......) FROM GroupData1.dbo.Group1
INSERT INTO NewDB.dbo.Newtable(.......) SELECT (......) FROM GroupData1.dbo.Group2
.....
INSERT INTO NewDB.dbo.Newtable(.......) SELECT (......) FROM GroupData2.dbo.Group101
INSERT INTO NewDB.dbo.Newtable(.......) SELECT (......) FROM GroupData2.dbo.Group102
.....
以此类推,一共1100条,编辑好后放到查询分析器执行,我电脑耗时3个小时
之后针对QQ号和群号分别建立索引
USE [NewDB]
GO
CREATE NONCLUSTERED INDEX [IDX_QQ_NUM] ON [dbo].[Newtable]
(
[QQNum] ASC
)WITH (STATISTICS_NORECOMPUTE = OFF, SORT_IN_TEMPDB = OFF, IGNORE_DUP_KEY = OFF, DROP_EXISTING = OFF, ONLINE = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [PRIMARY]
GO
USE [NewDB]
GO
CREATE NONCLUSTERED INDEX [IDX_QUN_NUM] ON [dbo].[Newtable]
(
[QunNum] ASC
)WITH (STATISTICS_NORECOMPUTE = OFF, SORT_IN_TEMPDB = OFF, IGNORE_DUP_KEY = OFF, DROP_EXISTING = OFF, ONLINE = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [PRIMARY]
GO
每个索引建立时间大约3个小时。(索引建立要放在查询分析器用命令执行,不要使用GUI,数据量太大,会提示超时)
这样弄好后就是一个库一个表,可以实现瞬间反馈查询结果了
批处理合并
group合并
::合并所有表
@echo off
del /f /q 1.sql
setlocal Enabledelayedexpansion
set p=0
for /l %%i in (1,1,11) do (
for /l %%j in (1,1,100) do (
set /a p=!p!+1
echo INSERT INTO qqinfo.dbo.qqinfo^([QQNum],[Nick],[Age],[Gender],[Auth],[QunNum]^) SELECT [QQNum],[Nick] ,[Age] ,[Gender] ,[Auth],[QunNum] FROM GroupData%%i.dbo.Group!p!>>1.sql
echo go>>1.sql
)
)
osql -E -i 1.sql
qunlist合并
::合并所有表
@echo off
del /f /q 1.sql
setlocal Enabledelayedexpansion
set p=0
for /l %%i in (1,1,11) do (
for /l %%j in (1,1,10) do (
set /a p=!p!+1
echo INSERT INTO qqinfo.dbo.quninfo^([QunNum],[MastQQ],[CreateDate],[Title],[Class],[QunText]^) SELECT [QunNum],[MastQQ],[CreateDate],[Title],[Class],[QunText] FROM QunInfo%%i.dbo.QunList!p!>>1.sql
echo go>>1.sql
)
)
osql -E -i 1.sql