face-imsi (3-2 18:00-3-3 20:33 lasted 26 hours and 30 minutes. 10s/piece. 9473. Average 10s/piece.
[framework] 2021-03-03 20:27:38 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9446
[framework] 2021-03-03 20:27:44 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9447
[framework] 2021-03-03 20:27:59 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9448
[framework] 2021-03-03 20:28:04 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9449
[framework] 2021-03-03 20:28:06 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9450
[framework] 2021-03-03 20:28:13 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9451
[framework] 2021-03-03 20:28:24 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9452
[framework] 2021-03-03 20:28:27 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9453
[framework] 2021-03-03 20:28:30 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9454
[framework] 2021-03-03 20:28:36 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9455
[framework] 2021-03-03 20:28:44 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9456
[framework] 2021-03-03 20:28:53 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9457
[framework] 2021-03-03 20:29:00 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9458
[framework] 2021-03-03 20:29:07 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9459
[framework] 2021-03-03 20:29:19 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9460
[framework] 2021-03-03 20:29:22 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9461
[framework] 2021-03-03 20:29:28 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9462
[framework] 2021-03-03 20:29:39 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9463
[framework] 2021-03-03 20:29:49 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9464
[framework] 2021-03-03 20:30:35 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9465
[framework] 2021-03-03 20:31:38 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9466
[framework] 2021-03-03 20:31:41 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9467
[framework] 2021-03-03 20:32:22 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9468
[framework] 2021-03-03 20:32:31 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9469
[framework] 2021-03-03 20:33:01 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9470
[framework] 2021-03-03 20:33:06 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9471
[framework] 2021-03-03 20:33:11 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9472
[framework] 2021-03-03 20:33:16 - [ INFO ] - RefreshFaceImsiJob : 75 - *-*--**-*-*-------------RefreshFaceImsiJob-End= ,SIZE:9473个,已经处理个数:9473
face-mac( 3-2 21:00~ 3-3 22:35) lasted 25 hours and 35 minutes, 10s/piece, 9670 pieces. The check is roughly correct.
[framework] 2021-03-03 22:33:28 - [ INFO ] - RefreshFaceMacJob : 73 - *-*--**-*-*-------------RefreshFaceMacJob-END ,SIZE:9670个,已经处理个数:9655
[framework] 2021-03-03 22:33:33 - [ INFO ] - RefreshFaceMacJob : 73 - *-*--**-*-*-------------RefreshFaceMacJob-END ,SIZE:9670个,已经处理个数:9656
[framework] 2021-03-03 22:33:39 - [ INFO ] - RefreshFaceMacJob : 73 - *-*--**-*-*-------------RefreshFaceMacJob-END ,SIZE:9670个,已经处理个数:9657
[framework] 2021-03-03 22:33:52 - [ INFO ] - RefreshFaceMacJob : 73 - *-*--**-*-*-------------RefreshFaceMacJob-END ,SIZE:9670个,已经处理个数:9658
[framework] 2021-03-03 22:33:58 - [ INFO ] - RefreshFaceMacJob : 73 - *-*--**-*-*-------------RefreshFaceMacJob-END ,SIZE:9670个,已经处理个数:9659
[framework] 2021-03-03 22:34:02 - [ INFO ] - RefreshFaceMacJob : 73 - *-*--**-*-*-------------RefreshFaceMacJob-END ,SIZE:9670个,已经处理个数:9660
[framework] 2021-03-03 22:34:05 - [ INFO ] - RefreshFaceMacJob : 73 - *-*--**-*-*-------------RefreshFaceMacJob-END ,SIZE:9670个,已经处理个数:9661
[framework] 2021-03-03 22:34:14 - [ INFO ] - RefreshFaceMacJob : 73 - *-*--**-*-*-------------RefreshFaceMacJob-END ,SIZE:9670个,已经处理个数:9662
[framework] 2021-03-03 22:34:23 - [ INFO ] - RefreshFaceMacJob : 73 - *-*--**-*-*-------------RefreshFaceMacJob-END ,SIZE:9670个,已经处理个数:9663
[framework] 2021-03-03 22:34:33 - [ INFO ] - RefreshFaceMacJob : 73 - *-*--**-*-*-------------RefreshFaceMacJob-END ,SIZE:9670个,已经处理个数:9664
[framework] 2021-03-03 22:34:39 - [ INFO ] - RefreshFaceMacJob : 73 - *-*--**-*-*-------------RefreshFaceMacJob-END ,SIZE:9670个,已经处理个数:9665
[framework] 2021-03-03 22:34:54 - [ INFO ] - RefreshFaceMacJob : 73 - *-*--**-*-*-------------RefreshFaceMacJob-END ,SIZE:9670个,已经处理个数:9666
[framework] 2021-03-03 22:34:59 - [ INFO ] - RefreshFaceMacJob : 73 - *-*--**-*-*-------------RefreshFaceMacJob-END ,SIZE:9670个,已经处理个数:9667
[framework] 2021-03-03 22:35:05 - [ INFO ] - RefreshFaceMacJob : 73 - *-*--**-*-*-------------RefreshFaceMacJob-END ,SIZE:9670个,已经处理个数:9668
[framework] 2021-03-03 22:35:20 - [ INFO ] - RefreshFaceMacJob : 73 - *-*--**-*-*-------------RefreshFaceMacJob-END ,SIZE:9670个,已经处理个数:9669
[framework] 2021-03-03 22:35:26 - [ INFO ] - RefreshFaceMacJob : 73 - *-*--**-*-*-------------RefreshFaceMacJob-END ,SIZE:9670个,已经处理个数:9670
traffic-imsi 3-4 00:00:00 ~3-4 04:21 4 hours 21 minutes, 5406, 3 seconds each. Checking calculation: 5406*3/3600=4.5. Checking calculation is correct.
[framework] 2021-03-04 00:00:00 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:1
[framework] 2021-03-04 00:00:04 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:2
[framework] 2021-03-04 00:00:06 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:3
[framework] 2021-03-04 00:00:09 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:4
[framework] 2021-03-04 00:00:12 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:5
[framework] 2021-03-04 00:00:18 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:6
[framework] 2021-03-04 00:00:23 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:7
[framework] 2021-03-04 00:00:25 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:8
[framework] 2021-03-04 00:00:25 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:9
[framework] 2021-03-04 00:00:30 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:10
[framework] 2021-03-04 00:00:31 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:11
[framework] 2021-03-04 00:00:32 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:12
[framework] 2021-03-04 00:00:34 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:13
[framework] 2021-03-04 00:00:37 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:14
[framework] 2021-03-04 00:00:40 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:15
[framework] 2021-03-04 00:00:44 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:16
[framework] 2021-03-04 00:00:51 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:17
[framework] 2021-03-04 00:00:57 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:18
[framework] 2021-03-04 00:01:01 - [ INFO ] - RefreshTrafficImsiJob : 75 - *-*--**-*-*-------------RefreshTrafficImsiJob-END,SIZE:5406个,已经处理个数:19
traffic-mac 3-4 2:00~5:18 3 hours and 18 minutes, 2seconds/each. 5688. The verification is correct. 5688*2/3600=3.16
[framework] 2021-03-04 05:17:37 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5667
[framework] 2021-03-04 05:17:45 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5668
[framework] 2021-03-04 05:17:47 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5669
[framework] 2021-03-04 05:17:54 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5670
[framework] 2021-03-04 05:17:54 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5671
[framework] 2021-03-04 05:17:55 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5672
[framework] 2021-03-04 05:17:57 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5673
[framework] 2021-03-04 05:17:58 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5674
[framework] 2021-03-04 05:17:59 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5675
[framework] 2021-03-04 05:17:59 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5676
[framework] 2021-03-04 05:18:01 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5677
[framework] 2021-03-04 05:18:01 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5678
[framework] 2021-03-04 05:18:03 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5679
[framework] 2021-03-04 05:18:03 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5680
[framework] 2021-03-04 05:18:05 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5681
[framework] 2021-03-04 05:18:05 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5682
[framework] 2021-03-04 05:18:07 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5683
[framework] 2021-03-04 05:18:07 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5684
[framework] 2021-03-04 05:18:07 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5685
[framework] 2021-03-04 05:18:09 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5686
[framework] 2021-03-04 05:18:13 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5687
[framework] 2021-03-04 05:18:14 - [ INFO ] - RefreshTrafficMacJob : 73 - *-*--**-*-*-------------RefreshTrafficMacJob-END= ,SIZE:5688个,已经处理个数:5688
Cause Analysis:
imagecode in traffic: The count is dozens of less than 50.
imagecode in face : count 200.
The larger the table, the more data can be deleted in one batch, and the more time-consuming it is.
Solution: Reduce the amount of data inserted in batches. There are fewer natural deletions and fewer insertions.