Performance
The performance data in this document is based on the default configuration. If you are facing high network latency or high throughput write scenarios, you can refer to the Operation Manual for optimization.
Test Datasetβ
- Dataset: TPC-H 1T
Test Cluster Configurationβ
Configuration Item | Upstream Configuration | Downstream Configuration |
---|---|---|
FE | 2 cores 16 GB | 2 cores 16 GB |
BE | 3 nodes, 16 cores 64 GB, 3*500 GB per node | 3 nodes, 16 cores 64 GB, 3*500 GB per node |
Incremental Synchronization Performance Testβ
Test Stepsβ
- Create the database and tables for TPC-H 1T in the upstream cluster.
- Create a synchronization job for the TPC-H 1T database.
- Wait for the TPC-H 1T data import to complete and record the completion time.
- Wait for the downstream data synchronization to complete and record the completion time.
Test Conclusionβ
Incremental synchronization time difference: 33 seconds
Full Synchronization Performance Testβ
Test Stepsβ
- Create the library and table information for TPC-H 1T in the upstream cluster and complete the data import, recording the completion time.
- Create a synchronization job for the TPC-H 1T database.
- Wait for the downstream data synchronization to complete and record the completion time.
Test Conclusionβ
Full synchronization time difference: 6 minutes 1 second
Flink Synchronization Performance Testβ
Test Stepsβ
- Use Flink to import 100,000,000 records in the upstream.
- Create a synchronization job for the library and table.
- Observe the difference between the downstream synchronization completion time and the upstream import completion time at each stage (e.g., 1,000,000 records, 2,000,000 records, etc.).
- Record the last import completion time in the upstream.
- Record the downstream synchronization completion time.
Test Conclusionβ
The lag time at each stage is maintained within 5 seconds
.