We Are Customer-centric And Provide Customized Or One-stop Full-stack Solutions To Empower All Industries.
The Xx Network Security Brigade Plans To Deploy Mobile Terminal Hardware Feature Collection Equipment In Key Areas Such As Internet Cafes, Large Chain Stores, Public Telephone Booths On Key Roads, And Bus Stations Throughout The District To Monitor Mobile Terminal Devices In The Area. It Realizes Functions Such As Data Collection, Real-time Feedback, Data Aggregation (Data Warehouse), Entry Alarm, And Trajectory Tracking, Providing A Powerful Grip For Public Security Organs In Public Wifi Control Work.
With The Increase In The Number Of Data Collection Devices Invested By Xx Network Security, The Increase In Data Access Volume, And The Increasing Complexity Of Business Analysis Scenarios, More Powerful Data Warehouse Support Is Required. The Original Rdbms-based Data Warehouse Has Reached A Performance Bottleneck; Therefore, Shanghai Xx Network Security Urgently Needs A More Advanced Technology That Can Not Only Solve The Current Problems, But Also Meet The Needs Of Future Business Development. The Problems Encountered By Rdbms Are Mainly Reflected In The Following Four Aspects:
1. Data Etl Takes Longer And Longer, And Cannot Meet The Target System’s Requirements For Data Timeliness. The Sla Of Critical Tasks Cannot Be Guaranteed.
2. Rdbms Performance Optimization (Index & Partition) Cannot Overcome The I/o Bottleneck. At The Same Time, The Continuous Increase Of Indexes And Partitions In The Data Warehouse Also Increases The Resource Consumption Of The System During Loading, And Increases The System Maintenance Level.
3. Due To Performance Reasons, The Random Query Capability Is Limited, And The Retrieval Scenario Only Supports 7 Days Of Data, And Real-time Tracking For A Longer Time Axis Is Not Possible.
4. The Current System Architecture Does Not Support Linear Expansion, Which Restricts Data Storage. Expansion Requires High Costs To Purchase Large Equipment. Even So, It Is Impossible To Control The Performance Processing Pressure Brought By Data Growth.
The Following Figure Is Based On The Architecture Design And Data Flow Of The Powerleader Big Data Platform:
size | 2U rack-mount server, 86.1mm ( height ) * 447mm ( width ) * 790mm ( depth ) |
CPU | Equipped with two 6230R/26C/52T / 2.1GHz processors |
Hard disk slot | Provides 12 3.5- inch hard disk slots, equipped with 2 960G SSD system disks and 10 4TB data disks |
Network port | 4 Gigabit electrical ports, 4 10G optical ports (including 4 10G optical modules) |
RAID | 2G cache RAID array card (supports RAID0 1 10 ) and is equipped with super capacitor |
PCIE slot | Configure at least 4 PCIe slots |
power supply | Configured with 2 AC power modules, 1+1 |
operating system | Centos7.6 |
Powerleader Big Data Integrated Machine (Pr2715p2) Is A 2u Server Product Newly Launched By Powerleader. It Adopts Intel C620 Series High-performance Chipset And Supports The Second-generation Intel® Xeon® Processor Scalable Processor Series. This Model Supports Up To 3 Tb Of Memory Capacity, 8 Hot-swappable 3.5-inch Hard Disks By Default, And Optional 12-disk/24-disk Versions, And Can Flexibly Expand Full-height And Full-length Pci-e Devices. The Highly Integrated Design Brings Strong Performance In A Limited Space To Support The Operation Of Critical Tasks. Pr2715p2 Provides Advanced Management Functions And Storage Technology, With Reliable Scalability And High Availability
The Main Process Is That After The Acquisition Device Collects The Source Data, It Passes Through The Grating, And Part Of The Data Will Be Transmitted To The Ftp Server. When The Data Scheduling Server Finds That There Is New Data Arriving From The Ftp Server, It Will Clean And Integrate The Data, And Then Summarize It Into The Inceptor Data Warehouse And The Hyperbase Retrieval Library. Another Part Of The Data Directly Enters The Hyperbase Retrieval Library Through The Distributed Message Queue, And The Front-end Application System Can Access And Use The Data.
Up To Now, Shanghai Xx Network Security Has Completely Replaced The Previous Rdbms Database, And It Has Been Running Smoothly For About A Year, Storing A Total Of 150t Of Data, With A Weekly Data Growth Of About 4t. The Front-end Application System Has Given Good Feedback. With The Continuous Development Of Public Security Business In Recent Years And The Continuous Addition Of Hardware Equipment, The Storage And Processing Capacity Has Continued To Increase. The Tdh Big Data Platform Can Fully Meet The Requirements Through Linear Expansion.
Single-user Analysis And Quick Query Are Implemented Using The Hyperbase Component Of Powerleader. Through Powerleader's Powerful Sql Support And Jdbc Interface, Combined With Powerleader's Full-text Search Engine Search Component, Accurate Results Can Be Queried With Superior Low-latency Response Speed To Ensure Stable Business Operation.
