We have established a big data platform that can integrate and analyze internal data such as business reports, approval documents, and external data such as SNS and news.
Challenges
Establishment of pilot systems such as regular audits and civil complaints of big data and artificial intelligence loan businesses to efficiently perform supervisory and inspection work and enhance the rights and interests of financial consumers
Need to introduce software to support large-capacity distributed processing and machine learning required for big data and artificial intelligence operation
Solutions
Introduction of TeraONE, a big data platform based on Apache Hadoop with ETL and in-memory distribution technology
Provides 1:1 automatic program generation using Excel mapping format
Provides a function to integrate and analyze internal data such as business reports, approval documents, etc., and external data such as SNS, news, etc
Benefits
Building an Optimized Big Data Platform
Establishment of TeraONE, a hybrid big data platform that supports both existing and Hadoop systems
Provides web monitoring capabilities
Provides real-time monitoring of data processing and fault conditions
Provides project permission management by user and group
Secure Name Node Server with Redundancy
HA configuration with Apache Zookeeper to prepare for Name node and Resource Manager failures
Name node disk configuration uses RAID5 to configure a backup-to-disk scheme
Configure data node replication to ensure availability, continuity of disaster recovery services
Supports Hadoop environments without disruption when adding or removing nodes, and ensures data reliability with data triple replication