慧博云通
Baidao helps Huibo Yuntong with log data analysis
Company Profile
Huibo Yuntong Technology Co., Ltd. was founded in 2009 with a registered capital of 360 million yuan. It is a national high-tech enterprise specializing in software information technology services. Headquartered in Hangzhou, its business spans the globe, providing professional technical services to customers in industries such as finance, telecommunications, the Internet, and high-tech. Huibo Yuntong is committed to becoming an international, professional, and innovative software technology service enterprise, continuously creating value for customers.
industry
Internet
Case background and challenges
As production data and logs become increasingly complex, it is more challenging to extract data insights from the data captured in the logs. There are more and more sources of logs, making it difficult to organize and query useful information.
Scheme architecture description
- Install the Cloud Logging agent in the application server to capture log messages.
- When logs are available in Logging, the script will automatically route the logs to the Cloud Storage partition using the Logging support provided by the Cloud SDK.
- Dataflow processes the logs by extracting metadata and calculating basic summary data.
- The Dataflow pipeline is designed to process log elements daily and generate summary metrics for server response times based on the daily logs.
- The output of Dataflow is loaded into a BigQuery table, where it is analyzed to provide business intelligence.
- BigQuery provides a highly scalable and cost – effective option that enables us to capture and analyze data in real – time.
Use the product
- Cloud Logging
- Cloud Storage
- Anthos
- Pub/Sub
- Dataflow
- Big Query
Features of the plan
Collect the logs generated during the runtime of applications and servers in real time through Cloud Logging and store them in Cloud Storage. Monitor the health status of the application’s operation in real time, analyze the logs through BigQuery to predict the occurrence cycle of anomalies and make treatment plans in advance. In the face of complex and changeable anomalies, real-time monitoring of the application can also be carried out in conjunction with Cloud Monitoring, so as to understand the problem in the first place. This can further reduce the time of abnormal downtime.
Customer benefits
1、Quickly troubleshoot problems
Traditional logs face huge difficulties in viewing, collecting, and searching, which requires a lot of time. Using Cloud Logging simplifies this process, making operations and maintenance no longer difficult, greatly shortening the problem – troubleshooting time and reducing losses.
2、Google results
- Huibo Yuntong uses A/B testing to understand user preferences, helping to increase the application retention rate by 20%.
- By pushing products preferred by users, it expands the user base and doubles the interaction rate.
- It seamlessly integrates with the Google Cloud ecosystem to build a more complete data set for understanding customer needs.
- Based on the data provided by BigQuery and Dataflow, it optimizes the loading logic and increases the advertising click – through rate by 20%.