Skip to Content

SNS Data Analysis System

Category

Custom Software Development

Project size

4 MMDs

Industry

Data management

Technologies
  • Front-End: Angular 8, Open Layer, Open Street Map
  • Back-End: Node.js, Nginx
  • Database: MongoDB, MariaDB
Scope of work

Full-Stack Development

Quality assurance


About the project

BHSOFT partnered with a leading Japanese manufacturing solutions firm to develop an SNS (Social Network Service) data analysis system aimed at forecasting natural disasters. The system utilizes real-time Twitter data to monitor and evaluate disaster-related information via a geospatial data information system, displayed through a comprehensive dashboard.


The client, a prominent player in the manufacturing solutions sector, specializes in developing automated design systems based on CAD, structural analysis systems for construction and civil engineering, environmental simulation tools, and GIS asset management solutions.

The client sought to leverage social media data, specifically from Twitter, to predict, prepare for, and alert authorities about potential natural disasters. This would be achieved by monitoring disaster-related keywords on Twitter and visualizing the data in a geospatial dashboard.


With a longstanding relationship with BHSoft, the client turned to us for expertise in developing a robust system that can analyze vast quantities of SNS data, monitor specific disaster-related keywords in real-time, and provide actionable insights through an intuitive dashboard interface.

One of the primary challenges encountered during the project was the large volume of Twitter data. The sheer size of the data initially slowed down the system’s performance. However, leveraging BHSOFT’s extensive experience in GIS (Geographical Information Systems) and big data analytics, we were able to implement a solution that optimized the handling of Twitter data. This optimization ensured smoother processing, enhanced the system's performance, and resulted in a seamless user experience.

With years of expertise in GIS, BHSOFT developed a geospatial data information system specifically tailored for disaster monitoring and analysis. The system continuously monitors predefined disaster-related keywords on Twitter and compiles relevant data for visualization on the dashboard.


The key functionalities of the system include:


  • Dashboard Screen: Displays real-time keyword rankings, keyword charts, and a map detailing essential information about tweeted keywords, including time, location, and content.
  • Tweet Search Screen: Allows users to search for disaster-related keywords, exclude unwanted terms, and filter by language preference. Results are accompanied by detailed tweet information, and users can export data in CSV format.
  • Statistic Screen: Shows the ranking and percentage of instances recorded for each keyword, offering the ability to generate graphs and export data in CSV format.
  • Keyword Management Screen: Admin-only feature for managing disaster-related keywords. Administrators can create, edit, or remove keywords and set thresholds for monitoring. Keywords can also be displayed in a historical chart.
  • Keyword Exclusion Screen: Admin-only feature to manage exclusion lists. This allows administrators to create, edit, or remove keywords from the exclusion list.
  • User Management Screen: Admin-only feature for managing standard user accounts, allowing administrators to create, edit, or remove user profiles.