SEARCH KEYWORD -- Big four



  Cleansing data with Pig and storing JSON format to HBase with Pig UDF

Introduction This post will explain you the way to clean data and store JSON format to HBase. Hadoop architect experts also explain Apache Pig and its advantages in Hadoop in this post. Read more and find out how they do it. This post contains steps to do some basic clean the duplication data and convert the data to JSON format to store to HBase. Actually, we have some built-in lib to parse JSON in Pig but it is important to manipulate the JSON data in Java code before store to HBase. Apache Pig...

   JSON,HADOOP ARCHITECT,APACHE HBASE,PIG UDF     2016-06-10 01:13:41

  Python FTP Server and Client

Distributed Log File Automated Archive System This week, we will introduce the automated compute cluster nodes' log automated archive system project and FTP Communication utility library module. Program Design Purpose: This project aims to create an FTP server & client lib program for file transfer and a files management system for log data synchronization. We will develop an automated log file archive system that regularly collects newly generated log files from multiple nodes in a compute...

       2024-09-29 04:07:50

  How VR technologies take over the world

Virtual Reality (VR) literally may get it beneficial to experience anything, anywhere, anytime. It is normally the several immersive type of legitimate fact technology and can convince the real real human human brain that it is usually normally someplace it can get absolutely critically not really seriously. Brain installed displays happen to be used with earphones and hands controllers to offer a entirely immersive arrive across. With the major technology businesses on whole world community (Fa...

       2019-05-20 05:30:39

  OT Railway System Development: How to Use PLC to Implement Land Based Railway Track Fixed Block Sign

Figure-00: Railway fixed block signaling system over view diagram, version v1.3 (2024) Project Design Purpose: This project aims to use Programmable Logic Controllers (PLC) with train detection sensors and train control signals to develop an automated OT system for railway track fixed block signaling control. The system will include a digital equivalent simulation to explain the logic of the track fixed block Automatic Train Control (ATC) mechanism for demonstration and training purposes. In th...

       2024-07-27 04:08:41

  SIEM Big Data Visualization [03]:Graph-Based SIEM Log Analysis Dashboard

Program Design Purpose: The purpose of this program is to develop a Graph-Based SIEM (System Information and Event Management) dashboard that visualizes network communication patterns by processing and analyzing logs from IDS, firewalls, host computers, and other security devices. This dashboard will help security analysts quickly identify and investigate potential threats by using a Cytoscape-style Node-Edge graph for intuitive data representation. The program is an angular plug in which can i...

       2024-10-26 04:31:11

  SIEM Big Data Visualization [02]: National Cyber Threats Dashboard

Dashboard for Summarizing SG National Cyber Threats in Critical Infrastructure Program Design Purpose: The purpose of this program is to develop a comprehensive Angular web dashboard plugin for a Security Information and Event Management (SIEM) system, focusing on the effective monitoring, categorization, summarization, and visualization of cyber threat events targeting Singapore's critical infrastructure. This dashboard will provide researchers and security managers with a clear, concise view ...

       2024-10-19 09:56:45

  SIEM Big Data Visualization : Dashboard for Monitoring Scam Events in Critical Infrastructure

Project Design Purpose: In a Security Information and Event Management (SIEM) system, effective monitoring and visualization of scam events is crucial to detecting and responding to cyberattacks. Cybercriminals often use deceptive methods to exploit individuals or organizations, aiming to steal sensitive information, financial assets, or disrupt operations. This project seeks to develop a web plugin dashboard to help cybersecurity researchers and managers better understand the scope and impact ...

       2024-10-05 20:47:09

  LinkedIn is out of China and replaced with LinkedIn Jobs

The popular job searching site LinkedIn has come out a special version for China which is just offering job searching capabilities and messaging capabilities in the connections. The social media capability like news feeds and peoples activities are stripped out. Now if you are in China and open LinkedIn app, it will prompt you and ask you to download an app called LinkedIn Jobs. You will not be able to dismiss the dialog and you are forced to download the other app if you wanna continue to...

   LINKEDIN,LINKEDIN JOBS,CHINA,MICROSOFT     2021-12-24 20:13:24

  Is Toutiao taking general content creators seirously?

Tiktok is now very popular among the Z-generation around the world. This is an app created by the Chinese company ByteDance. In China, the Chinese version of Tiktok called Douyin is not the only popular app created by ByteDance, there are a few other apps created by ByteDance are also popular such as Jinri Toutiao, a news app famous for its recommendation algorithm similar to Tiktok, also Huoshan Video, another video app similar to YouTube. This Toutiao app encourages general people to create co...

   JINRI TOUTIAO,CONTENT CREATION,TOUTIAO,BYTEDANCE     2021-10-03 01:10:27

  Google transferred a domain name to a Chinese company for free

Google just completed a domain transfer to another company in China. The interesting part is that this domain transfer is for free. The story begins with a recent tweet from the CEO Dash Huang of a Chinese game company called X.D. Network Inc who claims that they obtained the domain name taptap.cn from Google for free. From the tweet, Mr. Huang expressed his appreciation to Google for freely transferring the domain name taptap.cn to their company. Their company launched some product ...

   GOOGLE,TAPTAP.CN,TAPTAP     2021-09-29 11:17:18