User Behavior Analytics
Published:
Distributed Data Processing · Jun 2024–Sep 2024
Deployed a Hadoop data processing stack on Linux and used shell scripts and HiveQL to clean and analyze user behavior data.
Technologies: Linux, Hadoop, Hive, HBase, Shell, MySQL
Cluster Deployment and Integration
I helped deploy, configure, and integrate a Hadoop cluster, a Hive data warehouse, and an HBase database to support distributed storage and processing of user behavior data.
Data Cleaning and Exchange
I used shell scripts to deduplicate records, fill missing fields, and standardize formats. I also transferred data between Hive, MySQL, and HBase.
Analysis
I used HiveQL to analyze user conversion, rank products by sales, and track active-user trends over time.