DataMining - Network Graph on Ask Ubuntu Question Forum

SJSU CMPE239 - Web and Data Mining class project

Mission: visualize the quality and relationship of questions on Ask Ubuntu forum by a network graph.

Demo running on Heroku

Live Demo on Heroku

Data Pipeline

Docs

• Logistics:
  • Project idea
  • Workflow
• Project Report: Paper
• Presentation: Slides

Resources

• Ask Ubuntu: Tutorial
• Datasets: Stack Exchange Data Dump
• Data attributes: Fields details
• Data - intermidiate results: Google Drive

Tools

• Data Processing:
  • Bash-Sed
  • Pig
  • Hive
• Analysis: R Project
• Vidualization:
  • Gephi
  • Sigma.js
• Hosting Sever: Node.js