Community Detection using Girvan-Newman Algorithm and Spark Framework
VerifiedAdded on 2019/09/30
|5
|1250
|54
Homework Assignment
AI Summary
This assignment focuses on implementing the Girvan-Newman algorithm using the Spark framework to detect communities in a graph derived from Amazon Instant Video review data. The task is divided into two parts. Task 1 requires calculating the betweenness of each edge in the graph using the Girvan-Newman algorithm. Task 2 involves implementing betweenness and modularity calculations to divide the graph into communities that maximize modularity. The solution involves processing the provided dataset using Spark RDDs, adhering to specific runtime and output formatting requirements. The final submission includes source code (Scala or Python), result files, and a description file detailing the environment and execution instructions. The assignment emphasizes efficient community detection in a distributed environment.
Contribute Materials
Your contribution can guide someone’s learning journey. Share your
documents today.
1 out of 5