Implement the co-occurrence problem over common crawl dataset:https://registry.opendata.aws/commoncrawl/(Links to an external site.), compare the performance of different optimisations such as pairs,...

Implement the co-occurrence problem over common crawl dataset:https://registry.opendata.aws/commoncrawl/(Links to an external site.), compare the performance of different optimisations such as pairs, stripes by changing number of clusters, dataset size, etc. If you implement this, you can get afairscore. If you further implement local aggregation, partitioner, combiner, you will get agoodscore. If you further use multiple datasets from AWS except the common crawl to do above analysis, you will getfullmark.