Leverage Cloud Technologies for Malware Hunting at Scale

How to index hundreds of terabytes of malware using Apache Spark and Iceberg tables

In this article, we will show how we used Spark and Iceberg tables to implement a malware index similar to UrsaDB and integrated this index into Mquery an analyst-friendly web GUI to submit YARA rules and display results.

This proof of concept was developed during GeekWeek an annual workshop organized by the Canadian Centre for Cyber Security and bring together …

big data cloud cloud computing editors pick jupyter-notebook malware scale spark technologies